libsvtav1 vs librav1e vs libaom-av1 Dataset

Compare the libsvtav1, librav1e and libaom-av1 encoders.

The parameters of this database

Name	Value	Description (link)	Total
video	aov, baolei_balloon, baolei_man, baolei_woman, baolei_yard, boat, bode_museum, brest_sedof, cosmos, cs_go, elevator, fountain, graphics_mix_simple, graphics_mix_transitions, heroes_of_the_storm, jianling_beach, jianling_temple, life_untouched, meridian, mine_craft, mission_control, mooving_text, neon, neptune_fountain_2, neptune_fountain_3, nocturne, oberbaum_spree, park_joy, project_cars, quadriga_tree, rain_fruits, riverbank, skater, soccer, sol_levante, sparks, star_craft, subway_tree, text_mix_transition, tiergarten_parkway, tunnel_flag world_of_warcraft	ctc	\(42\)
profile	sd, fhd	video resolution and more	\(2\)
encoder	libsvtav1, librav1e, libaom-av1	enc_encoder	\(3\)
quality	\(\left\{\frac{k}{17} \mid k \in [1,16] \right\}\)	enc_quality	\(16\)
effort	fast, medium, slow	enc_effort	\(3\)
mode	cbr, vbr	enc_mode	\(2\)
thread	\(\left\{ 8 \right\}\)	enc_threads	\(1\)
repeat	\(2\) times	total repetitions	\(2\)
ramdisk	yes	shm in enc_cmd	\(1\)
host	paradoxe-32	env_hostname	\(1\)
metrics	psnr, ssim, vif, vmaf	Table t_met_metric
total	\(\prod\)	total number of points	\(9197/48384\)

Download

mendevi download svtav1_vs_rav1e_vs_aom.db.xz.torrent

• svtav1_vs_rav1e_vs_aom.json.xz (6.9 Mo).

• svtav1_vs_rav1e_vs_aom.db.xz.torrent (24.9 Go).

Plots

Distortion and Consumption as a function of bitrate

Overall trend for all measures:

mendevi plot svtav1_vs_rav1e_vs_aom.db -x rate -y psnr -y vmaf -wx category -c '(encoder, profile)' -m effort

Result for a single video, including energy:

mendevi plot svtav1_vs_rav1e_vs_aom.db -x rate -x energy -y psnr -c encoder -m effort -wy profile -f "ref_stem=='park_joy'"

Conclusion

1. libvstav1 is significantly faster than librav1e! This difference is even more pronounced at higher throughput rates.

2. librav1e allows for lower bitrate (in constant quality mode).

3. Although librav1e shows better distortion at high bitrates, libsvtav1 is better at equal encoding duration.

Reproduce

mkdir av1
for video in ctc/*.mkv; do
    mendevi prepare $video -o av1 -p sd
    mendevi prepare $video -o av1 -p fhd
done
cd av1
mendevi encode -e fast -e medium -e slow -m cbr -m vbr -c libsvtav1 -c librav1e -c libaom-av1 reference*
mendevi probe --psnr --ssim --vif --vmaf reference* sample*