Skip to content

Commit 818eaf4

Browse files
y-guyony-guyon
authored
Codec-Compare version 0.2.1 (#8)
1 parent 2b02778 commit 818eaf4

24 files changed

Lines changed: 361 additions & 111 deletions

‎CHANGELOG.md‎

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,20 @@
11
# Changelog
22

3+
## v0.2.1
4+
5+
- Display the URL of the batch JSON on load failure.
6+
- Display a warning when using effort or quality encoding setting as a match
7+
criterion.
8+
- Display enabled filters in the Summary tab.
9+
- Do not group batches with different filters in the Summary tab.
10+
- Add built-in support for raw decoding duration (same as decoding duration but
11+
exclusive of any color conversion).
12+
- Limit JPEG XL input quality range to [75:99] by default.
13+
- Rename "quality metric" to "distortion metric" in the code to avoid confusing
14+
it with "encoder quality setting".
15+
- Select default distortion metrics based on what the codecs optimize for.
16+
- Fix NaN issue with mwc-slider handling non-integer ranges.
17+
318
## v0.2.0
419

520
- Show a simple sentence by default. Keep the advanced interface in another tab.

‎assets/demo_batch_other_codec_settingA.json‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -27,24 +27,24 @@
2727
{ "effort": "Compression effort parameter" },
2828
{ "quality": "Compression quality parameter" },
2929
{
30-
"psnr": "Quality metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
30+
"psnr": "Distortion metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
3131
},
3232
{
33-
"ssim": "Quality metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
33+
"ssim": "Distortion metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
3434
},
3535
{
36-
"msssim": "Quality metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
36+
"msssim": "Distortion metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
3737
},
3838
{
39-
"butteraugli": "Quality metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
39+
"butteraugli": "Distortion metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
4040
},
4141
{
42-
"ciede2000": "Quality metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
42+
"ciede2000": "Distortion metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
4343
},
4444
{ "encoding_time": "Encoding duration in seconds (approximate)" },
4545
{ "decoding_time": "Decoding duration in seconds (approximate)" },
4646
{
47-
"ssimulacra": "Quality metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
47+
"ssimulacra": "Distortion metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
4848
},
4949
{ "encoded_size": "Size of the encoded image file in bytes" },
5050
{

‎assets/demo_batch_other_codec_settingB.json‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -27,24 +27,24 @@
2727
{ "effort": "Compression effort parameter" },
2828
{ "quality": "Compression quality parameter" },
2929
{
30-
"psnr": "Quality metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
30+
"psnr": "Distortion metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
3131
},
3232
{
33-
"ssim": "Quality metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
33+
"ssim": "Distortion metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
3434
},
3535
{
36-
"msssim": "Quality metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
36+
"msssim": "Distortion metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
3737
},
3838
{
39-
"butteraugli": "Quality metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
39+
"butteraugli": "Distortion metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
4040
},
4141
{
42-
"ciede2000": "Quality metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
42+
"ciede2000": "Distortion metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
4343
},
4444
{ "encoding_time": "Encoding duration in seconds (approximate)" },
4545
{ "decoding_time": "Decoding duration in seconds (approximate)" },
4646
{
47-
"ssimulacra": "Quality metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
47+
"ssimulacra": "Distortion metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
4848
},
4949
{ "encoded_size": "Size of the encoded image file in bytes" },
5050
{

‎assets/demo_batch_other_codec_settingC.json‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -27,24 +27,24 @@
2727
{ "effort": "Compression effort parameter" },
2828
{ "quality": "Compression quality parameter" },
2929
{
30-
"psnr": "Quality metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
30+
"psnr": "Distortion metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
3131
},
3232
{
33-
"ssim": "Quality metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
33+
"ssim": "Distortion metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
3434
},
3535
{
36-
"msssim": "Quality metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
36+
"msssim": "Distortion metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
3737
},
3838
{
39-
"butteraugli": "Quality metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
39+
"butteraugli": "Distortion metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
4040
},
4141
{
42-
"ciede2000": "Quality metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
42+
"ciede2000": "Distortion metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
4343
},
4444
{ "encoding_time": "Encoding duration in seconds (approximate)" },
4545
{ "decoding_time": "Decoding duration in seconds (approximate)" },
4646
{
47-
"ssimulacra": "Quality metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
47+
"ssimulacra": "Distortion metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
4848
},
4949
{ "encoded_size": "Size of the encoded image file in bytes" },
5050
{

‎assets/demo_batch_some_codec_effort0.json‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -18,24 +18,24 @@
1818
{ "effort": "Compression effort parameter" },
1919
{ "quality": "Compression quality parameter" },
2020
{
21-
"psnr": "Quality metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
21+
"psnr": "Distortion metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
2222
},
2323
{
24-
"ssim": "Quality metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
24+
"ssim": "Distortion metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
2525
},
2626
{
27-
"msssim": "Quality metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
27+
"msssim": "Distortion metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
2828
},
2929
{
30-
"butteraugli": "Quality metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
30+
"butteraugli": "Distortion metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
3131
},
3232
{
33-
"ciede2000": "Quality metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
33+
"ciede2000": "Distortion metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
3434
},
3535
{ "encoding_time": "Encoding duration in seconds (approximate)" },
3636
{ "decoding_time": "Decoding duration in seconds (approximate)" },
3737
{
38-
"ssimulacra": "Quality metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
38+
"ssimulacra": "Distortion metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
3939
},
4040
{ "encoded_size": "Size of the encoded image file in bytes" },
4141
{ "bpp": "Encoded bits per pixel" },

‎assets/demo_batch_some_codec_effort1.json‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -18,24 +18,24 @@
1818
{ "effort": "Compression effort parameter" },
1919
{ "quality": "Compression quality parameter" },
2020
{
21-
"psnr": "Quality metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
21+
"psnr": "Distortion metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
2222
},
2323
{
24-
"ssim": "Quality metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
24+
"ssim": "Distortion metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
2525
},
2626
{
27-
"msssim": "Quality metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
27+
"msssim": "Distortion metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
2828
},
2929
{
30-
"butteraugli": "Quality metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
30+
"butteraugli": "Distortion metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
3131
},
3232
{
33-
"ciede2000": "Quality metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
33+
"ciede2000": "Distortion metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
3434
},
3535
{ "encoding_time": "Encoding duration in seconds (approximate)" },
3636
{ "decoding_time": "Decoding duration in seconds (approximate)" },
3737
{
38-
"ssimulacra": "Quality metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
38+
"ssimulacra": "Distortion metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
3939
},
4040
{ "encoded_size": "Size of the encoded image file in bytes" },
4141
{

‎assets/demo_batch_some_codec_effort2.json‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -18,24 +18,24 @@
1818
{ "effort": "Compression effort parameter" },
1919
{ "quality": "Compression quality parameter" },
2020
{
21-
"psnr": "Quality metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
21+
"psnr": "Distortion metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"
2222
},
2323
{
24-
"ssim": "Quality metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
24+
"ssim": "Distortion metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"
2525
},
2626
{
27-
"msssim": "Quality metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
27+
"msssim": "Distortion metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM"
2828
},
2929
{
30-
"butteraugli": "Quality metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
30+
"butteraugli": "Distortion metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli"
3131
},
3232
{
33-
"ciede2000": "Quality metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
33+
"ciede2000": "Distortion metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000"
3434
},
3535
{ "encoding_time": "Encoding duration in seconds (approximate)" },
3636
{ "decoding_time": "Decoding duration in seconds (approximate)" },
3737
{
38-
"ssimulacra": "Quality metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
38+
"ssimulacra": "Distortion metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra"
3939
},
4040
{ "encoded_size": "Size of the encoded image file in bytes" },
4141
{

‎assets/demo_batch_some_codec_exp.json‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -29,19 +29,19 @@
2929
{ "effort": "Compression effort parameter" },
3030
{ "quality": "Compression quality parameter" },
3131
{
32-
"psnr": "Quality metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio. Warning: There is no scientific consensus on which objective quality metric to use."
32+
"psnr": "Distortion metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio. Warning: There is no scientific consensus on which objective distortion metric to use."
3333
},
3434
{
35-
"ssim": "Quality metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity. Warning: There is no scientific consensus on which objective quality metric to use."
35+
"ssim": "Distortion metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity. Warning: There is no scientific consensus on which objective distortion metric to use."
3636
},
3737
{
38-
"msssim": "Quality metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM. Warning: There is no scientific consensus on which objective quality metric to use."
38+
"msssim": "Distortion metric Multi-Scale Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity#Multi-Scale_SSIM. Warning: There is no scientific consensus on which objective distortion metric to use."
3939
},
4040
{
41-
"butteraugli": "Quality metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli. Warning: There is no scientific consensus on which objective quality metric to use."
41+
"butteraugli": "Distortion metric Butteraugli. See https://en.wikipedia.org/wiki/Guetzli#Butteraugli. Warning: There is no scientific consensus on which objective distortion metric to use."
4242
},
4343
{
44-
"ciede2000": "Quality metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000. Warning: There is no scientific consensus on which objective quality metric to use."
44+
"ciede2000": "Distortion metric CIEDE 2000. See https://en.wikipedia.org/wiki/Color_difference#CIEDE2000. Warning: There is no scientific consensus on which objective distortion metric to use."
4545
},
4646
{
4747
"encoding_time": "Encoding duration in seconds. Warning: Timings are environment-dependent and inaccurate."
@@ -50,14 +50,14 @@
5050
"decoding_time": "Decoding duration in seconds. Warning: Timings are environment-dependent and inaccurate."
5151
},
5252
{
53-
"ssimulacra": "Quality metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra. Warning: There is no scientific consensus on which objective quality metric to use."
53+
"ssimulacra": "Distortion metric SSIMULACRA. See https://github.com/cloudinary/ssimulacra. Warning: There is no scientific consensus on which objective distortion metric to use."
5454
},
5555
{ "encoded_size": "Size of the encoded image file in bytes" },
5656
{
57-
"lpips": "Learned Perceptual Image Patch Similarity. See https://arxiv.org/abs/1801.03924. Warning: There is no scientific consensus on which objective quality metric to use."
57+
"lpips": "Learned Perceptual Image Patch Similarity. See https://arxiv.org/abs/1801.03924. Warning: There is no scientific consensus on which objective distortion metric to use."
5858
},
5959
{
60-
"flip": "Difference evaluator for alternating images. See https://research.nvidia.com/publication/2020-07_lip-difference-evaluator-alternating-images. Warning: There is no scientific consensus on which objective quality metric to use."
60+
"flip": "Difference evaluator for alternating images. See https://research.nvidia.com/publication/2020-07_lip-difference-evaluator-alternating-images. Warning: There is no scientific consensus on which objective distortion metric to use."
6161
}
6262
],
6363
"field_values": [

‎assets/demo_batch_webp_installed.json‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,8 +28,8 @@
2828
{"encoded_size": "Size of the encoded image file in bytes"},
2929
{"encoding_time": "Encoding duration in seconds"},
3030
{"decoding_time": "Decoding duration in seconds"},
31-
{"psnr": "Quality metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"},
32-
{"ssim": "Quality metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"}
31+
{"psnr": "Distortion metric Peak Signal-to-Noise Ratio. See https://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio"},
32+
{"ssim": "Distortion metric Structural Similarity Index Measure. See https://en.wikipedia.org/wiki/Structural_similarity"}
3333
],
3434
"field_values": [
3535
["logo.png", 400, 265, 0, 0, 13860, 0.00967575, 0.00139627, 40.3415, 20.6103],

‎package.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
{
22
"name": "codec_compare",
3-
"version": "0.2.0",
3+
"version": "0.2.1",
44
"description": "Codec performance comparison tool",
55
"publisher": "Google LLC",
66
"author": "Yannis Guyon",

0 commit comments

Comments
 (0)