Skip to content

Commit 0428618

Browse files
authored
testing: Cut render-* test resolution in half to speed up testing (#2131)
The time it takes to run a full testsuite was slowly creeping up to an inconvenient time on CI. The most expensive test are the `render-*` tests. Cut all of their resolutions in half to speed up CI runs. Update a lot of reference images. But after updating the ref images we need to fully pass CI (and pass on my work machine and my personal laptop), I could see that there were a number of `testsuite/render-*/ref/*.exr` files that did NOT get updated in this process -- we must conclude that they are old references that are no longer needed, so I deleted them. I also noticed that testsuite/render-material-layer had no ref images updated, and some git investigation reveals that this test that was added in 2017 was NEVER in testing.cmake and thus never ran in CI at all. So just remove it. Signed-off-by: Larry Gritz <lg@larrygritz.com>
1 parent 45ae428 commit 0428618

108 files changed

Lines changed: 28 additions & 536 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

src/cmake/testing.cmake

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -374,7 +374,7 @@ macro (osl_add_all_tests)
374374
render-mx-sheen
375375
render-mx-medium-vdf
376376
render-mx-medium-vdf-glass
377-
render-microfacet render-oren-nayar
377+
render-microfacet render-oren-nayar
378378
render-spi-thinlayer
379379
render-uv render-veachmis render-ward
380380
render-raytypes
-331 KB
Binary file not shown.
-245 KB
Binary file not shown.
-245 KB
Binary file not shown.

testsuite/render-background/run.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,4 +11,4 @@
1111
idiff_program = "idiff"
1212

1313
outputs = [ "out.exr" ]
14-
command = testrender("-r 320 240 -aa 4 --options statistics:level=1 scene.xml out.exr")
14+
command = testrender("-r 160 120 -aa 4 --options statistics:level=1 scene.xml out.exr")
28.9 KB
Binary file not shown.
-62.9 KB
Binary file not shown.
-65.9 KB
Binary file not shown.

testsuite/render-bumptest/run.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,6 @@
99
hardfail = 0.035
1010

1111
outputs = [ "out.exr" ]
12-
command = testrender("-r 256 256 -aa 4 --llvm_opt 13 bumptest.xml out.exr")
12+
command = testrender("-r 128 128 -aa 4 --llvm_opt 13 bumptest.xml out.exr")
1313

1414
# Note: we pick this test arbitrarily as the one to verify llvm_opt=13 works
-239 KB
Binary file not shown.

0 commit comments

Comments
 (0)