Skip to content

testing: Reduce output precision of geomath and trig, collapse variants#2126

Merged
lgritz merged 1 commit into
AcademySoftwareFoundation:mainfrom
lgritz:lg-geomath
Jun 17, 2026
Merged

testing: Reduce output precision of geomath and trig, collapse variants#2126
lgritz merged 1 commit into
AcademySoftwareFoundation:mainfrom
lgritz:lg-geomath

Conversation

@lgritz

@lgritz lgritz commented Jun 7, 2026

Copy link
Copy Markdown
Collaborator

Analyzing the geomath and trig testsuite entries, each of them had multiple reference outputs due to small precision differences between platforms and optimization levels. By printing only 4 digits of precision (and in one case of an unstable value to pass to tan, just picking a different value), we are able to collapse those tests to one reference output each.

Assisted-by: Claude Code / Claude Opus 4.8

Analyzing the geomath and trig testsuite entires, each of them had
multiple reference outputs due to small precision differences between
platforms and optimization levels. By printing only 4 digits of
precision (and in one case of an unstable value to pass to tan, just
picking a different value), we are able to collapse those tests to one
reference output each.

only flushes near-zero values, not precision. With the reduced precision every
platform/backend produces identical text, so the four variant references are
removed and a single ref/out.txt remains. The JIT and C++
(OSL_DEBUG_OUTPUT_CPP=3) backends now produce byte-identical output and both
pass against it.

Assisted-by: Claude Code / Claude Opus 4.8

Signed-off-by: Larry Gritz <lg@larrygritz.com>
@lgritz

lgritz commented Jun 16, 2026

Copy link
Copy Markdown
Collaborator Author

Any comments?

@lgritz lgritz merged commit 45ae428 into AcademySoftwareFoundation:main Jun 17, 2026
98 of 102 checks passed
@lgritz lgritz deleted the lg-geomath branch June 19, 2026 15:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants