Improve wasm test runner progress reporting by DanielZ224 · Pull Request #1286 · Lind-Project/lind-wasm

DanielZ224 · 2026-06-27T03:08:12Z

Purpose

This PR improves the progress and failure reporting for the wasm test runner.

Previously, the runner printed per-test success/failure messages and made it harder to quickly identify which tests failed. This update changes the runtime output to a compact progress format where each passing test prints ., each failing test prints X, and skipped/unknown cases print S.

At the end of the run, the runner now prints a summary and defers detailed failure output to a dedicated Failures section.

Related Issue

Fixes #1274.

Changes

Added compact progress reporting to wasmtestreport.py.
Prints:
- . for passed tests
- X for failed tests
- S for skipped or unrecorded tests
Defers detailed failure output until after all tests complete.
Prints a final summary with passed, failed, and skipped counts.
Lowers per-test success/failure logging from info/error to debug so normal output stays concise.
Lowers skip logging to debug to reduce noise when using --run.

Example Output

Running 73 tests
......................................X............................XX...X
69 passed, 4 failed
Failures:
/home/lind/lind-wasm/tests/unit-tests/file_tests/deterministic/unlinkat.c
Error type: Failure_native_running
Native execution: Failed to create file in subdirectory: Permission denied

Testing

Ran syntax validation:

python3 -m py_compile scripts/test/harnesses/wasmtestreport.py

Also tested the updated reporting with:

python3 scripts/test/harnesses/wasmtestreport.py \
  --run file_tests \
  --allow-pre-compiled \
  --skip-libcpp

Observed the expected compact progress line, summary, and deferred failure details.

Note: the local file_tests run reported 69 passed and 4 failed. The failures appear related to local filesystem/test environment state, such as permission errors and pre-existing files, rather than the reporting change itself.

github-actions · 2026-06-27T03:19:14Z

End-to-End Test Report

Test Preview

grate harness

Grate Test Report

Metric	Value
Total	15
Success	15
Failures	0
Compile Failures	0
Runtime Failures	0
Timeout Failures	0
Missing Pair Failures	0

Cases

Test	Status	Output
concurrent-request/geteuid_grate.c	Success	STDOUT: [Grate\|geteuid] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 3 [Cage \| geteuid] PASS: 1000000 calls returned 10 [Grate\|geteuid] PASS STDERR:
concurrent-request/race-test_grate.c	Success	STDOUT: pass STDERR:
concurrent-request/thread_race_grate.c	Success	STDOUT: [thread_race] Registering handler for cage 2 in grate 1 with fn ptr addr: 3 [thread_race] PASS: 20 threads x 100000 calls returned 10 [thread_race] PASS STDERR:
copy-data-between-cages/cp-stncpy_grate.c	Success	STDOUT: [cage] pathname addr=0xfffb6ff9 [cage] pathname='random' [Grate\|open] intercepts open call: thiscage=1, arg1cage=2 [Grate\|open] copied pathname: random [cage] fd=10 STDERR:
copy-data-between-cages/cpdata_grate.c	Success	STDOUT: [Grate\|open] intercepts open call: thiscage=1, arg1cage=2 [Grate\|open] copied pathname: random [cage] fd=10 STDERR:
interposing-calls/fork-with-newret_grate.c	Success	STDOUT: [Grate\|interpose-fork] Registering fork handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|interpose-fork] Handling function ptr: 3 from cage: 1 [Grate\|interpose-fork] In fork_grate 1 handler for cage: 1 [Cage] Forked process with PID: 10 [Grate\|interpose-fork] PASS STDERR:
interposing-calls/interpose-exec_grate.c	Success	STDOUT: [Grate\|interpose-exec] Registering exec handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|interpose-exec] Handling function ptr: 3 from cage: 1 [Grate\|interpose-exec] In exec_grate 1 handler for cage: 1 [Grate\|interpose-exec] Handling function ptr: 3 from cage: 1 [Grate\|interpose-exec] In exec_grate 1 handler for cage: 1 Exec successful, argv[1]: --execd [Grate\|interpose-exec] PASS STDERR:
interposing-calls/interpose-exit_grate.c	Success	STDOUT: [Grate\|interpose-exit] Registering exit handler for cage 2 in grate 1 with fn ptr addr: 3 Exiting... [Grate\|interpose-exit] PASS STDERR:
interposing-calls/interpose-fork_grate.c	Success	STDOUT: [Grate\|interpose-fork] Registering fork handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|interpose-fork] Handling function ptr: 3 from cage: 1 [Grate\|interpose-fork] In fork_grate 1 handler for cage: 1 [Grate\|interpose-fork] PASS STDERR:
interposing-calls/interpose-mmap_grate.c	Success	STDOUT: [Grate\|interpose-mmap] Registering mmap handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 mmap test: PASS [Grate\|interpose-mmap] PASS STDERR:
interposing-calls/interpose-register_grate.c	Success	STDOUT: [Grate\|interpose-register] Registering register_handler for cage 2 in grate 1 with fn ptr addr: 4 [cage] registering 107. grateid: 2 cageid: 3 [Grate\|interpose-register] Handling function ptr: 4 from cage: 1 [Grate\|interpose-register] In register_grate 1 handler for cage: 1 [Grate\|geteuid] Registering geteuid handler for cage 1 in grate 1 with fn ptr addr: 3 [Grate\|interpose-register] Handling function ptr: 3 from cage: 1 [Grate\|interpose-register] In register_grate 1 handler for cage: 1 [Grate\|interpose-register] PASS STDERR:
multi-register_grate.c	Success	STDOUT: [Grate\|multi-register_grate] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 4 [Grate\|multi-register_grate] Registering getuid handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|multi-register_grate] Handling function ptr: 4 from cage: 1 [Grate\|multi-register_grate] In multi-register_grate 1 handler for cage: 1 [Grate\|multi-register_grate] Handling function ptr: 3 from cage: 1 [Grate\|multi-register_grate] In multi-register_grate 1 handler for cage: 1 [Cage \| multi-register] PASS: geteuid=10, getuid=20 [Grate\|multi-register] PASS STDERR:
simple-tests/copy-handler-table_grate.c	Success	STDOUT: [Grate\|copy-handler-table] Registering geteuid handler for cage 2 in grate 1 [Grate\|copy-handler-table] geteuid handler invoked for cage 1 [Grate\|copy-handler-table] geteuid handler invoked for cage 1 [Cage\|copy-handler-table] PASS: child inherited handler, then overwrite changed geteuid to 0 [Cage\|copy-handler-table] PASS: parent=123 child_exit=0 [Grate\|copy-handler-table] PASS STDERR:
simple-tests/diff-cage-args_grate.c	Success	STDOUT: [Grate\|diff-cage-args] Handling function ptr: 3 from cage: 1 [Grate\|diff-cage-args] In open_grate 1 handler for cage: 1 Hello world. FD=-1 [Grate\|diff-cage-args] Handling function ptr: 4 from cage: 1 Goodbye world! ret=4321 buf=helloworld [Grate\|diff-cage-args] PASS STDERR:
simple-tests/geteuid_grate.c	Success	STDOUT: [Grate\|geteuid] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|geteuid] Handling function ptr: 3 from cage: 1 [Grate\|geteuid] In geteuid_grate 1 handler for cage: 1 [Cage \| geteuid] PASS: geteuid ret = 10 [Grate\|geteuid] PASS STDERR:

static harness

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	3
Number of Successes	3
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Native Time	Wasm Time	Output
Static Tests
fork_simple.c	Success	None	0.056650s	4.231572s	Success
thread.c	Success	None	0.047162s	4.205339s	Success
tls_test.c	Success	None	0.053660s	4.255454s	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	0
Number of Successes	0
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

wasm harness

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	234
Number of Successes	234
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Native Time	Wasm Time	Output
Dylink Tests
basic.c	Success	None	0.048269s	0.118206s	Success
dlopen_fork.c	Success	None	0.049671s	0.147691s	Success
dlopen_thread.c	Success	None	0.052607s	0.141238s	Success
double_fork_dlopen.c	Success	None	0.054324s	0.186117s	Success
fork_dlopen.c	Success	None	0.049439s	0.145040s	Success
longjmp_dlopen.c	Success	None	0.047802s	0.136676s	Success
rdynamic_main.c	Success	None	0.049740s	0.135857s	Success
File Tests
chartests.c	Success	None	0.050733s	0.152985s	Success
chdir_getcwd.c	Success	None	0.048376s	0.121042s	Success
chmod.c	Success	None	0.055289s	0.130703s	Success
clock_gettime_highlevel.c	Success	None	0.121658s	0.166467s	Success
clock_gettime_simple.c	Success	None	0.042534s	0.107727s	Success
cloexec.c	Success	None	0.055903s	0.147746s	Success
close.c	Success	None	0.058251s	0.141440s	Success
copy_file_range.c	Success	None	0.052418s	0.145595s	Success
creat_access.c	Success	None	0.053449s	0.123136s	Success
doubleclose.c	Success	None	0.043880s	0.102607s	Success
dup.c	Success	None	0.044178s	0.116763s	Success
dup2.c	Success	None	0.050220s	0.117138s	Success
dup3.c	Success	None	0.048418s	0.117263s	Success
dupwrite.c	Success	None	0.051356s	0.117440s	Success
etc_conf.c	Success	None	0.046874s	0.122869s	Success
faccessat.c	Success	None	0.047656s	0.122494s	Success
fchdir.c	Success	None	0.053388s	0.133916s	Success
fchmod.c	Success	None	0.052317s	0.130949s	Success
fchmodat.c	Success	None	0.046465s	0.117823s	Success
fcntl.c	Success	None	0.056313s	0.137667s	Success
fcntl_dupfd.c	Success	None	0.044671s	0.113705s	Success
fdatasync.c	Success	None	0.049314s	0.115972s	Success
filetest.c	Success	None	0.050307s	0.112426s	Success
filetest1000.c	Success	None	0.060428s	0.128010s	Success
flock.c	Success	None	0.059475s	0.171754s	Success
fstat.c	Success	None	0.052930s	0.135435s	Success
fstatfs.c	Success	None	0.046268s	0.110982s	Success
fsync.c	Success	None	0.051425s	0.118393s	Success
ftruncate.c	Success	None	0.055695s	0.216203s	Success
getcwd.c	Success	None	0.048569s	0.111998s	Success
getcwd_null.c	Success	None	0.051575s	0.125783s	Success
getpgid.c	Success	None	0.045108s	0.105826s	Success
getrandom.c	Success	None	0.053288s	0.133079s	Success
ioctl.c	Success	None	0.054762s	0.126256s	Success
link.c	Success	None	0.056498s	0.163833s	Success
locale_test.c	Success	None	0.065218s	0.319730s	Success
lseek.c	Success	None	0.056707s	0.194198s	Success
lstat.c	Success	None	0.059683s	0.140091s	Success
mkdir_rmdir.c	Success	None	0.051550s	0.122499s	Success
mkfifo_test.c	Success	None	0.055689s	0.172516s	Success
mknod.c	Success	None	0.049330s	0.129866s	Success
nocancel_io.c	Success	None	0.055166s	0.147909s	Success
open.c	Success	None	0.045777s	0.107716s	Success
openat.c	Success	None	0.046650s	0.115474s	Success
path_conversion_safety.c	Success	None	0.057131s	0.140791s	Success
ppoll.c	Success	None	0.056688s	0.130768s	Success
pread_pwrite.c	Success	None	0.048958s	0.124916s	Success
preadv_pwritev.c	Success	None	0.055469s	0.141079s	Success
printf.c	Success	None	0.042511s	0.102249s	Success
prlimit64.c	Success	None	0.045937s	0.111662s	Success
read.c	Success	None	0.052552s	0.127835s	Success
readbytes.c	Success	None	0.046585s	0.113453s	Success
readdir_basic.c	Success	None	0.055430s	0.153669s	Success
readlink.c	Success	None	0.054238s	0.130237s	Success
readlinkat.c	Success	None	0.053762s	0.131192s	Success
readv_writev_test.c	Success	None	0.053869s	0.135328s	Success
rename.c	Success	None	0.054628s	0.120897s	Success
renameat.c	Success	None	0.055863s	0.135536s	Success
sc-writev.c	Success	None	0.051166s	0.118076s	Success
stat.c	Success	None	0.053281s	0.132487s	Success
statfs.c	Success	None	0.045487s	0.109230s	Success
symlink.c	Success	None	0.054285s	0.154166s	Success
sync_file_range.c	Success	None	0.048597s	0.112619s	Success
timespec_time_t_compat.c	Success	None	0.048729s	0.114623s	Success
trailing_slash.c	Success	None	0.049911s	0.123246s	Success
truncate.c	Success	None	0.052514s	0.140340s	Success
unlink.c	Success	None	0.054036s	0.154029s	Success
unlinkat.c	Success	None	0.055247s	0.144602s	Success
utimensat.c	Success	None	0.050479s	0.137216s	Success
write.c	Success	None	0.043733s	0.102275s	Success
writeloop.c	Success	None	0.055603s	0.119452s	Success
writepartial.c	Success	None	0.053066s	0.115812s	Success
writev.c	Success	None	0.053267s	0.125825s	Success
Math Tests
math_link_smoke.c	Success	None	0.059354s	0.111011s	Success
math_tests.c	Success	None	0.059902s	0.141676s	Success
printf_float.c	Success	None	0.055439s	0.136546s	Success
Memory Tests
brk.c	Success	None	0.048378s	0.114572s	Success
fork_large_memory.c	Success	None	0.083205s	0.456840s	Success
malloc.c	Success	None	0.046611s	0.104397s	Success
malloc_large.c	Success	None	0.047648s	0.105417s	Success
memcpy.c	Success	None	0.047055s	0.106933s	Success
memory_error_test.c	Success	None	0.054451s	0.139644s	Success
mmap.c	Success	None	0.044167s	0.106572s	Success
mmap_address_truncation.c	Success	None	0.045071s	0.112183s	Success
mmap_aligned.c	Success	None	0.045662s	0.121698s	Success
mmap_complicated.c	Success	None	0.052334s	0.144622s	Success
mmap_file.c	Success	None	0.052788s	0.123287s	Success
mmap_shared.c	Success	None	0.053484s	0.137840s	Success
mmaptest.c	Success	None	0.047737s	0.113649s	Success
mprotect.c	Success	None	0.044814s	0.106551s	Success
mprotect_boundary.c	Success	None	0.044572s	0.118169s	Success
mprotect_end_region.c	Success	None	0.047395s	0.118166s	Success
mprotect_middle_region.c	Success	None	0.044336s	0.115034s	Success
mprotect_multiple_times.c	Success	None	0.045495s	0.113349s	Success
mprotect_same_value.c	Success	None	0.045106s	0.111481s	Success
mprotect_spanning_regions.c	Success	None	0.046740s	0.129677s	Success
munmap_adjacent_shm.c	Success	None	0.048006s	0.127044s	Success
sbrk.c	Success	None	0.049411s	0.111944s	Success
segfault.c	Success	None	0.052171s	0.150094s	Success
shm.c	Success	None	0.051851s	0.143738s	Success
shmtest.c	Success	None	0.045220s	0.114571s	Success
thread_malloc_sequential.c	Success	None	0.052780s	0.180579s	Success
vtable.c	Success	None	0.056499s	0.127031s	Success
Networking Tests
accept4.c	Success	None	0.055467s	0.137859s	Success
dns_resolve_test.c	Success	None	0.100455s	0.243332s	Success
dnstest.c	Success	None	0.054436s	0.125209s	Success
epoll_badfd.c	Success	None	0.044039s	0.108037s	Success
epoll_edge_triggered.c	Success	None	0.210762s	0.411302s	Success
epollcreate1.c	Success	None	0.055081s	0.143801s	Success
error_handling_net.c	Success	None	0.065592s	0.201713s	Success
getaddrinfo_test.c	Success	None	0.057840s	0.173366s	Success
getaddrinfo_unspec.c	Success	None	0.087204s	0.134594s	Success
gethostname.c	Success	None	0.052058s	0.117571s	Success
getifaddrs.c	Success	None	0.109113s	0.246124s	Success
getsockname.c	Success	None	0.054144s	0.124822s	Success
getsockopt.c	Success	None	0.067305s	0.185246s	Success
ipv6_basic.c	Success	None	0.056828s	0.174956s	Success
makepipe.c	Success	None	0.046118s	0.105994s	Success
nonblocking_eagain.c	Success	None	0.058204s	0.174234s	Success
pipe.c	Success	None	0.056236s	0.137839s	Success
pipe2.c	Success	None	0.065428s	0.134533s	Success
pipeinput.c	Success	None	0.060152s	0.173810s	Success
pipeinput2.c	Success	None	0.101976s	0.206588s	Success
pipeonestring.c	Success	None	0.055363s	0.155563s	Success
pipepong.c	Success	None	0.053853s	0.159479s	Success
pipewrite.c	Success	None	0.049266s	0.122846s	Success
poll.c	Success	None	0.052534s	0.117915s	Success
recvfrom-sendto.c	Success	None	0.070584s	0.136846s	Success
sendmsg_recvmsg_test.c	Success	None	0.055965s	0.136321s	Success
serverclient.c	Success	None	0.092750s	0.299549s	Success
shutdown.c	Success	None	0.054841s	0.133219s	Success
shutdown_fork.c	Success	None	0.053680s	0.148599s	Success
simple-select.c	Success	None	0.059830s	0.169869s	Success
simple_epoll.c	Success	None	0.052185s	0.128097s	Success
socket.c	Success	None	0.051861s	0.129926s	Success
socket_cloexec.c	Success	None	0.054327s	0.120129s	Success
socket_options_advanced.c	Success	None	0.087477s	0.286247s	Success
socketepoll.c	Success	None	0.051402s	0.119058s	Success
socketpair.c	Success	None	0.060386s	0.163200s	Success
socketselect.c	Success	None	0.055653s	0.132314s	Success
udp_send_recv.c	Success	None	0.163052s	0.289684s	Success
uds-getsockname.c	Success	None	0.056195s	0.131256s	Success
uds-nb-select.c	Success	None	2.061014s	2.195997s	Success
uds-serverclient.c	Success	None	0.057115s	0.172219s	Success
uds-socketselect.c	Success	None	0.058468s	0.150329s	Success
uds_listen_poll.c	Success	None	1.064094s	1.233466s	Success
writev_socket.c	Success	None	0.063851s	0.173106s	Success
Process Tests
barrier_test.c	Success	None	0.051625s	0.138635s	Success
chain_thread.c	Success	None	1.053418s	1.146621s	Success
ctor_syscall_test.c	Success	None	0.041826s	0.104952s	Success
cxa_atexit_test.c	Success	None	0.048772s	0.114724s	Success
exec_non_utf8.c	Success	None	0.053321s	0.121413s	Success
execve_shebang.c	Success	None	0.054004s	0.120455s	Success
exit.c	Success	None	0.049531s	0.110367s	Success
exit_failure.c	Success	None	0.051611s	0.132465s	Success
exit_group_thread.c	Success	None	0.055103s	0.155240s	Success
exit_status_first_wins.c	Success	None	0.056926s	0.158846s	Success
flockfile_test.c	Success	None	0.053274s	0.146030s	Success
fork2malloc.c	Success	None	0.054485s	0.145728s	Success
fork_select.c	Success	None	0.052159s	0.149330s	Success
fork_simple.c	Success	None	0.049804s	0.129847s	Success
fork_syscall.c	Success	None	0.056505s	0.630891s	Success
fork_tls_ctype.c	Success	None	0.056123s	0.163312s	Success
forkandopen.c	Success	None	0.053172s	0.149618s	Success
forkdup.c	Success	None	0.054803s	0.144197s	Success
forkexecuid.c	Success	None	0.051417s	0.154012s	Success
forkexecv-arg.c	Success	None	0.052493s	0.144156s	Success
forkexecv.c	Success	None	0.050485s	0.142807s	Success
forkfiles.c	Success	None	0.053367s	0.148192s	Success
forkmalloc.c	Success	None	0.052649s	0.134227s	Success
forknodup.c	Success	None	0.053943s	0.147762s	Success
function-ptr.c	Success	None	0.046625s	0.107895s	Success
getegid_syscall.c	Success	None	0.054570s	0.484340s	Success
getgid_syscall.c	Success	None	0.053846s	0.475927s	Success
getpid.c	Success	None	0.046503s	0.107020s	Success
getpid_syscall.c	Success	None	0.056749s	0.496352s	Success
getppid.c	Success	None	0.053396s	0.138872s	Success
getppid_syscall.c	Success	None	0.057468s	0.429705s	Success
getuid.c	Success	None	0.052876s	0.116838s	Success
getuid_syscall.c	Success	None	0.052150s	0.261358s	Success
hello-arg.c	Success	None	0.042874s	0.109375s	Success
hello.c	Success	None	0.043407s	0.103004s	Success
longjmp.c	Success	None	0.043883s	0.115018s	Success
mutex.c	Success	None	2.056860s	2.134393s	Success
printf_deadlock_smoke.c	Success	None	0.061502s	0.171217s	Success
printf_thread_test.c	Success	None	0.051146s	0.145103s	Success
sem_forks.c	Success	None	0.056252s	0.190364s	Success
setjmp_edge.c	Success	None	0.048018s	0.187570s	Success
setsid.c	Success	None	0.046176s	0.105279s	Success
template.c	Success	None	0.053635s	0.192044s	Success
test_crossmodule_longjmp.c	Success	None	0.054842s	0.152969s	Success
test_exec_nofork.c	Success	None	0.052192s	0.141865s	Success
test_unlink_open_file.c	Success	None	0.047893s	0.109116s	Success
thread-guard.c	Success	None	0.049893s	0.131782s	Success
thread-test.c	Success	None	0.046888s	0.121550s	Success
thread.c	Success	None	0.046191s	0.121653s	Success
thread_cageid_race.c	Success	None	0.048445s	0.292270s	Success
tls_test.c	Success	None	0.051383s	0.160680s	Success
uname.c	Success	None	0.045721s	0.105170s	Success
wait.c	Success	None	0.050315s	0.156280s	Success
waitpid_anychild.c	Success	None	0.052680s	0.138648s	Success
waitpid_syscall.c	Success	None	1.054943s	1.229941s	Success
waitpid_wnohang.c	Success	None	0.052025s	0.136904s	Success
Signal Tests
alarm.c	Success	None	7.053820s	7.147127s	Success
eintr_fork_signal.c	Success	None	1.054069s	1.154418s	Success
kill.c	Success	None	1.050765s	1.137636s	Success
pause_test.c	Success	None	1.052905s	1.144484s	Success
setitimer.c	Success	None	7.052681s	7.152311s	Success
sigalrm.c	Success	None	2.051946s	2.134148s	Success
sigaltstack.c	Success	None	0.052509s	0.131718s	Success
sigchld.c	Success	None	1.053326s	1.139044s	Success
signal-fork.c	Success	None	4.054224s	4.136362s	Success
signal-simple.c	Success	None	0.052610s	0.121650s	Success
signal_SIGCHLD.c	Success	None	0.052717s	0.144401s	Success
signal_fork.c	Success	None	0.049009s	0.141734s	Success
signal_int_ignored.c	Success	None	2.053491s	2.140672s	Success
signal_kill_cleanup.c	Success	None	1.049187s	1.131979s	Success
signal_procmask.c	Success	None	0.045695s	0.120030s	Success
signal_read_interrupt.c	Success	None	0.556692s	0.649304s	Success
signal_recursive.c	Success	None	0.046145s	0.125599s	Success
signal_sa_mask.c	Success	None	0.046376s	0.116049s	Success
signal_select_interrupt.c	Success	None	0.556685s	0.648627s	Success
signal_write_interrupt.c	Success	None	1.053775s	1.140084s	Success
sigpipe.c	Success	None	1.053996s	1.146809s	Success
sigprocmask.c	Success	None	1.051251s	1.125217s	Success
sigsuspend_test.c	Success	None	1.050086s	1.147153s	Success
test_sigsetjmp.c	Success	None	0.051460s	0.152985s	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	6
Number of Successes	6
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Native Time	Wasm Time	Output
Dylink Tests
dlerror.c	Success	None	0.044664s	0.110318s	Success
Memory Tests
invalid_access_direct.c	Success	None	0.111819s	0.113108s	Success
invalid_access_fork.c	Success	None	0.137790s	0.201416s	Success
mmap-negative1.c	Success	None	0.137564s	0.122770s	Success
mmap-negative2.c	Success	None	0.160708s	0.186493s	Success
Signal Tests
signal_resethand.c	Success	None	1.051488s	1.134778s	Success

C++ harness

Summary

Metric	Value
Total	1
Success	1
Failures	0
Compile failures	0
Runtime failures	0
Output mismatch	0
Timeouts	0

Cases

Test	Status	Error type	Native time	Wasm time	Output
tests/unit-tests/cpp/sort.cpp	Success		0.466840s	8.880135s	LIBCPP_SORT_OK 1 2 3

Yaxuan-w · 2026-06-29T00:41:32Z

Can we let make test do same thing?

DanielZ224 · 2026-06-29T18:11:46Z

@Yaxuan-w Updated this so the unified runner path used by make test also preserves the compact wasm test progress and deferred failure summary. I verified it through scripts/test/test_runner.py --harness wasmtestreport, which now shows the same . / X progress line followed by the summary and Failures section.

github-actions · 2026-06-29T18:23:02Z

End-to-End Test Report

Test Preview

grate harness

Grate Test Report

Metric	Value
Total	15
Success	15
Failures	0
Compile Failures	0
Runtime Failures	0
Timeout Failures	0
Missing Pair Failures	0

Cases

Test	Status	Output
concurrent-request/geteuid_grate.c	Success	STDOUT: [Grate\|geteuid] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 3 [Cage \| geteuid] PASS: 1000000 calls returned 10 [Grate\|geteuid] PASS STDERR:
concurrent-request/race-test_grate.c	Success	STDOUT: pass STDERR:
concurrent-request/thread_race_grate.c	Success	STDOUT: [thread_race] Registering handler for cage 2 in grate 1 with fn ptr addr: 3 [thread_race] PASS: 20 threads x 100000 calls returned 10 [thread_race] PASS STDERR:
copy-data-between-cages/cp-stncpy_grate.c	Success	STDOUT: [cage] pathname addr=0xfffb6ff9 [cage] pathname='random' [Grate\|open] intercepts open call: thiscage=1, arg1cage=2 [Grate\|open] copied pathname: random [cage] fd=10 STDERR:
copy-data-between-cages/cpdata_grate.c	Success	STDOUT: [Grate\|open] intercepts open call: thiscage=1, arg1cage=2 [Grate\|open] copied pathname: random [cage] fd=10 STDERR:
interposing-calls/fork-with-newret_grate.c	Success	STDOUT: [Grate\|interpose-fork] Registering fork handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|interpose-fork] Handling function ptr: 3 from cage: 1 [Grate\|interpose-fork] In fork_grate 1 handler for cage: 1 [Cage] Forked process with PID: 10 [Grate\|interpose-fork] PASS STDERR:
interposing-calls/interpose-exec_grate.c	Success	STDOUT: [Grate\|interpose-exec] Registering exec handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|interpose-exec] Handling function ptr: 3 from cage: 1 [Grate\|interpose-exec] In exec_grate 1 handler for cage: 1 [Grate\|interpose-exec] Handling function ptr: 3 from cage: 1 [Grate\|interpose-exec] In exec_grate 1 handler for cage: 1 Exec successful, argv[1]: --execd [Grate\|interpose-exec] PASS STDERR:
interposing-calls/interpose-exit_grate.c	Success	STDOUT: [Grate\|interpose-exit] Registering exit handler for cage 2 in grate 1 with fn ptr addr: 3 Exiting... [Grate\|interpose-exit] PASS STDERR:
interposing-calls/interpose-fork_grate.c	Success	STDOUT: [Grate\|interpose-fork] Registering fork handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|interpose-fork] Handling function ptr: 3 from cage: 1 [Grate\|interpose-fork] In fork_grate 1 handler for cage: 1 [Grate\|interpose-fork] PASS STDERR:
interposing-calls/interpose-mmap_grate.c	Success	STDOUT: [Grate\|interpose-mmap] Registering mmap handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 [Grate\|interpose-mmap] Handling function ptr: 3 from cage: 1 [Grate\|interpose-mmap] In mmap_grate 1 handler for cage: 1 mmap test: PASS [Grate\|interpose-mmap] PASS STDERR:
interposing-calls/interpose-register_grate.c	Success	STDOUT: [Grate\|interpose-register] Registering register_handler for cage 2 in grate 1 with fn ptr addr: 4 [cage] registering 107. grateid: 2 cageid: 3 [Grate\|interpose-register] Handling function ptr: 4 from cage: 1 [Grate\|interpose-register] In register_grate 1 handler for cage: 1 [Grate\|geteuid] Registering geteuid handler for cage 1 in grate 1 with fn ptr addr: 3 [Grate\|interpose-register] Handling function ptr: 3 from cage: 1 [Grate\|interpose-register] In register_grate 1 handler for cage: 1 [Grate\|interpose-register] PASS STDERR:
multi-register_grate.c	Success	STDOUT: [Grate\|multi-register_grate] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 4 [Grate\|multi-register_grate] Registering getuid handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|multi-register_grate] Handling function ptr: 4 from cage: 1 [Grate\|multi-register_grate] In multi-register_grate 1 handler for cage: 1 [Grate\|multi-register_grate] Handling function ptr: 3 from cage: 1 [Grate\|multi-register_grate] In multi-register_grate 1 handler for cage: 1 [Cage \| multi-register] PASS: geteuid=10, getuid=20 [Grate\|multi-register] PASS STDERR:
simple-tests/copy-handler-table_grate.c	Success	STDOUT: [Grate\|copy-handler-table] Registering geteuid handler for cage 2 in grate 1 [Grate\|copy-handler-table] geteuid handler invoked for cage 1 [Grate\|copy-handler-table] geteuid handler invoked for cage 1 [Cage\|copy-handler-table] PASS: child inherited handler, then overwrite changed geteuid to 0 [Cage\|copy-handler-table] PASS: parent=123 child_exit=0 [Grate\|copy-handler-table] PASS STDERR:
simple-tests/diff-cage-args_grate.c	Success	STDOUT: [Grate\|diff-cage-args] Handling function ptr: 3 from cage: 1 [Grate\|diff-cage-args] In open_grate 1 handler for cage: 1 Hello world. FD=-1 [Grate\|diff-cage-args] Handling function ptr: 4 from cage: 1 Goodbye world! ret=4321 buf=helloworld [Grate\|diff-cage-args] PASS STDERR:
simple-tests/geteuid_grate.c	Success	STDOUT: [Grate\|geteuid] Registering geteuid handler for cage 2 in grate 1 with fn ptr addr: 3 [Grate\|geteuid] Handling function ptr: 3 from cage: 1 [Grate\|geteuid] In geteuid_grate 1 handler for cage: 1 [Cage \| geteuid] PASS: geteuid ret = 10 [Grate\|geteuid] PASS STDERR:

static harness

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	3
Number of Successes	3
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Native Time	Wasm Time	Output
Static Tests
fork_simple.c	Success	None	0.061743s	4.041211s	Success
thread.c	Success	None	0.051640s	4.106179s	Success
tls_test.c	Success	None	0.058980s	4.143013s	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	0
Number of Successes	0
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

wasm harness

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	234
Number of Successes	234
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Native Time	Wasm Time	Output
Dylink Tests
basic.c	Success	None	0.052457s	0.124852s	Success
dlopen_fork.c	Success	None	0.055234s	0.153490s	Success
dlopen_thread.c	Success	None	0.055499s	0.152939s	Success
double_fork_dlopen.c	Success	None	0.058179s	0.197401s	Success
fork_dlopen.c	Success	None	0.054279s	0.150351s	Success
longjmp_dlopen.c	Success	None	0.053571s	0.142514s	Success
rdynamic_main.c	Success	None	0.055349s	0.147714s	Success
File Tests
chartests.c	Success	None	0.052436s	0.156267s	Success
chdir_getcwd.c	Success	None	0.054860s	0.127737s	Success
chmod.c	Success	None	0.057927s	0.138018s	Success
clock_gettime_highlevel.c	Success	None	0.125232s	0.181380s	Success
clock_gettime_simple.c	Success	None	0.048607s	0.116080s	Success
cloexec.c	Success	None	0.057347s	0.154230s	Success
close.c	Success	None	0.065172s	0.150247s	Success
copy_file_range.c	Success	None	0.056892s	0.149462s	Success
creat_access.c	Success	None	0.057697s	0.128990s	Success
doubleclose.c	Success	None	0.048621s	0.109806s	Success
dup.c	Success	None	0.048995s	0.124643s	Success
dup2.c	Success	None	0.054249s	0.124567s	Success
dup3.c	Success	None	0.052785s	0.125768s	Success
dupwrite.c	Success	None	0.054435s	0.125475s	Success
etc_conf.c	Success	None	0.051375s	0.132281s	Success
faccessat.c	Success	None	0.053694s	0.130150s	Success
fchdir.c	Success	None	0.057986s	0.139797s	Success
fchmod.c	Success	None	0.056814s	0.138207s	Success
fchmodat.c	Success	None	0.052172s	0.129344s	Success
fcntl.c	Success	None	0.054889s	0.139552s	Success
fcntl_dupfd.c	Success	None	0.049909s	0.119419s	Success
fdatasync.c	Success	None	0.053889s	0.121816s	Success
filetest.c	Success	None	0.055161s	0.122784s	Success
filetest1000.c	Success	None	0.064899s	0.136926s	Success
flock.c	Success	None	0.062254s	0.172230s	Success
fstat.c	Success	None	0.057703s	0.141191s	Success
fstatfs.c	Success	None	0.049745s	0.118621s	Success
fsync.c	Success	None	0.054572s	0.121794s	Success
ftruncate.c	Success	None	0.060045s	0.222348s	Success
getcwd.c	Success	None	0.052176s	0.116602s	Success
getcwd_null.c	Success	None	0.055894s	0.132320s	Success
getpgid.c	Success	None	0.049764s	0.113629s	Success
getrandom.c	Success	None	0.056680s	0.139203s	Success
ioctl.c	Success	None	0.058142s	0.132689s	Success
link.c	Success	None	0.060287s	0.168889s	Success
locale_test.c	Success	None	0.066149s	0.324948s	Success
lseek.c	Success	None	0.060375s	0.201005s	Success
lstat.c	Success	None	0.061860s	0.150448s	Success
mkdir_rmdir.c	Success	None	0.056447s	0.130624s	Success
mkfifo_test.c	Success	None	0.060345s	0.178422s	Success
mknod.c	Success	None	0.055046s	0.135705s	Success
nocancel_io.c	Success	None	0.058188s	0.149949s	Success
open.c	Success	None	0.050603s	0.115259s	Success
openat.c	Success	None	0.051179s	0.121871s	Success
path_conversion_safety.c	Success	None	0.060092s	0.146376s	Success
ppoll.c	Success	None	0.059523s	0.132964s	Success
pread_pwrite.c	Success	None	0.052862s	0.129481s	Success
preadv_pwritev.c	Success	None	0.058034s	0.143441s	Success
printf.c	Success	None	0.048220s	0.112633s	Success
prlimit64.c	Success	None	0.049898s	0.116689s	Success
read.c	Success	None	0.056490s	0.136442s	Success
readbytes.c	Success	None	0.052891s	0.121463s	Success
readdir_basic.c	Success	None	0.059230s	0.161543s	Success
readlink.c	Success	None	0.055938s	0.134715s	Success
readlinkat.c	Success	None	0.057610s	0.137137s	Success
readv_writev_test.c	Success	None	0.057926s	0.139255s	Success
rename.c	Success	None	0.059567s	0.129434s	Success
renameat.c	Success	None	0.058002s	0.141902s	Success
sc-writev.c	Success	None	0.056291s	0.128228s	Success
stat.c	Success	None	0.056840s	0.138066s	Success
statfs.c	Success	None	0.051049s	0.118205s	Success
symlink.c	Success	None	0.058107s	0.158465s	Success
sync_file_range.c	Success	None	0.054176s	0.123380s	Success
timespec_time_t_compat.c	Success	None	0.053685s	0.120357s	Success
trailing_slash.c	Success	None	0.055084s	0.131887s	Success
truncate.c	Success	None	0.057110s	0.149244s	Success
unlink.c	Success	None	0.058128s	0.163553s	Success
unlinkat.c	Success	None	0.057462s	0.143338s	Success
utimensat.c	Success	None	0.054758s	0.147121s	Success
write.c	Success	None	0.049754s	0.110935s	Success
writeloop.c	Success	None	0.057528s	0.126613s	Success
writepartial.c	Success	None	0.056798s	0.120516s	Success
writev.c	Success	None	0.057569s	0.134215s	Success
Math Tests
math_link_smoke.c	Success	None	0.062196s	0.119015s	Success
math_tests.c	Success	None	0.064085s	0.146434s	Success
printf_float.c	Success	None	0.060526s	0.141413s	Success
Memory Tests
brk.c	Success	None	0.053359s	0.121937s	Success
fork_large_memory.c	Success	None	0.088131s	0.467800s	Success
malloc.c	Success	None	0.052300s	0.114653s	Success
malloc_large.c	Success	None	0.052616s	0.114504s	Success
memcpy.c	Success	None	0.052012s	0.116389s	Success
memory_error_test.c	Success	None	0.056848s	0.143126s	Success
mmap.c	Success	None	0.049179s	0.114017s	Success
mmap_address_truncation.c	Success	None	0.051179s	0.118883s	Success
mmap_aligned.c	Success	None	0.050342s	0.131187s	Success
mmap_complicated.c	Success	None	0.056050s	0.152706s	Success
mmap_file.c	Success	None	0.056361s	0.128618s	Success
mmap_shared.c	Success	None	0.055198s	0.145893s	Success
mmaptest.c	Success	None	0.052830s	0.121386s	Success
mprotect.c	Success	None	0.050483s	0.115573s	Success
mprotect_boundary.c	Success	None	0.050177s	0.125136s	Success
mprotect_end_region.c	Success	None	0.049689s	0.121975s	Success
mprotect_middle_region.c	Success	None	0.050121s	0.120864s	Success
mprotect_multiple_times.c	Success	None	0.050937s	0.124089s	Success
mprotect_same_value.c	Success	None	0.049622s	0.119219s	Success
mprotect_spanning_regions.c	Success	None	0.053038s	0.136701s	Success
munmap_adjacent_shm.c	Success	None	0.052339s	0.136658s	Success
sbrk.c	Success	None	0.052914s	0.118904s	Success
segfault.c	Success	None	0.057249s	0.160695s	Success
shm.c	Success	None	0.055003s	0.152422s	Success
shmtest.c	Success	None	0.051204s	0.122541s	Success
thread_malloc_sequential.c	Success	None	0.058823s	0.192865s	Success
vtable.c	Success	None	0.062820s	0.133697s	Success
Networking Tests
accept4.c	Success	None	0.060379s	0.143886s	Success
dns_resolve_test.c	Success	None	0.098063s	0.198484s	Success
dnstest.c	Success	None	0.057357s	0.149049s	Success
epoll_badfd.c	Success	None	0.051841s	0.116053s	Success
epoll_edge_triggered.c	Success	None	0.214981s	0.401500s	Success
epollcreate1.c	Success	None	0.058682s	0.141629s	Success
error_handling_net.c	Success	None	0.065958s	0.212972s	Success
getaddrinfo_test.c	Success	None	0.073466s	0.179632s	Success
getaddrinfo_unspec.c	Success	None	0.083727s	0.193662s	Success
gethostname.c	Success	None	0.051800s	0.113573s	Success
getifaddrs.c	Success	None	0.059155s	0.139712s	Success
getsockname.c	Success	None	0.060517s	0.136973s	Success
getsockopt.c	Success	None	0.060021s	0.167566s	Success
ipv6_basic.c	Success	None	0.064875s	0.172495s	Success
makepipe.c	Success	None	0.051414s	0.116276s	Success
nonblocking_eagain.c	Success	None	0.086980s	0.217454s	Success
pipe.c	Success	None	0.076316s	0.170133s	Success
pipe2.c	Success	None	0.061272s	0.135213s	Success
pipeinput.c	Success	None	0.063814s	0.175221s	Success
pipeinput2.c	Success	None	0.062447s	0.171275s	Success
pipeonestring.c	Success	None	0.060163s	0.165070s	Success
pipepong.c	Success	None	0.058402s	0.168443s	Success
pipewrite.c	Success	None	0.055729s	0.132016s	Success
poll.c	Success	None	0.056151s	0.124027s	Success
recvfrom-sendto.c	Success	None	0.058206s	0.139005s	Success
sendmsg_recvmsg_test.c	Success	None	0.062490s	0.148154s	Success
serverclient.c	Success	None	0.061812s	0.165819s	Success
shutdown.c	Success	None	0.060032s	0.149359s	Success
shutdown_fork.c	Success	None	0.059906s	0.155903s	Success
simple-select.c	Success	None	0.061283s	0.167694s	Success
simple_epoll.c	Success	None	0.057429s	0.134947s	Success
socket.c	Success	None	0.058427s	0.131932s	Success
socket_cloexec.c	Success	None	0.070331s	0.157556s	Success
socket_options_advanced.c	Success	None	0.065340s	0.272570s	Success
socketepoll.c	Success	None	0.056687s	0.126833s	Success
socketpair.c	Success	None	0.065775s	0.167564s	Success
socketselect.c	Success	None	0.057776s	0.139804s	Success
udp_send_recv.c	Success	None	0.205683s	0.449788s	Success
uds-getsockname.c	Success	None	0.070499s	0.140709s	Success
uds-nb-select.c	Success	None	2.066887s	2.200136s	Success
uds-serverclient.c	Success	None	0.075136s	0.285217s	Success
uds-socketselect.c	Success	None	0.057243s	0.139540s	Success
uds_listen_poll.c	Success	None	1.068809s	1.203308s	Success
writev_socket.c	Success	None	0.060118s	0.163523s	Success
Process Tests
barrier_test.c	Success	None	0.055350s	0.148466s	Success
chain_thread.c	Success	None	1.057051s	1.152799s	Success
ctor_syscall_test.c	Success	None	0.046792s	0.113904s	Success
cxa_atexit_test.c	Success	None	0.053643s	0.120755s	Success
exec_non_utf8.c	Success	None	0.056768s	0.129780s	Success
execve_shebang.c	Success	None	0.056291s	0.124647s	Success
exit.c	Success	None	0.053853s	0.117517s	Success
exit_failure.c	Success	None	0.055934s	0.143277s	Success
exit_group_thread.c	Success	None	0.057758s	0.162399s	Success
exit_status_first_wins.c	Success	None	0.059151s	0.165473s	Success
flockfile_test.c	Success	None	0.056492s	0.153337s	Success
fork2malloc.c	Success	None	0.056876s	0.147008s	Success
fork_select.c	Success	None	0.054729s	0.149979s	Success
fork_simple.c	Success	None	0.055092s	0.141175s	Success
fork_syscall.c	Success	None	0.060830s	0.649553s	Success
fork_tls_ctype.c	Success	None	0.058974s	0.165108s	Success
forkandopen.c	Success	None	0.058240s	0.157916s	Success
forkdup.c	Success	None	0.058740s	0.153235s	Success
forkexecuid.c	Success	None	0.055742s	0.165141s	Success
forkexecv-arg.c	Success	None	0.056660s	0.161695s	Success
forkexecv.c	Success	None	0.054687s	0.148680s	Success
forkfiles.c	Success	None	0.057139s	0.151001s	Success
forkmalloc.c	Success	None	0.057263s	0.143174s	Success
forknodup.c	Success	None	0.057827s	0.155231s	Success
function-ptr.c	Success	None	0.052430s	0.118912s	Success
getegid_syscall.c	Success	None	0.057003s	0.497935s	Success
getgid_syscall.c	Success	None	0.058631s	0.499983s	Success
getpid.c	Success	None	0.049003s	0.113627s	Success
getpid_syscall.c	Success	None	0.059097s	0.527050s	Success
getppid.c	Success	None	0.055763s	0.140876s	Success
getppid_syscall.c	Success	None	0.058937s	0.409375s	Success
getuid.c	Success	None	0.056838s	0.124848s	Success
getuid_syscall.c	Success	None	0.055121s	0.253714s	Success
hello-arg.c	Success	None	0.048403s	0.119847s	Success
hello.c	Success	None	0.047761s	0.110431s	Success
longjmp.c	Success	None	0.048948s	0.120256s	Success
mutex.c	Success	None	2.058456s	2.141844s	Success
printf_deadlock_smoke.c	Success	None	0.064459s	0.175634s	Success
printf_thread_test.c	Success	None	0.055145s	0.152637s	Success
sem_forks.c	Success	None	0.058991s	0.184429s	Success
setjmp_edge.c	Success	None	0.051578s	0.191330s	Success
setsid.c	Success	None	0.048748s	0.111969s	Success
template.c	Success	None	0.055864s	0.190865s	Success
test_crossmodule_longjmp.c	Success	None	0.057240s	0.158295s	Success
test_exec_nofork.c	Success	None	0.055309s	0.145819s	Success
test_unlink_open_file.c	Success	None	0.051239s	0.113275s	Success
thread-guard.c	Success	None	0.054381s	0.138324s	Success
thread-test.c	Success	None	0.052735s	0.132109s	Success
thread.c	Success	None	0.052514s	0.129522s	Success
thread_cageid_race.c	Success	None	0.051820s	0.302633s	Success
tls_test.c	Success	None	0.055602s	0.170699s	Success
uname.c	Success	None	0.050928s	0.114814s	Success
wait.c	Success	None	0.052659s	0.158351s	Success
waitpid_anychild.c	Success	None	0.057797s	0.145637s	Success
waitpid_syscall.c	Success	None	1.058492s	1.242080s	Success
waitpid_wnohang.c	Success	None	0.058335s	0.148555s	Success
Signal Tests
alarm.c	Success	None	7.056000s	7.153714s	Success
eintr_fork_signal.c	Success	None	1.059445s	1.167544s	Success
kill.c	Success	None	1.057790s	1.147906s	Success
pause_test.c	Success	None	1.057701s	1.154263s	Success
setitimer.c	Success	None	7.057569s	7.157121s	Success
sigalrm.c	Success	None	2.059276s	2.147589s	Success
sigaltstack.c	Success	None	0.060757s	0.140717s	Success
sigchld.c	Success	None	1.058060s	1.148092s	Success
signal-fork.c	Success	None	4.059219s	4.147558s	Success
signal-simple.c	Success	None	0.058231s	0.132305s	Success
signal_SIGCHLD.c	Success	None	0.055743s	0.153451s	Success
signal_fork.c	Success	None	0.055417s	0.150699s	Success
signal_int_ignored.c	Success	None	2.058179s	2.149093s	Success
signal_kill_cleanup.c	Success	None	1.057210s	1.141339s	Success
signal_procmask.c	Success	None	0.052249s	0.128607s	Success
signal_read_interrupt.c	Success	None	0.561022s	0.651914s	Success
signal_recursive.c	Success	None	0.052464s	0.134275s	Success
signal_sa_mask.c	Success	None	0.050460s	0.121651s	Success
signal_select_interrupt.c	Success	None	0.561457s	0.657361s	Success
signal_write_interrupt.c	Success	None	1.059727s	1.148385s	Success
sigpipe.c	Success	None	1.059570s	1.162315s	Success
sigprocmask.c	Success	None	1.057133s	1.132442s	Success
sigsuspend_test.c	Success	None	1.054929s	1.153023s	Success
test_sigsetjmp.c	Success	None	0.057179s	0.160320s	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	6
Number of Successes	6
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Native Time	Wasm Time	Output
Dylink Tests
dlerror.c	Success	None	0.049315s	0.121025s	Success
Memory Tests
invalid_access_direct.c	Success	None	0.118882s	0.134263s	Success
invalid_access_fork.c	Success	None	0.153127s	0.209636s	Success
mmap-negative1.c	Success	None	0.138148s	0.124164s	Success
mmap-negative2.c	Success	None	0.165530s	0.227174s	Success
Signal Tests
signal_resethand.c	Success	None	1.055716s	1.147574s	Success

C++ harness

Summary

Metric	Value
Total	1
Success	1
Failures	0
Compile failures	0
Runtime failures	0
Output mismatch	0
Timeouts	0

Cases

Test	Status	Error type	Native time	Wasm time	Output
tests/unit-tests/cpp/sort.cpp	Success		0.393518s	8.437743s	LIBCPP_SORT_OK 1 2 3

DanielZ224 requested a review from Yaxuan-w June 27, 2026 03:08

Improve wasm test runner progress reporting

64225e0

DanielZ224 force-pushed the improve-test-runner-reporting branch from c7417a2 to 64225e0 Compare June 29, 2026 18:10

Yaxuan-w approved these changes Jun 29, 2026

View reviewed changes

Yaxuan-w requested review from Uk-jake and vidyalakshmir June 29, 2026 18:38

vidyalakshmir approved these changes Jul 6, 2026

View reviewed changes

Yaxuan-w merged commit 7d47b7a into main Jul 6, 2026
3 checks passed

Uh oh!

Conversation

DanielZ224 commented Jun 27, 2026

Purpose

Related Issue

Changes

Example Output

Testing

Uh oh!

github-actions Bot commented Jun 27, 2026

End-to-End Test Report

grate harness

Grate Test Report

Cases

static harness

Test Report

Summary

Test Results by Category

Summary

wasm harness

Test Report

Summary

Test Results by Category

Summary

Test Results by Category

C++ harness

Summary

Cases

Uh oh!

Yaxuan-w commented Jun 29, 2026

Uh oh!

DanielZ224 commented Jun 29, 2026

Uh oh!

github-actions Bot commented Jun 29, 2026

End-to-End Test Report

grate harness

Grate Test Report

Cases

static harness

Test Report

Summary

Test Results by Category

Summary

wasm harness

Test Report

Summary

Test Results by Category

Summary

Test Results by Category

C++ harness

Summary

Cases

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants