Additional fixes

[Frauschi]

zd21457

[wolfSSL-Fenrir-bot]

Fenrir Automated Review — PR #10116

Scan targets checked: src, src-bugs, src-compliance, wolfcrypt-api_misuse, wolfcrypt-bugs, wolfcrypt-compliance, wolfcrypt-concurrency, wolfcrypt-portability, wolfcrypt-src

No new issues found in the changed files. ✅

[douzzer]

only failing subtest is multi-test all-c89-clang-tidy "FAIL: scripts/ocsp-stapling2.test"

[douzzer]

Missing some FIPS gating I suspect, re "Properly reject Ed448 identity public key"

[linuxkm-defaults-all-fips-v6-sanitizer] [35 of 52] [5a573e0c76]
    setting up FIPS "v6-linuxkm"... 
    refreshing fips WCv6.0.0-linuxkm-UPDT-RC3... [caching link to git@github.com... done]  done, now at 7756dbea90
    setting up FIPS "v6-linuxkm"...     refreshing wolfssl WCv6.0.0-linuxkm-UPDT-RC2... done, now at b7220aeb4b
done [fips="WCv6.0.0-linuxkm-UPDT-RC3" (7756dbea90), wolfCrypt="WCv6.0.0-linuxkm-UPDT-RC2" (def685129c)]
    configure with sanitizers...   real 0m10.090s  user 0m6.531s  sys 0m4.403s
    build...   real 0m38.522s  user 8m9.887s  sys 0m9.403s
    fixing FIPS hash in user library... done.
    check...FAIL: scripts/unit.test
   real 1m23.506s  user 2m1.463s  sys 0m15.917s
ERROR - tests/api.c line 6719 failed with:
    expected: wolfSSL_shutdown(ssl_c) == WOLFSSL_SUCCESS
    result:   2 != 1
ERROR - tests/api.c line 34781 failed with:
    expected: wc_ed448_import_public_fips(identity, sizeof(identity), &key) != 0
    result:   0 == 0
ERROR - tests/api.c line 36066 failed with:
    expected: Test failed
    result:   ret 0
   1306: test_pkcs7_decode_encrypted_outputsz               : skipped
   1307: test_pkcs7_ori_oversized_oid                       : skipped
   1308: test_wolfSSL_Cleanup                               : passed (  0.00001)

FAILURES:
   1305: test_ed448_rejects_identity_key

 End API Tests
 Failed/Skipped/Passed/All: 1/443/864/1308
FAIL scripts/unit.test (exit status: 1)

scripts/unit.log tail:
   1306: test_pkcs7_decode_encrypted_outputsz               : skipped
   1307: test_pkcs7_ori_oversized_oid                       : skipped
   1308: test_wolfSSL_Cleanup                               : passed (  0.00001)

FAILURES:
   1305: test_ed448_rejects_identity_key

 End API Tests
 Failed/Skipped/Passed/All: 1/443/864/1308
FAIL scripts/unit.test (exit status: 1)
    linuxkm-defaults-all-fips-v6-sanitizer fail_analytic_check
    failed config: 'EXTRA_CPPFLAGS=-Werror' '--srcdir' '.' '--disable-jobserver' '--enable-option-checking=fatal' '--enable-fips=v6' '--enable-linuxkm-defaults' '--enable-intelasm' '--enable-sp-asm' '--enable-all' '--enable-acert' '--enable-dtls13' '--enable-dtls-mtu' '--enable-dtls-frag-ch' '--enable-dtlscid' '--enable-quic' '--with-sys-crypto-policy' '--disable-srtp' 'CC=gcc-16' 'LDFLAGS=-g -fno-omit-frame-pointer -fsanitize-recover=all -fsanitize=address,pointer-subtract,leak,undefined,float-cast-overflow,float-divide-by-zero,bounds-strict -fsanitize-recover=all ' 'CFLAGS=-DTEST_ALWAYS_RUN_TO_END -Wno-declaration-after-statement -DDEBUG_LINUXKM_PIE_SUPPORT -DWC_SIPHASH_NO_ASM -DWC_DEBUG_CIPHER_LIFECYCLE -g -fno-omit-frame-pointer -fsanitize=address,pointer-subtract,leak,undefined,float-cast-overflow,float-divide-by-zero,bounds-strict -fsanitize-recover=all --param=max-vartrack-size=128000000' 'CPPFLAGS=-DNO_WOLFSSL_CIPHER_SUITE_TEST -pedantic -Wnull-dereference -Wdeclaration-after-statement'

[Frauschi]

@douzzer I fixed the FIPS gating