docs: update qiskit_code_validation example defaults#743
Conversation
github-actions
Bot
added
the
documentation
|
The PR description has been updated. Please fill out the template for your PR to be reviewed. |
Merge ProtectionsYour pull request matches the following merge protections and will not be merged until they are valid. 🟢 Enforce conventional commitWonderful, this rule succeeded.Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/
|
|
This is draft as I'm still wrapping up my final benchmarks and intend to update the benchmark results section of the README once they're done. I'll also update toolbox repo with the remaining results once it's finished. It pushes my laptop to it's limit so I'm running them overnight and it will take two more nights to finish (should have results on Friday) |
Switch default model to hf.co/Qiskit/mistral-small-3.2-24b-qiskit-GGUF and inline QISKIT_SYSTEM_PROMPT as a documented optional tuning aid for non-specialized models. Update README to match. Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com>
ajbozarth
force-pushed
the
qiskit-code-validation-ivr-example
branch
from
d3d637e to
1e62d53
Compare
Replace outdated benchmark table with completed run data and add check() correctness finding (~32.5% on QHE). Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com>
|
Updated with the benchmark results and moved out of draft. |
|
cc @vabarbosa |
vabarbosa
left a comment
vabarbosa
left a comment
There was a problem hiding this comment.
hello @ajbozarth. this is good, but i do have just a couple comments below. thank you!
…EADME Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com>
psschwei
left a comment
psschwei
left a comment
There was a problem hiding this comment.
tests pass and Va approved, fine with me
fd51c2b
…uting#743) * docs: update qiskit_code_validation example defaults Switch default model to hf.co/Qiskit/mistral-small-3.2-24b-qiskit-GGUF and inline QISKIT_SYSTEM_PROMPT as a documented optional tuning aid for non-specialized models. Update README to match. Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com> * docs: update qiskit_code_validation README benchmark results Replace outdated benchmark table with completed run data and add check() correctness finding (~32.5% on QHE). Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com> * docs: add grounding_context usage example to qiskit_code_validation README Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com> --------- Signed-off-by: Alex Bozarth <ajbozart@us.ibm.com>
3 participants
Misc PR
Type of PR
Description
Follows up on #717 to add system prompt and grounding context support to the
qiskit_code_validationIVR example.Adds
QISKIT_SYSTEM_PROMPTas an optional tuning aid (disabled by default) for use with non-specialized models, and wiressystem_promptandgrounding_contextas optional parameters throughgenerate_validated_qiskit_code(). The default config (Qiskit-specialized model, RepairTemplateStrategy, no system prompt) is unchanged and now explicitly documented. README updated to reflect configuration options and model guidance.Benchmarking data supporting these decisions (prompt corpus, run results, and analysis docs) is available in @ajbozarth's toolbox repo.
Testing