Currently testrun names, eg. ./results/llm/<dir_name>, are determined by the Model-name being tested (test_model).
This RFE requests that the can be an arbitrary name, specified by the user at test invocation time.
This could be implemented via an ENV var, eg. -e "test_name=cores_4_8_12-rag-chat-code_PI34"
Support would need to also be provided in StreamLIT pages for visualizing those named results:
- Test Execution specification: support user specified testrun names
- Streamlit: ‘filter’ the viewable results with a user specified testrun name
Currently testrun names, eg. ./results/llm/<dir_name>, are determined by the Model-name being tested (test_model).
This RFE requests that the can be an arbitrary name, specified by the user at test invocation time.
This could be implemented via an ENV var, eg. -e "test_name=cores_4_8_12-rag-chat-code_PI34"
Support would need to also be provided in StreamLIT pages for visualizing those named results: