This is a flow leverage llm to eval percieved intelligence. Perceived intelligence is the degree to which a bot can impress the user with its responses, by showing originality, insight, creativity, knowledge, and adaptability.
Tools used in this flow:
pythontool- built-in
llmtool
Prepare your Azure Open AI resource follow this instruction and get your api_key if you don't have one.
# Override keys with --set to avoid yaml file changes
pf connection create --file ../../../connections/azure_openai.yml --set api_key=<your_api_key> api_base=<your_api_base># test with default input value in flow.dag.yaml
pf flow test --flow .pf run create --flow . --data ./data.jsonl --stream