Is this the right issue type?
Summary
The logs for lettuce aren't very helpful.
The LLM logs should store a lot more by default.
OpenTelemetry has examples of GenAI logs
For each generation we should at least log:
- operation name
- model name
- temperature
- messages
Some of this is reported from the Llama.cpp meta, but the prompt should be included
For database searches, the search parameters should be logged, like:
- search term
- search parameters
- query type
Acceptance Criteria
Tasks
Confirm creation
Is this the right issue type?
Summary
The logs for lettuce aren't very helpful.
The LLM logs should store a lot more by default.
OpenTelemetry has examples of GenAI logs
For each generation we should at least log:
Some of this is reported from the Llama.cpp meta, but the prompt should be included
For database searches, the search parameters should be logged, like:
Acceptance Criteria
Tasks
Confirm creation