Business rule engine (No LLMs for production runs of business rules)

[camilletaylor12345]

Is your feature request related to a problem? Please describe.
I want to reduce the costs of evaluating business rules in production

Describe the solution you'd like
I want to evaluate business rules using a business rules engine that is lower cost than using LLMs to evaluate business rules engines with LLMs

Describe alternatives you've considered
Optimized promts to reduce LLM based criteria validation

[rstrahan]

Thanks @camilletaylor12345 ! Love this idea, to help evaluate and scope this properly, could you provide some additional detail?

What types of rules are you evaluating? — Could you share some examples of your business rules? Specifically, are they deterministic/structured rules (e.g., "field X must be greater than Y", "date must be within 30 days") or do they require interpretation of unstructured document content?

Hybrid approach? — Are you proposing a hybrid model where deterministic rules are handled by a rules engine and more complex interpretive rules still use an LLM? Or are you looking to fully eliminate LLM usage for rule evaluation? If Hybrid, what would be the deciding factor?

[camilletaylor12345]

What types of rules are you evaluating? — Could you share some examples of your business rules? Specifically, are they deterministic/structured rules (e.g., "field X must be greater than Y", "date must be within 30 days") or do they require interpretation of unstructured document content? Deterministic structured rules

Hybrid approach? — Are you proposing a hybrid model where deterministic rules are handled by a rules engine and more complex interpretive rules still use an LLM? Or are you looking to fully eliminate LLM usage for rule evaluation? If Hybrid, what would be the deciding factor? Yes a hybrid approach. If deterministic can't handle the rule, use LLM