-
Notifications
You must be signed in to change notification settings - Fork 1.3k
Context Management #1682
Copy link
Copy link
Open
Labels
area:context-memoryContext window, memory, compaction, checkpoints, and instruction loadingContext window, memory, compaction, checkpoints, and instruction loading
Description
Describe the feature or problem you'd like to solve
Context manager
Proposed solution
Be able to manage the context of an smart LLM is huge advantage to get the best out of them. It is well known that the model capabilities decreases as the context grows. The web version of chat gpt allows you to edit any previous message in the conversation chain, allowing you to rewrite any previous message in a way that given the conversation you can just rewrite the a previous question instead of add extra context.
This should make more efficients as well (less cross attention)
Example prompts or workflows
No response
Additional context
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
area:context-memoryContext window, memory, compaction, checkpoints, and instruction loadingContext window, memory, compaction, checkpoints, and instruction loading
Type
Fields
Give feedbackNo fields configured for Feature.