Skip to content

Commit f781414

Browse files
committed
arify prompt caching by ordering context files by update recency
1 parent 2b5919e commit f781414

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ Code Web Chat (CWC) is a free and open-source, privacy-first **AI coding toolkit
3939

4040
## Sustainability 🌱
4141

42-
Because selected context files are included with your instructions in a single prompt, CWC enables heavy [prompt caching](https://developers.openai.com/api/docs/guides/prompt-caching/) utilization, across tasks. Make your chatbot quotas last longer or lower token costs by up to 90%. Enable blazing fast local inference!
42+
CWC provides first-class support for [prompt caching](https://developers.openai.com/api/docs/guides/prompt-caching/) by ordering the selected context files by update recency and including them in constructed prompts before ever-changing instructions. Make your chatbot quotas last longer or lower token costs by up to 90%. Enable blazing fast local inference!
4343

4444
## Enabling autofill
4545

0 commit comments

Comments
 (0)