Local OpenAI/Anthropic-compatible proxy using structured conversation state to reduce repeated context. Savings and compatibility depend on the workload.
agent npm proxy arxiv emnlp venice llm anthropic long-horizon llm-agent context-management prompt-compression openai-compatible token-efficiency ai-cost-optimization token-savings skillstate
-
Updated
Oct 3, 2026 - TypeScript