Pay us $2. Save many times that on your LLM.
WOS feeds your LLM ~1,000 tokens per query - a bounded, relevant slice - instead of stuffing the full history into every prompt. The gap is enormous, and it grows with your history.
LLM cost per 1,000 queries Based on Tablet 1
User history100K
Queries / month1,000
Your LLM
45× cheaper - you save $244/mo
Every $1 spent on WOS saves ~$98 on the LLM. Bigger history or a pricier model → bigger ROI.
Where the savings come from
- Without WOS you stuff the whole history into each prompt -
100K tokens × $2.50/1M = $0.25per query, at GPT-4o input rates (about 2× that on Opus-tier models). - With WOS you ingest once (
$2/1M), then each query is a tiny retrieve ($3/1M × 1,000) plus your LLM on just ~1,000 tokens. - The fewer tokens your LLM reads, the less you pay - and WOS keeps that number flat as memory grows.
Context shrink = history ÷ tokens fed, not cost (the calculator above prices each retrieve). 25K → 21× · 100K → 83× · 200K → 167×.