Edgee Agent Gateway Switches Models Mid-Session at 1.5 Times Cache Rewrite Cost
Summary
Edgee adds Self-Learning Routing to its Agent Gateway, which decides when a running coding session switches models, not only which model handles each turn. The gateway keeps a running total of forgone savings and switches once it reaches 1.5 times the cache rewrite cost. Edgee replays 30 days of sessions weekly to tune the tier map.
Key Points
- Upgrades bypass cost accounting, Edgee research engineer Khaled Maâmra says: a turn that needs more capability moves up whatever the switch costs.
- At the 1.5 threshold the gateway accepts a worst-case competitive ratio of 2.5, weaker than the 2 that break-even guarantees.
- Automatic apply skips a change unless the lower end of the saving's 95 percent interval sits above zero.