How should a software factory respond to changing prices and batch pricing?
Turn temporary discounts and batch pricing into deliberate scheduling decisions rather than ad hoc model switching.
Starting point
Model providers introduce temporary discounts, batch rates, and new plan limits. A low-priority backlog could allow Yesod to dispatch suitable work when a capable model becomes unusually inexpensive.
What to track
- The effort required to maintain current pricing and availability data.
- Which tasks tolerate batch latency and opportunistic scheduling.
- Whether a pricing agent should monitor announcements for cheap inference.
- How to express price thresholds without sacrificing reliability.
Living record
Pricing events, scheduling experiments, and policy changes will accumulate here.