PreviewYou're previewing CTO AI Forge. Sign in to use it.Sign in
← All lessons
L3 · AI-native architecture & platform8 min read

AI cost and FinOps for engineering

AI spend arrives through many doors: per-seat licences for coding tools, usage-based charges for premium models and agents, API tokens for product features, and compute for self-hosted models. Each behaves differently.

How the cost shapes differ

  • Seats are predictable but easy to over-buy; unused seats are pure waste.
  • Usage-based plans track value more closely but can spike — agents and long contexts consume far more tokens than autocomplete.
  • API tokens for features scale with your users; small prompt changes can double the bill.
  • Self-hosting trades token fees for GPUs, engineers and utilization risk.

Pricing models change

Vendors are still discovering their own economics, and they change plans. In June 2025 Cursor moved its Pro plan from request limits to compute-based limits that included $20 of frontier model usage per month at API pricing. On July 4, 2025 it published "Clarifying our pricing", saying the changes "were not communicated clearly, and we take full responsibility", and offered refunds for unexpected charges between June 16 and July 4. The lesson for buyers: model the cost of your usage pattern under each plan, and expect changes.

The FinOps basics for AI

  1. Visibility: tag all AI spend by team, use case and vendor; the gateway does most of this for API usage.
  2. Unit costs: cost per merged PR, per resolved ticket, per 1,000 feature requests.
  3. Budgets and limits: per-team budgets, per-key rate limits, alerts at thresholds, caps on agent run length.
  4. Optimization: right-size models (smaller models for simple tasks), cache repeated requests, trim prompts, batch where latency allows.
  5. Reviews: a monthly look at the top cost drivers and vendor plan changes.

Compare cost with value

A coding tool that costs a few hundred dollars per engineer per year is cheap if it saves even a few hours a month — but only if those hours turn into delivery. Tie cost to the scorecard's outcome metrics, not to time-saved surveys alone.

What this means for the CTO

Ask your finance partner and platform team for one AI cost view across seats, usage, tokens and compute, by team and use case. Set budgets and alerts before agents scale, because agent loops and long contexts are where bills surprise you.

When a vendor changes pricing — and they will — re-run your cost model with your real usage before renewing. Build the switching ability (gateway, abstracted model calls) that gives you negotiating power.

A simple rule helps: no AI use case goes to production without a named cost owner, a budget and a unit-cost metric. It keeps the conversation with your CFO about value per unit rather than an alarming total.

Real example

Cursor changed its Pro plan on June 16, 2025 from request-based limits to $20 of frontier model usage per month at API pricing (plus unlimited Tab and Auto). On July 4, 2025 it wrote that the changes "were not communicated clearly, and we take full responsibility", and offered full refunds for unexpected charges incurred between June 16 and July 4. Source: Cursor — Clarifying our pricing (Jul 4, 2025) ↗

Use it

Quick check · 3 questions

  1. 1.Which AI cost type is most likely to spike unexpectedly?

  2. 2.What is a good AI unit cost for an engineering use case?

  3. 3.What should you do when a vendor changes its pricing model?

0 of 3 answered

Sources

Last reviewed 2026-10-01.