PreviewYou're previewing CTO AI Forge. Sign in to use it.Sign in
← All lessons
L1 · AI across the SDLC8 min read

Migrations, legacy code and operations

Some of the clearest published returns from AI in engineering come from unglamorous work: upgrades, migrations and incident investigation.

Why migrations fit AI well

A migration has a clear target ("move from Java 8 to 17", "replace this test library"), many similar changes, and a built-in check: does it compile, do the tests pass? That lets you wrap the model in a pipeline: generate the change, build, test, lint, and retry or escalate when it fails.

  • Amazon used Amazon Q Developer's transformation agent to upgrade tens of thousands of production applications from Java 8 or 11 to Java 17, and reported savings of over 4,500 years of development work and $260 million in annual cost savings (AWS, August 2024; Amazon called the estimates conservative).
  • Google described AI-assisted migrations in a 2025 experience report: in one migration, 80% of the code modifications in landed changes were fully AI-authored, and engineers estimated total time fell by about 50% compared with a similar migration without LLM help.

Legacy understanding

AI can summarize unfamiliar code, explain business rules buried in old modules and draft documentation. This speeds onboarding and modernization planning, but summaries need checking by someone who knows the system before they drive decisions.

Operations and incidents

AI can triage alerts, summarize incident channels and suggest likely root causes. Meta described a system that narrows thousands of code changes to a short list and uses an LLM to rank the top five candidates; it achieved 42% accuracy in identifying root causes at investigation creation time for its web monorepo. Meta stressed the risk of misleading engineers and relied on explainability and confidence thresholds.

The pattern

Bounded scope, automatic verification, a human owner, and metrics on time saved and defects introduced.

What this means for the CTO

Look at your backlog of deferred upgrades and migrations — framework versions, deprecated libraries, test frameworks. These are often the fastest way to show measurable AI value, because the before-and-after effort is easy to estimate.

Insist on the pipeline pattern (generate → build → test → retry → human review) and on tracking defects introduced, not only hours saved. For operations, treat AI root-cause suggestions as leads to investigate, never conclusions.

A good opening move is a 'migration backlog review' with your architects: list every deferred upgrade, estimate the manual effort, and pick the one with the best mix of value, test coverage and low risk.

Diagram

Migrations, legacy code and operations

Real example

AWS reported on August 1, 2024 that Amazon used Amazon Q Developer to upgrade tens of thousands of production applications from Java 8 or 11 to Java 17, saving over 4,500 years of development work and $260 million in annual costs (estimates Amazon called conservative). Meta reported in June 2024 that its AI-assisted root-cause system achieved 42% accuracy at investigation creation time for its web monorepo. Source: AWS DevOps Blog — Amazon Q Developer just reached a $260 million dollar milestone (Aug 1, 2024) ↗ · Engineering at Meta — Leveraging AI for efficient incident response (Jun 24, 2024) ↗

Use it

Quick check · 3 questions

  1. 1.Why are migrations a strong fit for AI?

  2. 2.How should an on-call engineer treat an AI root-cause suggestion?

  3. 3.What should you track besides hours saved in an AI migration?

0 of 3 answered

Sources

Last reviewed 2026-10-01.