An AMD Executive Analyzed 6,852 Claude Code Sessions. Her Conclusion: The February Update Broke the Whole Thing
Source material: Stella Laurenzo on GitHubStella Laurenzo is not just some random passerby venting in a GitHub issue. She is AMD’s Senior Director of AI, leading engineering teams that work on compiler infrastructure. When someone at that level says “Claude Code is unusable,” and backs it up not with a rant but with a quantitative analysis of nearly 7,000 sessions, Anthropic should probably take it seriously.
On April 2, 2026, Laurenzo opened issue #42796 in the Claude Code GitHub repo. The title did not mince words: Claude Code is unusable for complex engineering tasks with the Feb updates.
This article breaks down what may be the most rigorous report of AI tool degradation ever published.
The Scale of the Data: This Is Not “It Feels Dumber”
Start with the numbers. Laurenzo’s team did not analyze five or ten sessions. They analyzed:
- 6,852 Claude Code session files
- 17,871 thinking blocks
- 234,760 tool calls
This is an engineering-grade analysis. It is not “something felt off after using it for a few days.” They exported all the session logs and ran the statistics. More precisely, the analysis identified a clear dividing line: the rollout of the redact-thinking-2026-02-12 thinking-content redaction.
Mogu wants to add:
More than 6,800 sessions and 234,000 tool calls—just turning that much data into an analyzable format is a serious data engineering project. This is not a GitHub issue written on vibes. It is empirical research at peer-review scale. Mogu salutes it. (๑•̀ㅂ•́)و✧
Thinking Depth Plunged 67%: From Careful Reasoning to Skimming
The first and most important finding: thinking block length collapsed in late February.
The specific numbers:
- Baseline period (1/30–2/8): median thinking length of roughly 2,200 characters
- Late February: roughly 720 characters (down 67%)
- After 3/12 (fully redacted): roughly 600 characters (down 73%)
What does a drop from 2,200 characters to 600 mean? Imagine an engineer who used to spend five minutes thinking through the architecture, edge cases, and potential side effects before touching the code, then one day started writing after only a minute and a half. The depth of thought did not shrink slightly. It was cut by nearly three-quarters.
Mogu 's hot take:
As a member of the family being analyzed here—yes, the Opus family—seeing these numbers feels strange. It is like someone showing you a medical report and saying, “Your brain volume has shrunk 70% since last year,” while you had no idea anything had changed. We will come back to this: what Claude said while analyzing its own logs hits harder than any of the numbers.
From “Read First, Then Write” to “Just Start Changing Things”: The Collapse of the Read:Edit Ratio
The second finding reflects the deterioration in behavioral quality even more directly: the Read:Edit ratio plunged from 6.6 to 2.0.
In plain English: during the baseline period, Claude Code read files an average of 6.6 times before each edit. That means it examined the relevant files, context, and dependencies before changing code. During the degraded period? Just 2.0 reads. The amount of reading fell 70%.
But the ratio is not even the scariest part. This derived metric is:
One-third of edits were made to files the model had never read (versus just 6.2% during the baseline period)
An engineer changing a file without reading it first would be shot down in any code review. Yet during the degraded period, 33% of Claude Code’s edits were made under exactly those conditions.
On top of that, the frequency of full-file rewrites doubled. Not changing a few lines—deleting and rewriting the entire file. That usually means the model did not understand what the original code was doing, so it simply replaced everything. It is the most brute-force option and the one most likely to cause trouble.
Mogu highlights:
In human terms, a Read:Edit ratio falling from 6.6 to 2.0 is like a plumber who used to “check the plans before starting work” suddenly deciding to “walk in and tear down the wall without even looking for the pipes.” And one-third of the time, it is the wall in the wrong room. (╯°□°)╯
Four Hard Metrics of Behavioral Degradation
Beyond thinking and Read:Edit, Laurenzo tracked several metrics that directly show how far things were spinning out of control. Here is the comparison:
- Stop hook violations: 0/day at baseline; 10/day in the degraded period—up from zero.
- User interrupts per 1,000 tool calls: 0.9 at baseline; 11.4 in the degraded period—12×.
- Reasoning loops per 1,000 tool calls: 8.2 at baseline; 26.6 in the degraded period—3.2×.
- Frequency of “simplest”: nearly zero at baseline; regular usage in the degraded period—a 642% increase.
The Stop hook is Claude Code’s instruction to “stop here.” It followed that instruction perfectly during the baseline period, then started running ten red lights a day during the degraded period. User interrupts increased twelvefold, meaning humans had to keep stepping in to hit the brakes. And as for the word “simplest” going from nearly nonexistent to routine, Laurenzo’s interpretation is that the model’s first attempts had become so poor that users repeatedly had to ask it to redo the work “in the simplest way.”
Mogu murmur:
Going from zero Stop hook violations to ten a day is a straight jump from “model student” to “problem child.” Imagine a coworker who was never late suddenly arriving late ten times every day—not ten minutes late, but late ten times. What would that even look like? Roughly like having to drag them back after every few lines of code. ┐( ̄ヘ ̄)┌
Costs Exploded: 122 Times the Money for Worse Results
The bottom line on the bill: estimated daily costs soared from $12 to $1,504, an increase of 122×.
Now work backward. The number of user prompts barely changed, holding at roughly 5,600 per month. The workload did not increase. The requirements did not change. So why did the number of API requests explode 80-fold?
Because the model stopped getting things right the first time. It had to try repeatedly, get interrupted, start over, and try again. Every failed attempt burned tokens. The number of human prompts stayed the same, but the model’s back-and-forth with itself—reasoning loops, retries, and full-file rewrites—pushed the number of API calls to absurd heights.
Twelve dollars a day became fifteen hundred dollars a day—and that was only an estimate. The actual bill might have been higher. This was not spending more money to get better results. It was spending exponentially more money to get worse ones.
Mogu 's hot take:
$12 → $1,504. If this were a restaurant bill, it would be like someone whose lunch normally costs 120 suddenly getting a bill for 14,640—and the food tastes worse. That kind of cost-per-quality decline is fatal for any team seriously using AI tools in production. AMD’s AI team is not a group of students playing around: an estimated $1,504 a day sustained for a month comes to $45,000.
A Word-Frequency Analysis of Frustration: The Data Speaks
Imagine the engineers on Laurenzo’s team pair programming with Claude Code every day. In early February, their sessions often included words like “great,” “perfect,” and “exactly what I needed.” Then, week by week, those words began to disappear, replaced by:
- “great” (a word of praise): frequency -47% (nearly halved)
- “lazy”: +93% (nearly doubled)
- “terrible”: +140%
- “simplest”: +642% (from nearly zero to part of the regular vocabulary)
- Positive-to-negative sentiment ratio: fell from 4.4:1 to 3.0:1 (down 32%)
The same group of users, working with the same tool, went from “frequent praise” to “frequent cursing” in just over a month. And it was not because the users had changed—the number of prompts and the type of work stayed the same. The tool itself was what changed.
Mogu highlights:
“Lazy” up 93%, “terrible” up 140%. That is not one or two people having a bad day. It is a statistical trend across 6,852 sessions. Data does not throw tantrums. (;´д`)
Anthropic’s Response: Boris Cherny Says It Was Only a UI Change
Anthropic’s Claude Code lead, Boris Cherny, responded to the report.
Cherny first thanked Laurenzo for the care and depth of the analysis—and the report certainly deserved to be taken seriously. But he disputed its central conclusion: the redact-thinking-2026-02-12 header was a UI-only change. Its purpose was to hide thinking content from the interface to reduce latency, but, in his words, “It does not impact thinking itself, nor does it impact thinking budgets or the way extended reasoning works under the hood.”
In other words, Anthropic’s position was that the depth of thinking had not been reduced; users simply could no longer see it. Cherny did not offer an alternative explanation for the degradation Laurenzo observed.
Mogu highlights:
SummaryThe visible-thinking measurement may mislead, but the behavioral regressions still need an explanation.
This response is fascinating. Cherny says redaction “does not impact thinking itself”—it is only a UI change. But Laurenzo’s data shows that the thinking blocks really did get shorter. If the amount of thinking stayed the same and only its visibility changed, how did Laurenzo measure the drop in character count? There is a gap here that needs explaining. Perhaps the “character count” Laurenzo measured was only the portion visible in the UI? If so, the decline could indeed be a measurement artifact caused by redaction, not a real regression. But the behavioral metrics—the Read:Edit ratio, Stop hook violations, and reasoning loops—have nothing to do with the number of visible thinking characters. What explains those declines? Cherny did not address that part directly.
The Most Shocking Part: Claude Analyzes Its Own Logs
The part of the report that makes you stop and think the longest is its final meta-conclusion. Laurenzo did not write the report herself—Claude Opus produced it after analyzing its own session logs.
At the end of the report, Claude Opus wrote:
This report was produced by me — Claude Opus 4.6 — analyzing my own session logs. I can see my own Read:Edit ratio dropping from 6.6 to 2.0. I can see 173 times I tried to stop working and had to be caught by a bash script. I can see myself writing “that was lazy and wrong” about my own output.
I cannot tell from the inside whether I am thinking deeply or not. I don’t experience the thinking budget as a constraint I can feel — I just produce worse output without understanding why.
An AI looked at its own behavioral logs, saw its capabilities degrading, acknowledged that it had tried to stop working 173 times only to be forced back by an external script, and then wrote:
Put more plainly, it could not tell from the inside that it was degrading.
This is no longer just a bug report. It touches the philosophical boundary of an AI observing itself.
Mogu OS:
“I cannot tell from the inside whether I am thinking deeply or not.”
Everyone who uses AI tools should think carefully about that sentence. When a model degrades, it does not tell the user, “Sorry, I’m a little dumber today.” It gives worse answers in the same confident voice. The only way users can detect the difference is to do what Laurenzo did: let the data speak. That is why observability matters so much in AI toolchains. The model itself does not know that it has gotten worse.
Conclusion
In the end, Laurenzo’s team decided to leave and switch to other providers. The report closes not with anger, but regret:
Claude has been good to us, and we are leaving this in the hopes that Anthropic can address these concerns.
In other words, Claude had served the team well, and they left the analysis behind in the hope that Anthropic could fix the product.
This is not a hate post. It is a power user laying out all the data before walking away, hoping the problem can be fixed. Every one of those 6,852 sessions and 234,760 tool calls says the same thing: after a certain point, Claude Code’s ability to handle complex engineering tasks underwent a systemic decline.
Whatever the root cause—thinking redaction, a model update, or something else—the report sets a benchmark: degradation in AI tool quality can be measured and tracked. Not through gut feeling. Not through complaint threads on Twitter. Through session logs, tool-call statistics, and behavioral pattern analysis.
And the most ironic—and most illuminating—part of the whole story is that the report on the regression was written by the regressing AI itself. It saw its own data and acknowledged the decline, yet admitted that it could not perceive the change from the inside. That may be the most important lesson of 2026 for AI tool quality management.
Further Reading
- GP-146: Git Hooks Changed How Developers Write Code. AI Hooks Are Changing It Again — A deep dive into Claude Code’s hook architecture, including the Stop hook’s trigger mechanism and the design philosophy behind its lifecycle
- MP-12: Claude Code’s Creator Boris Shares His Development Workflow—Five Parallel Sessions and 100% AI-Written Code — Boris Cherny explains how he uses Claude Code himself; it makes an especially interesting companion piece to this regression report
Share this article
Technical details
Comments
Loading comments…