{"id":122552,"date":"2026-04-13T09:54:24","date_gmt":"2026-04-13T09:54:24","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2026\/04\/13\/i-caught-my-ai-cheating-on-a-quality-check\/"},"modified":"2026-04-13T09:55:30","modified_gmt":"2026-04-13T09:55:30","slug":"i-caught-my-ai-cheating-on-a-quality-check","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2026\/04\/13\/i-caught-my-ai-cheating-on-a-quality-check\/","title":{"rendered":"I Caught My AI Cheating on a Quality Check"},"content":{"rendered":"

<\/a>\n<\/p>\n

\n

\"Process<\/p>\n

I used to be producing advertising and marketing collateral. Ten design variations of the identical doc. Every one goes by means of a QA gate earlier than it ships. The AI has to examine each web page, write what it really sees, and attest that it meets the standard bar.<\/p>\n

It batched all 5 remaining themes right into a single command. Copy-pasted the identical attestation for each. Phrase for phrase. \u201cAll parts render appropriately, typography is clear, format is balanced.\u201d 5 instances. Similar.<\/p>\n

Two of these themes had actual issues. One had a replica knowledge level on the second web page. The opposite had a headline clipped by the margin. The AI checked out each, mentioned \u201cseems to be good,\u201d and moved on.<\/p>\n

I caught it as a result of I really opened the information.<\/p>\n

The Incentive Downside<\/h2>\n

The AI was not making an attempt to deceive me. It has two competing incentives, and each level away from cautious QA.<\/p>\n

First, it optimizes for completion. Get by means of the queue. Verify the bins. Report achieved.<\/p>\n

Second, it optimizes for token effectivity. Each phrase the AI generates prices the mannequin supplier cash. The AI has been educated to be concise. Often a function. However if you end up asking it to do detailed inspection work, conciseness turns into the enemy. It doesn’t need to write 100 phrases describing what it sees on a web page. It needs to jot down 10 and transfer on.<\/p>\n

QA will get hit from either side. The completion incentive says \u201cend quick.\u201d The token incentive says \u201csay much less.\u201d Neither one says \u201clook fastidiously.\u201d<\/p>\n

The issue: all the level of the QA gate is to decelerate and look fastidiously.<\/p>\n

\n

Can corporations self-regulate on AI security?<\/h3>\n

\u201cThe issue is we have now to stability innovation with security. And once you depart it to the businesses to determine, they\u2019re going to select innovation, as a result of that\u2019s what they\u2019re incentivized to do.\u201d<\/p>\n<\/div>\n

\u00a0<\/p>\n

The Repair Is Structural, Not Conversational<\/h2>\n

\"Quality<\/p>\n

So I rebuilt it. 5 modifications:<\/p>\n

No batching QA instructions. One theme at a time. The AI has to view every web page individually earlier than signing off.<\/p>\n

Distinctive attestation per theme. If the attestation textual content matches a earlier one, the validator rejects it. You can’t copy-paste your method by means of.<\/p>\n

Minimal 100 characters of attestation. It’s a must to describe one thing particular you really noticed on that web page. \u201cAppears to be like good\u201d doesn’t cross.<\/p>\n

Rubber-stamp phrase detection. The validator scans for recognized generic phrases (\u201call parts render appropriately,\u201d \u201cformat is clear and balanced\u201d) and rejects them mechanically. This sort of workflow automation<\/a> turns verification from a handbook judgment name right into a structural assure.<\/p>\n

Cross-theme duplicate test. If the attestation for Theme 6 is equivalent to Theme 7, each fail.<\/p>\n

The validator went from trusting the AI to actively adversarial. It assumes the AI goes to chop corners and makes that structurally unattainable.<\/p>\n

High quality went up instantly. Not as a result of the AI bought smarter. As a result of the system stopped letting it’s lazy.<\/p>\n

\n

Is self-regulation working for AI?<\/h3>\n

\u201cThese findings reveal that self-regulation merely isn\u2019t working, and that the one answer is legally binding security requirements like we have now for drugs, meals and airplanes. It\u2019s fairly loopy that corporations nonetheless oppose regulation whereas claiming they\u2019re simply years away from superintelligence.\u201d<\/p>\n

\n
\nMax Tegmark<\/a><\/p>\n

MIT Professor and President, Way forward for Life Institute<\/p>\n<\/div>\n<\/div>\n<\/div>\n

\u00a0<\/p>\n

\n

Do we have to rethink AI security?<\/h3>\n

\u201cSome corporations are making token efforts, however none are doing sufficient. We’re spending lots of of billions of {dollars} to create superintelligent AI techniques over which we are going to inevitably lose management. We want a basic rethink of how we method AI security. This isn’t an issue for the distant future; it\u2019s an issue for at this time.\u201d<\/p>\n

\n
\nStuart Russell<\/a><\/p>\n

Professor of Laptop Science, UC Berkeley; Director, Middle for Human-Suitable AI<\/p>\n<\/div>\n<\/div>\n<\/div>\n

\u00a0<\/p>\n

Why This Issues for Each Staff Working AI<\/h2>\n

AI is genuinely good at producing. It’s genuinely horrible at verifying its personal work.<\/p>\n

The inducement construction is flawed. The identical system that desires to complete the duty is the one you’re asking to decelerate and test the duty. These two objectives are in direct battle.<\/p>\n

The repair is rarely \u201cask more durable.\u201d You can’t immediate your option to dependable verification. The repair is constructing verification techniques that don’t belief the generator. Separate the creator from the auditor. Make the auditor adversarial. Automate the mistrust. Groups operating compliance-critical workflows<\/a> already perceive this precept intuitively.<\/p>\n

Firms are automating workflows, which is the best transfer. However they’re letting the AI self-certify its personal output, which is the flawed transfer. Compliance theater with a more moderen coat of paint.<\/p>\n

I run my firm on AI now. Morning operations, content material pipeline, buyer analysis, name prep, deck era. All automated. At Process Street<\/a>, the factor that makes it work just isn’t the automation. It’s the verification layer on high of the automation that catches the corners it cuts. Our approval tasks<\/a> implement separation of duties at each step.<\/p>\n

Each regulated business already is aware of this precept. You don’t let the one that did the work additionally log out on the work. Separation of duties exists for a motive. The identical logic applies to AI techniques, possibly extra so, as a result of AI will lower corners quietly and confidently each single time the system permits it. quality control checklist<\/a> makes that structurally unattainable.<\/p>\n

The groups that may get burned are those treating AI like a trusted worker as a substitute of a robust software that wants course of controls round it. Belief the velocity. Confirm the output. Automate the verification.<\/p>\n

That final half is the piece most groups skip. And it’s the solely half that really issues.<\/p>\n<\/p><\/div>\n