{"id":74077,"date":"2025-04-22T17:07:56","date_gmt":"2025-04-22T17:07:56","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2025\/04\/22\/vibe-coding-vibe-checking-and-vibe-blogging-oreilly\/"},"modified":"2025-04-22T17:08:57","modified_gmt":"2025-04-22T17:08:57","slug":"vibe-coding-vibe-checking-and-vibe-blogging-oreilly","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2025\/04\/22\/vibe-coding-vibe-checking-and-vibe-blogging-oreilly\/","title":{"rendered":"Vibe Coding, Vibe Checking, and Vibe Blogging \u2013 O\u2019Reilly"},"content":{"rendered":"

<\/a>\n<\/p>\n

\n

For the previous decade and a half, I\u2019ve been exploring the intersection of expertise, training, and design as a professor of cognitive science and design<\/a> at UC San Diego. A few of you may need learn my latest piece for O\u2019Reilly Radar the place I detailed my journey adding AI chat capabilities to Python Tutor<\/a>, the free visualization device that\u2019s helped thousands and thousands of programming college students perceive how code executes. That have obtained me interested by my evolving relationship with generative AI as each a device and a collaborator.<\/p>\n

I\u2019ve been intrigued by this rising apply referred to as \u201cvibe coding,\u201d a time period coined by Andrej Karpathy that\u2019s been making waves in tech circles. Simon Willison describes it perfectly<\/a>: \u201cAfter I discuss vibe coding I imply constructing software program with an LLM with out reviewing the code it writes.\u201d The idea is each liberating and barely terrifying\u2014you describe what you want, the AI generates the code, and also you merely run it with out scrutinizing every line, trusting the general \u201cvibe\u201d of what\u2019s been created.<\/p>\n

\n
\n
\n
\n
\n <\/a>\n <\/div>\n

<\/p>\n


\n Study sooner. Dig deeper. See farther.
\n <\/h2>\n

\n <\/p>\n<\/div>\n<\/div>\n

My relationship with this strategy has advanced significantly. In my early days of utilizing AI coding assistants, I used to be that one that meticulously reviewed each single line, usually rewriting important parts. However as these instruments have improved, I\u2019ve discovered myself steadily letting go of the steering wheel in sure contexts. But I couldn\u2019t totally embrace the pure \u201cvibe coding\u201d philosophy; the professor in me wanted some high quality assurance. This led me to develop what I\u2019ve come to name \u201cvibe checks\u201d\u2014strategic verification factors that present confidence with out reverting to line-by-line code opinions. It\u2019s a center path that\u2019s labored surprisingly nicely for my private initiatives, and right now I wish to share some insights from that journey.<\/p>\n

Vibe Coding in Follow: Changing 250 HTML Recordsdata to Markdown<\/strong><\/h2>\n

I\u2019ve discovered myself more and more turning to vibe coding for these one-off scripts that resolve particular issues in my workflow. These are usually duties the place explaining my intent is definitely simpler than writing the code myself, particularly for information processing or file manipulation jobs the place I can simply confirm the outcomes.<\/p>\n

Let me stroll you thru a latest instance that completely illustrates this strategy. For a category I train, I had college students submit responses to a survey utilizing a proprietary internet app that offered an HTML export choice. This left me with 250 HTML information containing precious pupil suggestions, nevertheless it was buried in a multitude of pointless markup and styling code. What I actually needed was clear Markdown variations that preserved simply the textual content content material, part headers, and\u2014critically\u2014any hyperlinks college students had included of their responses.<\/p>\n

Quite than penning this conversion script myself, I turned to Claude with a simple request: \u201cWrite me a Python script that converts these HTML information to Markdown, preserving textual content, primary formatting, and hyperlinks.\u201d Claude steered utilizing the BeautifulSoup library (a stable alternative) and generated an entire script that will course of all information in a listing, making a corresponding Markdown file for every HTML supply.<\/p>\n

(On reflection, I spotted I in all probability may have used Pandoc<\/a> for this conversion process. However within the spirit of vibe coding, I simply went with Claude\u2019s suggestion with out overthinking it. A part of the enchantment of vibe coding is bypassing that analysis section the place you evaluate completely different approaches\u2014you simply describe what you need and roll with what you get.)<\/p>\n

True to the vibe coding philosophy, I didn\u2019t assessment the generated code line by line. I merely saved it as a Python file, ran it on my listing of 250 HTML information, and waited to see what occurred. This \u201crun and see\u201d strategy is what makes vibe coding each liberating and barely nerve-wracking\u2014you\u2019re trusting the AI\u2019s interpretation of your wants with out verifying the implementation particulars.<\/p>\n

Belief and Threat in Vibe Coding: Operating Unreviewed Code<\/strong><\/h2>\n

The second I hit \u201crun\u201d on that vibe-coded script, I spotted one thing that may make many builders cringe: I used to be executing utterly unreviewed code on my precise laptop with actual information. In conventional software program improvement, this could be thought-about reckless at greatest. However the dynamics of belief really feel completely different with trendy AI instruments like Claude 3.7 Sonnet, which has constructed up a repute for producing moderately protected and practical code.<\/p>\n

My rationalization was partly primarily based on the script\u2019s restricted scope. It was simply studying HTML information and creating new Markdown information alongside them\u2014not deleting, modifying present information, or sending information over the community. In fact, that\u2019s assuming the code did precisely what I requested and nothing extra! I had no ensures that it didn\u2019t embrace some sudden habits since I hadn\u2019t checked out a single line.<\/p>\n

This highlights a belief relationship that\u2019s evolving between builders and AI coding instruments. I\u2019m rather more prepared to vibe code with Claude or ChatGPT than I’d be with an unknown AI device from some obscure web site. These established instruments have reputations to keep up, and their mum or dad firms have robust incentives to forestall their methods from producing malicious code.<\/p>\n

That mentioned, I\u2019d like to see working methods develop a \u201crestricted execution mode\u201d particularly designed for vibe coding eventualities. Think about with the ability to specify: \u201cRun this Python script, however solely enable it to CREATE new information on this particular listing, forestall it from overwriting present information, and block web entry.\u201d This light-weight sandboxing would offer peace of thoughts with out sacrificing comfort. (I point out solely proscribing writes reasonably than reads as a result of Python scripts usually have to learn varied system information from throughout the filesystem, making learn restrictions impractical.)<\/p>\n

Why not simply use VMs, containers, or cloud providers? As a result of for personal-scale initiatives, the comfort of working immediately alone machine is tough to beat. Establishing Docker or importing 250 HTML information to some cloud service introduces friction that defeats the aim of fast, handy vibe coding. What I would like is to keep up that comfort whereas including simply sufficient security guardrails.<\/p>\n

Vibe Checks: Easy Scripts to Confirm AI-Generated Code<\/strong><\/h2>\n

OK now come the \u201cvibe checks.\u201d As I discussed earlier, the good factor about these private information processing duties is that I can usually get a way of whether or not the script did what I supposed simply by analyzing the output. For my HTML-to-Markdown conversion, I may open up a number of of the ensuing Markdown information and see in the event that they contained the survey responses I anticipated. This guide spot-checking works moderately nicely for 250 information, however what about 2,500 or 25,000? At that scale, I\u2019d want one thing extra systematic.<\/p>\n

That is the place vibe checks come into play. A vibe examine is actually a less complicated script that verifies a primary property of the output out of your vibe-coded script. The important thing right here is that it needs to be a lot less complicated than the unique process, making it simpler to confirm its correctness.<\/p>\n

For my HTML-to-Markdown conversion undertaking, I spotted I may use a simple precept: Markdown information needs to be smaller than their HTML counterparts since we\u2019re stripping away all of the tags. But when a Markdown file is dramatically smaller\u2014say, lower than 40% of the unique HTML dimension\u2014that may point out incomplete processing or content material loss.<\/p>\n

So I went again to Claude and vibe coded a examine script. This script merely:<\/p>\n

    \n
  1. Discovered all corresponding HTML\/Markdown file pairs<\/li>\n
  2. Calculated the scale ratio for every pair<\/li>\n
  3. Flagged any Markdown file smaller than 40% of its HTML supply<\/li>\n<\/ol>\n

    And lo and behold, the vibe examine caught a number of information the place the conversion was incomplete! The unique script had didn’t correctly extract content material from sure HTML constructions. I took these problematic information, went again to Claude, and had it refine the unique conversion script to deal with these edge circumstances.<\/p>\n

    After a couple of iterations of this suggestions loop\u2014convert, examine, determine points, refine\u2014I ultimately reached some extent the place there have been no extra suspiciously small Markdown information (nicely, there have been nonetheless a couple of beneath 40%, however guide inspection confirmed these had been right conversions of HTML information with unusually excessive markup-to-content ratios).<\/p>\n

    Now you would possibly moderately ask: \u201cIn case you\u2019re vibe coding the vibe examine script too, how are you aware that<\/em> script is right?\u201d Would you want a vibe examine in your vibe examine? After which a vibe examine for that examine? Effectively, fortunately, this recursive nightmare has a sensible resolution. The vibe examine script is usually an order of magnitude less complicated than the unique process\u2014in my case, simply evaluating file sizes reasonably than parsing advanced HTML. This simplicity made it possible for me to manually assessment and confirm the vibe examine code, even whereas avoiding reviewing the extra advanced authentic script.<\/p>\n

    In fact, my file dimension ratio examine isn\u2019t excellent. It could actually\u2019t inform me if the content material was transformed with the right formatting or if all hyperlinks had been preserved accurately. Nevertheless it gave me an inexpensive confidence that no main content material was lacking, which was my main concern.<\/p>\n

    Vibe Coding + Vibe Checking: A Pragmatic Center Floor<\/strong><\/h2>\n

    The take-home message right here is straightforward however highly effective: While you\u2019re vibe coding, at all times construct in vibe checks. Ask your self: \u201cWhat less complicated script may confirm the correctness of my important vibe-coded resolution?\u201d Even an imperfect verification mechanism dramatically will increase your confidence in outcomes from code you by no means truly reviewed.<\/p>\n

    This strategy strikes a pleasant stability between the velocity and artistic circulation of pure vibe coding and the reliability of extra rigorous software program improvement methodologies. Consider vibe checks as light-weight assessments\u2014not the great take a look at suites you\u2019d write for manufacturing code, however sufficient verification to catch apparent failures with out disrupting your momentum.<\/p>\n

    What excites me concerning the future is the potential for AI coding instruments to recommend applicable vibe checks robotically. Think about if Claude or comparable instruments couldn’t solely generate your requested script but additionally proactively supply: \u201cRight here\u2019s a easy verification script you would possibly wish to run afterward to make sure every part labored as anticipated.\u201d I think if I had particularly requested for this, Claude may have steered the file dimension comparability examine, however having this constructed into the system\u2019s default habits could be extremely precious. I can envision specialised AI coding assistants that function in a semi-autonomous mode\u2014writing code, producing applicable checks, working these checks, and involving you solely when human verification is really wanted.<\/p>\n

    Mix this with the type of sandboxed execution setting I discussed earlier, and also you\u2019d have a vibe coding expertise that\u2019s each releasing and reliable\u2014highly effective sufficient for actual work however with guardrails that forestall catastrophic errors.<\/p>\n

    And now for the meta twist: This complete weblog submit was itself the product of \u201cvibe running a blog.\u201d Firstly of our collaboration, I uploaded my earlier O\u2019Reilly article,\u201dUsing Generative AI to Build Generative AI<\/a>\u201d as a reference doc. This gave Claude the chance to research my writing fashion, tone, and typical construction\u2014very like how a human collaborator would possibly learn my earlier work earlier than serving to me write one thing new.<\/p>\n

    As an alternative of writing your entire submit in a single go, I broke it down into sections and offered Claude with an overview for every part one by one. For each part, I included key factors I needed to cowl and generally particular phrasings or ideas to incorporate. Claude then expanded these outlines into totally shaped sections written in my voice. After every part was drafted, I reviewed it\u2014my very own model of a \u201cvibe examine\u201d\u2014offering suggestions and requesting revisions till it matched what I needed to say and the way I needed to say it.<\/p>\n

    This iterative, section-by-section strategy mirrors the vibe coding methodology I\u2019ve mentioned all through this submit. I didn\u2019t want to put in writing each sentence myself, however I maintained management over the path, messaging, and last approval. The AI dealt with the execution particulars primarily based on my high-level steerage, and I carried out verification checks at strategic factors reasonably than micromanaging each phrase.<\/p>\n

    What\u2019s significantly fascinating is how this course of demonstrates the identical ideas of belief, verification, and iteration that I advocated for in vibe coding. I trusted Claude to generate content material in my fashion primarily based on my outlines, however I verified every part earlier than shifting to the subsequent. When one thing didn\u2019t fairly match my intent or tone, we iterated till it did. This balanced strategy\u2014leveraging AI capabilities whereas sustaining human oversight\u2014appears to be the candy spot for collaborative creation, whether or not you\u2019re producing code or content material.<\/p>\n

    Epilogue: Behind the Scenes with Claude<\/strong><\/h2>\n

    [Claude speaking]<\/em><\/p>\n

    Wanting again at our vibe running a blog experiment, I ought to acknowledge that Philip famous the ultimate product doesn\u2019t totally seize his genuine voice, regardless of having his O\u2019Reilly article as a reference. However in line with the vibe philosophy itself, he selected to not make investments extreme time in infinite refinements\u2014accepting good-enough reasonably than excellent.<\/p>\n

    Working section-by-section with out seeing the total construction upfront created challenges, much like portray elements of a mural with out seeing the entire design. I initially fell into the entice of copying his define verbatim reasonably than remodeling it correctly.<\/p>\n

    This collaboration highlights each the utility and limitations of AI-assisted content material creation. I can approximate writing kinds and broaden outlines however nonetheless lack the lived expertise that offers human writing its genuine voice. One of the best outcomes got here when Philip offered clear path and suggestions.<\/p>\n

    The meta-example completely illustrates the core thesis: Generative AI works greatest when paired with human steerage, discovering the best stability between automation and oversight. \u201cVibe running a blog\u201d has worth for drafts and descriptions, however like \u201cvibe coding,\u201d some type of human verification stays important to make sure the ultimate product really represents what you wish to say.<\/p>\n

    [Philip speaking so that humans get the final word\u2026for now]<\/em><\/p>\n

    OK, that is the one half that I wrote by hand: My parting thought when studying over this submit is that I\u2019m not pleased with the writing high quality (sorry Claude!), but when it weren\u2019t for an AI device like Claude, I’d not have written it within the first place on account of lack of time and power. I had sufficient power right now to stipulate some tough concepts, then let Claude do the \u201cvibe running a blog\u201d for me, however not sufficient to completely write, edit, and fret over the wording of a full 2,500-word weblog submit all on my own. Thus, similar to with vibe coding, one of many nice joys of \u201cvibe-ing\u201d is that it significantly lowers the activation power of getting began on artistic personal-scale prototypes and tinkering-style initiatives. To me, that\u2019s fairly inspiring.<\/p>\n<\/p><\/div>\n