{"id":88938,"date":"2025-08-08T02:43:40","date_gmt":"2025-08-08T02:43:40","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/"},"modified":"2025-08-08T02:44:47","modified_gmt":"2025-08-08T02:44:47","slug":"jay-alammar-on-building-ai-for-the-enterprise-oreilly","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/","title":{"rendered":"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly"},"content":{"rendered":"<p> <a href=\"https:\/\/go.fiverr.com\/visit\/?bta=1052423&nci=17043\" Target=\"_Top\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/fiverr.ck-cdn.com\/tn\/serve\/?cid=40081059\"  width=\"601\" height=\"201\"><\/a>\n<\/p>\n<div id=\"postContent-content\">\n<div class=\"podcast_player\">\n<div id=\"2262808225\" class=\"castos-player dark-mode \" tabindex=\"0\" data-episode=\"17223\" data-player_id=\"2262808225\">\n<div class=\"player\">\n<div class=\"player__main\">\n<div class=\"player__artwork player__artwork-17223\">\n<img decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/www.oreilly.com\/radar\/wp-content\/uploads\/sites\/3\/2024\/01\/Podcast_Cover_GenAI_in_the_Real_World-160x160.png\" alt=\"Generative AI in the Real World\" title=\"Generative AI in the Real World\"\/><\/div>\n<div class=\"player__body\">\n<div class=\"currently-playing\">\n<p>\nGenerative AI within the Actual World<\/p>\n<p>Generative AI within the Actual World: Jay Alammar on Constructing AI for the Enterprise<\/p>\n<\/div>\n<div class=\"play-progress\">\n<div class=\"play-pause-controls\">\n<button title=\"Play\" aria-label=\"Play Episode\" aria-pressed=\"false\" class=\"play-btn\"><br \/>\n<span class=\"screen-reader-text\">Play Episode<\/span><br \/>\n<\/button><br \/>\n<button title=\"Pause\" aria-label=\"Pause Episode\" aria-pressed=\"false\" class=\"pause-btn hide\"><br \/>\n<span class=\"screen-reader-text\">Pause Episode<\/span><br \/>\n<\/button><br \/>\n<img decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/www.oreilly.com\/radar\/wp-content\/plugins\/seriously-simple-podcasting\/assets\/css\/images\/player\/images\/icon-loader.svg\" alt=\"Loading\" class=\"ssp-loader hide\"\/><\/div>\n<div>\n<audio preload=\"none\" class=\"clip clip-17223\"><source src=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3\"><\/source><\/audio><\/p>\n<div class=\"ssp-playback playback\">\n<p>\n<button class=\"player-btn player-btn__volume\" title=\"Mute\/Unmute\"><br \/>\n<span class=\"screen-reader-text\">Mute\/Unmute Episode<\/span><br \/>\n<\/button><br \/>\n<button data-skip=\"-10\" class=\"player-btn player-btn__rwd\" title=\"Rewind 10 seconds\"><br \/>\n<span class=\"screen-reader-text\">Rewind 10 Seconds<\/span><br \/>\n<\/button><br \/>\n<button data-speed=\"1\" class=\"player-btn player-btn__speed\" title=\"Playback Speed\" aria-label=\"Playback Speed\">1x<\/button><br \/>\n<button data-skip=\"30\" class=\"player-btn player-btn__fwd\" title=\"Fast Forward 30 seconds\"><br \/>\n<span class=\"screen-reader-text\">Quick Ahead 30 seconds<\/span><br \/>\n<\/button><\/p>\n<p>\n<time class=\"ssp-timer\">00:00<\/time><br \/>\n<span>\/<\/span><br \/>\n<time class=\"ssp-duration\" datetime=\"PT0H0M0S\">42m 38s<\/time><\/p>\n<\/div>\n<\/div>\n<\/div>\n<nav class=\"player-panels-nav\">\n<button class=\"subscribe-btn\" id=\"subscribe-btn-17223\" title=\"Subscribe\">Subscribe<\/button><br \/>\n<button class=\"share-btn\" id=\"share-btn-17223\" title=\"Share\">Share<\/button><\/nav>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p>Jay Alammar, director and Engineering Fellow at Cohere, joins Ben Lorica to speak about constructing AI functions for the enterprise, utilizing RAG successfully, and the evolution of RAG into brokers. Pay attention in to seek out out what sorts of metadata you want while you\u2019re onboarding a brand new mannequin or agent; uncover how an emphasis on analysis helps a company enhance its processes; and learn to make the most of the most recent code-generation instruments.<\/p>\n<p><strong>Concerning the <em>Generative AI within the Actual World<\/em> podcast:<\/strong> In 2023, ChatGPT put AI on everybody\u2019s agenda. In 2025, the problem will likely be turning these agendas into actuality. In <em>Generative AI within the Actual World<\/em>, Ben Lorica interviews leaders who&#8217;re constructing with AI. Be taught from their expertise to assist put AI to work in your enterprise.<\/p>\n<p>Take a look at <a href=\"https:\/\/learning.oreilly.com\/playlists\/42123a72-1108-40f1-91c0-adbfb9f4983b\/?_gl=1*16z5k2y*_ga*MTE1NDE4NjYxMi4xNzI5NTkwODkx*_ga_092EL089CH*MTcyOTYxNDAyNC4zLjEuMTcyOTYxNDAyNi41OC4wLjA.\" target=\"_blank\" rel=\"noreferrer noopener\">other episodes<\/a> of this podcast on the O\u2019Reilly studying platform.<\/p>\n<h3 class=\"wp-block-heading\">Timestamps<\/h3>\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=0\" target=\"_blank\" rel=\"noreferrer noopener\">0:00<\/a>: Introduction to Jay Alammar, director at <a href=\"https:\/\/cohere.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Cohere<\/a>. He\u2019s additionally the creator of <em>Palms-On Massive Language Fashions<\/em>.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=30\" target=\"_blank\" rel=\"noreferrer noopener\">0:30<\/a>: What has modified in how you consider educating and constructing with LLMs?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=45\" target=\"_blank\" rel=\"noreferrer noopener\">0:45<\/a>: That is my fourth yr with Cohere. I actually love the chance as a result of it was an opportunity to affix the staff early (across the time of GPT-3). Aidan Gomez, one of many cofounders, was one of many coauthors of the transformers paper. I\u2019m a scholar of how this expertise went out of the lab and into apply. Having the ability to work in an organization that\u2019s doing that has been very instructional for me. That\u2019s slightly of what I exploit to show. I exploit my writing to study in public.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=140\" target=\"_blank\" rel=\"noreferrer noopener\">2:20<\/a>: I assume there\u2019s an enormous distinction between studying in public and educating groups inside corporations. What\u2019s the large distinction?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=156\" target=\"_blank\" rel=\"noreferrer noopener\">2:36<\/a>: Should you\u2019re studying by yourself, it&#8217;s a must to run by means of a lot content material and information, and it&#8217;s a must to mute a variety of it as nicely. This trade strikes extraordinarily quick. Everyone seems to be overwhelmed by the tempo. For adoption, the essential factor is to filter a variety of that and see what really works, what patterns work throughout use instances and industries, and write about these.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=205\" target=\"_blank\" rel=\"noreferrer noopener\">3:25<\/a>: That\u2019s why one thing like RAG proved itself as one utility paradigm for a way folks ought to be capable to use language fashions. Numerous it&#8217;s serving to folks minimize by means of the hype and get to what\u2019s really helpful, and lift AI consciousness. There\u2019s a degree of AI literacy that folks want to return to grips with.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=250\" target=\"_blank\" rel=\"noreferrer noopener\">4:10<\/a>: Folks in corporations wish to study issues which might be contextually related. For instance, when you\u2019re in finance, you need materials that may assist take care of Bloomberg and people sorts of knowledge sources, and materials conscious of the regulatory atmosphere.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=278\" target=\"_blank\" rel=\"noreferrer noopener\">4:38<\/a>: When folks began having the ability to perceive what this type of expertise was able to doing, there have been a number of classes the trade wanted to grasp. Don\u2019t consider chat as the very first thing you must deploy. Consider less complicated use instances, like summarization or extraction. Take into consideration these as constructing blocks for an utility.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=328\" target=\"_blank\" rel=\"noreferrer noopener\">5:28<\/a>: It\u2019s unlucky that the identify \u201cgenerative AI\u201d got here for use as a result of an important issues AI can do aren\u2019t generative: they\u2019re the illustration with embeddings that allow higher categorization, higher clustering, and enabling corporations to make sense of huge quantities of information. The following lesson was to not depend on a mannequin\u2019s data. To start with of 2023, there have been so many information tales concerning the fashions being a search engine. Folks anticipated the mannequin to be truthful, and so they had been stunned when it wasn\u2019t. One of many first options was RAG. RAG tries to retrieve the context that may hopefully include the reply. The following query was knowledge safety and knowledge privateness: They didn\u2019t need knowledge to depart their community. That\u2019s the place personal deployment of fashions turns into a precedence, the place the mannequin involves the info. With that, they began to deploy their preliminary use instances.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=484\" target=\"_blank\" rel=\"noreferrer noopener\">8:04<\/a>: Then that system can reply methods to a selected degree of problem\u2014however with extra problem, the system must be extra superior. Perhaps it must seek for a number of queries or do issues over a number of steps.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=511\" target=\"_blank\" rel=\"noreferrer noopener\">8:31<\/a>: One factor we discovered about RAG was that simply because one thing is within the context window doesn\u2019t imply the machine received\u2019t hallucinate. And other people have developed extra appreciation of making use of much more context: GraphRAG, context engineering. Are there particular developments that persons are doing extra of? I received enthusiastic about GraphRAG, however that is onerous for corporations. What are a few of the developments throughout the RAG world that you just\u2019re seeing?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=582\" target=\"_blank\" rel=\"noreferrer noopener\">9:42<\/a>: Sure, when you present the context, the mannequin may nonetheless hallucinate. The solutions are probabilistic in nature. The identical mannequin that may reply your questions 99% of the time accurately may\u2026<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=610\" target=\"_blank\" rel=\"noreferrer noopener\">10:10<\/a>: Or the fashions are black containers and so they\u2019re opinionated. The mannequin could have seen one thing in its pretraining knowledge.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=625\" target=\"_blank\" rel=\"noreferrer noopener\">10:25<\/a>: True. And when you\u2019re coaching a mannequin, there\u2019s that trade-off; how a lot do you wish to pressure the mannequin to reply from the context versus normal frequent sense?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=655\" target=\"_blank\" rel=\"noreferrer noopener\">10:55<\/a>: That\u2019s an excellent level. You is perhaps feeding conspiracy theories within the context home windows.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=664\" target=\"_blank\" rel=\"noreferrer noopener\">11:04<\/a>: As a mannequin creator, you at all times take into consideration generalization and the way the mannequin will be the most effective mannequin throughout the numerous use instances.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=675\" target=\"_blank\" rel=\"noreferrer noopener\">11:15<\/a>: The evolution of RAG: There are a number of ranges of problem that may be constructed right into a RAG system. The primary is to go looking one knowledge supply, get the highest few paperwork, and add them to the context. Then RAG methods will be improved by saying, \u201cDon\u2019t seek for the consumer question itself, however give the query to a language mannequin to say \u2018What question ought to I ask to reply this query?\u2019\u201d That grew to become question rewriting. Then for the mannequin to enhance its data gathering, give it the power to seek for a number of issues on the similar time\u2014for instance, evaluating NVIDIA\u2019s leads to 2023 and 2024. A extra superior system would seek for two paperwork, asking a number of queries.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=795\" target=\"_blank\" rel=\"noreferrer noopener\">13:15<\/a>: Then there are fashions that ask a number of queries in sequence. For instance, what are the highest automobile producers in 2024, and do they every make EVs? The perfect course of is to reply the primary query, get that checklist, after which ship a question for each. Does Toyota make an EV? Then you definitely see the agent constructing this habits. A number of the high options are those we\u2019ve described: question rewriting, utilizing engines like google, deciding when it has sufficient data, and doing issues sequentially.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=878\" target=\"_blank\" rel=\"noreferrer noopener\">14:38<\/a>: Earlier within the pipeline\u2014as you&#8217;re taking your PDF recordsdata, you research them and make the most of them. Nirvana can be a information graph. I\u2019m listening to about groups making the most of the sooner a part of the pipeline.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=933\" target=\"_blank\" rel=\"noreferrer noopener\">15:33<\/a>: It is a design sample we\u2019re seeing increasingly more of. Once you\u2019re onboarding, give the mannequin an onboarding part the place it may gather data, retailer it someplace that may assist it work together. We see a variety of metadata for brokers that take care of databases. Once you onboard to a database system, it will make sense so that you can give the mannequin a way of what the tables are, what columns they&#8217;ve. You see that additionally with a repository, with merchandise like Cursor. Once you onboard the mannequin to a brand new codebase, it will make sense to provide it a Markdown web page that tells it the tech stack and the check frameworks. Perhaps after implementing a big sufficient chunk, do a check-in after working the check. No matter having fashions that may match 1,000,000 tokens, managing that context is essential.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1043\" target=\"_blank\" rel=\"noreferrer noopener\">17:23<\/a>: And in case your retrieval provides you the correct data, why would you stick 1,000,000 tokens within the context? That\u2019s costly. And persons are noticing that LLMs behave like us: They learn the start of the context and the tip. They miss issues within the center.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1072\" target=\"_blank\" rel=\"noreferrer noopener\">17:52<\/a>: Are you listening to folks doing GraphRAG, or is it a factor that folks write about however few are happening this highway?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1098\" target=\"_blank\" rel=\"noreferrer noopener\">18:18<\/a>: I don\u2019t have direct expertise with it.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1104\" target=\"_blank\" rel=\"noreferrer noopener\">18:24<\/a>: Are folks asking for it?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1107\" target=\"_blank\" rel=\"noreferrer noopener\">18:27<\/a>: I can\u2019t cite a lot clamor. I\u2019ve heard of a lot of attention-grabbing developments, however there are many attention-grabbing developments in different areas.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1125\" target=\"_blank\" rel=\"noreferrer noopener\">18:45<\/a>: The folks speaking about it are the graph folks. One of many patterns I see is that you just get excited, and a yr in you notice that the one folks speaking about it are the distributors.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1156\" target=\"_blank\" rel=\"noreferrer noopener\">19:16<\/a>: Analysis: You\u2019re speaking to a variety of corporations. I\u2019m telling folks \u201cYour eval is IP.\u201d So if I ship you to an organization, what are the primary few issues they need to be doing?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1188\" target=\"_blank\" rel=\"noreferrer noopener\">19:48<\/a>: That\u2019s one of many areas the place corporations ought to actually develop inside information and capabilities. It\u2019s the way you\u2019re capable of inform which vendor is healthier on your use case. Within the realm of software program, it\u2019s akin to unit exams. That you must differentiate and perceive what use instances you\u2019re after. Should you haven\u2019t outlined these, you aren\u2019t going to achieve success.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1230\" target=\"_blank\" rel=\"noreferrer noopener\">20:30<\/a>: You set your self up for achievement when you outline the use instances that you really want. You collect inside examples along with your precise inside knowledge, and that may be a small dataset. However that gives you a lot path.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1250\" target=\"_blank\" rel=\"noreferrer noopener\">20:50<\/a>: That may pressure you to develop your course of too. When do you ship one thing to an individual? When do you ship it to a different mannequin?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1264\" target=\"_blank\" rel=\"noreferrer noopener\">21:04<\/a>: That grounds folks\u2019s expertise and expectations. And also you get all the advantages of unit exams.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1293\" target=\"_blank\" rel=\"noreferrer noopener\">21:33<\/a>: What\u2019s the extent of sophistication of an everyday enterprise on this space?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1300\" target=\"_blank\" rel=\"noreferrer noopener\">21:40<\/a>: I see folks growing fairly shortly as a result of the pickup in language fashions is large. It\u2019s an space the place corporations are catching up and investing. We\u2019re seeing a variety of adoption of software use and RAG and corporations defining their very own instruments. But it surely\u2019s at all times an excellent factor to proceed to advocate.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1344\" target=\"_blank\" rel=\"noreferrer noopener\">22:24<\/a>: What are a few of the patterns or use instances which might be frequent now that persons are pleased about, which might be delivering on ROI?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1360\" target=\"_blank\" rel=\"noreferrer noopener\">22:40<\/a>: RAG and grounding it on inside firm knowledge is one space the place folks can actually see a kind of product that was not potential a number of years in the past. As soon as an organization deploys a RAG mannequin, different issues come to thoughts like multimodality: pictures, audio, video. Multimodality is the subsequent horizon.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1401\" target=\"_blank\" rel=\"noreferrer noopener\">23:21<\/a>: The place are we on multimodality within the enterprise?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1407\" target=\"_blank\" rel=\"noreferrer noopener\">23:27<\/a>: It\u2019s crucial, particularly if you&#8217;re taking a look at corporations that depend on PDFs. There\u2019s charts and pictures in there. Within the medical subject, there\u2019s a variety of pictures. We\u2019ve seen that embedding fashions can even assist pictures.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1442\" target=\"_blank\" rel=\"noreferrer noopener\">24:02<\/a>: Video and audio are at all times the orphans.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1447\" target=\"_blank\" rel=\"noreferrer noopener\">24:07<\/a>: Video is troublesome. Solely particular media corporations are main the cost. Audio, I\u2019m anticipating a lot of developments this yr. It hasn\u2019t caught as much as textual content, however I\u2019m anticipating a variety of audio merchandise to return to market.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1481\" target=\"_blank\" rel=\"noreferrer noopener\">24:41<\/a>: One of many earliest use instances was software program improvement and coding. Is that an space that you just people are working in?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1491\" target=\"_blank\" rel=\"noreferrer noopener\">24:51<\/a>: Sure, that&#8217;s my focus space. I believe so much about code-generation brokers.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1501\" target=\"_blank\" rel=\"noreferrer noopener\">25:01<\/a>: At this level, I might say that almost all builders are open to utilizing code-generation instruments. What\u2019s your sense of the extent of acceptance or resistance?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1526\" target=\"_blank\" rel=\"noreferrer noopener\">25:26<\/a>: I advocate for folks to check out the instruments and perceive the place they\u2019re sturdy and the place they\u2019re missing. I\u2019ve discovered the instruments very helpful, however it&#8217;s good to assert possession and perceive how LLMs advanced from being writers of capabilities (which is how analysis benchmarks had been written a yr in the past) to extra superior software program engineering, the place the mannequin wants to resolve bigger issues throughout a number of steps and levels. Fashions at the moment are evaluated on SWE-bench, the place the enter is a GitHub challenge. Go and resolve the GitHub challenge, and we\u2019ll consider it when the unit exams go.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1617\" target=\"_blank\" rel=\"noreferrer noopener\">26:57<\/a>: Claude Code is sort of good at this, however it can burn by means of a variety of tokens. Should you\u2019re working in an organization and it solves an issue, that\u2019s effective. However it may get costly. That\u2019s certainly one of my pet peeves\u2014however we\u2019re attending to the purpose the place I can solely write software program after I\u2019m related to the web. I\u2019m assuming that the smaller fashions are additionally enhancing and we\u2019ll be capable to work offline.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1665\" target=\"_blank\" rel=\"noreferrer noopener\">27:45<\/a>: 100%. I\u2019m actually enthusiastic about smaller fashions. They\u2019re catching up so shortly. What we might solely do with the larger fashions two years in the past, now you are able to do with a mannequin that\u2019s 2B or 4B parameters.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1697\" target=\"_blank\" rel=\"noreferrer noopener\">28:17<\/a>: One of many buzzwords is brokers. I assume most individuals are within the early phases\u2014they\u2019re doing easy, task-specific brokers, perhaps a number of brokers working in parallel. However I believe multi-agents aren\u2019t fairly there but. What are you seeing?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1731\" target=\"_blank\" rel=\"noreferrer noopener\">28:51<\/a>: Maturity remains to be evolving. We\u2019re nonetheless within the early days for LLMs as a complete. Persons are seeing that when you deploy them in the correct contexts, beneath the correct consumer expectations, they will resolve many issues. When in-built the correct context with entry to the correct instruments, they are often fairly helpful. However the finish consumer stays the ultimate skilled. The mannequin ought to present the consumer its work and its causes for saying one thing and its sources for the data, so the tip consumer turns into the ultimate arbiter.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1809\" target=\"_blank\" rel=\"noreferrer noopener\">30:09<\/a>: I inform nontech customers that you just\u2019re already utilizing brokers when you\u2019re utilizing certainly one of these deep analysis instruments.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1820\" target=\"_blank\" rel=\"noreferrer noopener\">30:20<\/a>: Superior RAG methods have grow to be brokers, and deep analysis is perhaps one of many extra mature methods. It\u2019s actually superior RAG that\u2019s actually deep.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1840\" target=\"_blank\" rel=\"noreferrer noopener\">30:40<\/a>: There are finance startups which might be constructing deep analysis instruments for analysts within the finance trade. They\u2019re primarily brokers as a result of they\u2019re specialised. Perhaps one agent goes for earnings. You possibly can think about an agent for information work.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1875\" target=\"_blank\" rel=\"noreferrer noopener\">31:15<\/a>: And that\u2019s the sample that&#8217;s perhaps the extra natural progress out of the one agent.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1889\" target=\"_blank\" rel=\"noreferrer noopener\">31:29<\/a>: And I do know builders who&#8217;ve a number of situations of Claude Code doing one thing that they may convey collectively.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1901\" target=\"_blank\" rel=\"noreferrer noopener\">31:41<\/a>: We\u2019re originally of discovering and exploring. We don\u2019t actually have the consumer interfaces and methods which have advanced sufficient to make the most effective out of this. For code, it began out within the IDE. A number of the earlier methods that I noticed used the command line, like Aider, which I assumed was the inspiration for Claude Code. It\u2019s undoubtedly a great way to enhance AI within the IDE.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1945\" target=\"_blank\" rel=\"noreferrer noopener\">32:25<\/a>: There\u2019s new generations of the terminal even: Warp and marimo, which might be incorporating many of those developments.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=1959\" target=\"_blank\" rel=\"noreferrer noopener\">32:39<\/a>: Code extends past what software program engineers are utilizing. The overall consumer requires some degree of code capability within the agent, even when they\u2019re not studying the code. Should you inform the mannequin to provide you a bar chart, the mannequin is writing Matplotlib code. These are brokers which have entry to a run atmosphere the place they will write the code to provide to the consumer, who\u2019s an analyst, not a software program engineer. Code is essentially the most attention-grabbing space of focus.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2013\" target=\"_blank\" rel=\"noreferrer noopener\">33:33<\/a>: In terms of brokers or RAG, it\u2019s a pipeline that begins from the supply paperwork to the data extraction technique\u2014it turns into a system that it&#8217;s a must to optimize finish to finish. When RAG got here out, it was only a bunch of weblog posts saying that we should always deal with chunking. However now folks notice that is an end-to-end system. Does this make it a way more formidable problem for an enterprise staff? Ought to they go along with a RAG supplier like Cohere or experiment themselves?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2080\" target=\"_blank\" rel=\"noreferrer noopener\">34:40<\/a>: It relies on the corporate and the capability they must throw at this. In an organization that wants a database, they will construct one from scratch, however perhaps that\u2019s not the most effective strategy. They will outsource or purchase it from a vendor.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2105\" target=\"_blank\" rel=\"noreferrer noopener\">35:05<\/a>: Every of these steps has 20 decisions, so there\u2019s a combinatorial explosion.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2116\" target=\"_blank\" rel=\"noreferrer noopener\">35:16<\/a>: Corporations are beneath stress to point out ROI shortly and notice the worth of their funding. That\u2019s an space the place utilizing a vendor that specializes is useful. There are a variety of choices: the correct search methods, the correct connectors, the workflows and the pipelines and the prompts. Question rewriting and rewriting. In our training content material, we describe all of these. However when you\u2019re going to construct a system like this, it can take a yr or two. Most corporations don\u2019t have that sort of time.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2177\" target=\"_blank\" rel=\"noreferrer noopener\">36:17<\/a>: Then you definitely notice you want different enterprise options like safety and entry management. In closing: Most corporations aren\u2019t going to coach their very own basis fashions. It\u2019s all about MCP, RAG, and posttraining. Do you assume corporations ought to have a primary AI platform that may permit them to do some posttraining?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2222\" target=\"_blank\" rel=\"noreferrer noopener\">37:02<\/a>: I don\u2019t assume it\u2019s crucial for many corporations. You possibly can go far with a state-of-the-art mannequin when you work together with it on the extent of immediate engineering and context administration. That may get you up to now. And also you profit from the rising tide of the fashions enhancing. You don\u2019t even want to vary your API. That rising tide will proceed to be useful and useful.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2259\" target=\"_blank\" rel=\"noreferrer noopener\">37:39<\/a>: Corporations which have that capability and functionality, and perhaps that\u2019s nearer to the core of what their product is, issues like effective tuning are issues the place they will distinguish themselves slightly bit, particularly in the event that they\u2019re tried issues like RAG and immediate engineering.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2292\" target=\"_blank\" rel=\"noreferrer noopener\">38:12<\/a>: The superadvanced corporations are even doing reinforcement fine-tuning.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2302\" target=\"_blank\" rel=\"noreferrer noopener\">38:22<\/a>: The current improvement in basis fashions are multimodalities and reasoning. What are you trying ahead to on the muse mannequin entrance that&#8217;s nonetheless beneath the radar?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2328\" target=\"_blank\" rel=\"noreferrer noopener\">38:48<\/a>: I\u2019m actually excited to see extra of those textual content diffusion fashions. Diffusion is a distinct sort of system the place you\u2019re not producing your output token by token. We\u2019ve seen it in picture and video era. The output at first is simply static noise. However then the mannequin generates one other picture, refining the output so it turns into increasingly more clear. For textual content, that takes one other format. Should you\u2019re emitting output token by token, you\u2019re already dedicated to the primary two or three phrases.\u00a0<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2397\" target=\"_blank\" rel=\"noreferrer noopener\">39:57<\/a>: With textual content diffusion fashions, you may have a normal thought you wish to categorical. You&#8217;ve gotten an try at expressing it. And one other try the place you modify all of the tokens, not one after the other. Their output velocity is completely unbelievable. It will increase the velocity, but additionally might pose new paradigms or behaviors.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2438\" target=\"_blank\" rel=\"noreferrer noopener\">40:38<\/a>: Can they purpose?<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2440\" target=\"_blank\" rel=\"noreferrer noopener\">40:40<\/a>: I haven\u2019t seen demos of them doing reasoning. However that\u2019s one space that may very well be promising.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2451\" target=\"_blank\" rel=\"noreferrer noopener\">40:51<\/a>: What ought to corporations take into consideration the smaller fashions? Most individuals on the patron facet are interacting with the big fashions. What\u2019s the final sense for the smaller fashions shifting ahead? My sense is that they may show ample for many enterprise duties.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2493\" target=\"_blank\" rel=\"noreferrer noopener\">41:33<\/a>: True. If the businesses have outlined the use instances they need and have discovered a smaller mannequin that may fulfill this, they will deploy or assign that job to a small mannequin. It will likely be smaller, quicker, decrease latency, and cheaper to deploy.<\/li>\n<li><a href=\"https:\/\/cdn.oreillystatic.com\/radar\/generative-ai-real-world-podcast\/GenAI_in_the_Real_World_with_Jay_Alammar.mp3#t=2522\" target=\"_blank\" rel=\"noreferrer noopener\">42:02<\/a>: The extra you determine the person duties, the extra you\u2019ll be capable to say {that a} small mannequin can do the duties reliably sufficient. I\u2019m very enthusiastic about small fashions. I\u2019m extra enthusiastic about small fashions which might be succesful than massive fashions.<\/li>\n<\/ul>\n<\/div>\n<iframe data-lazy=\"true\" data-src=\"https:\/\/www.fiverr.com\/gig_widgets?id=U2FsdGVkX18x7XQvttUTrv1oEqmGNGTgvvCUiUoJ\/AP4z\/UyMz8lXGOLpu15jIMxBbTR0gmD5uBoFvhC4KWeALQRp3h\/X\/AwcVD0K8Wj9H\/ZzYKzcCNHosB9oS4SCJJFWiN85P9ICAc4OgCoE\/wHKIY7CDkf2\/DQ1vqGvk4smVe5cRDEmrLPCWi4FC8p40VUhSmWQ5udCm0zoJtorgWv3vbDQw0kKYkwn39ozAnQXDe+YvWMxkLFWA+O3TFwkJvdkIK+\/AUSnRssPKt5WHY0FhNOxnSPcLslEL4G4\/RfP95ve99U+kRnDy3X+KtzdQLY+u935ghON\/o3UE4IMv9oN6JX9RnxzL\/LRcOgnHigxStSGPKsZYtnz8RWNVT\/rOLAibqiWJadC5MYHRbekF3eg6FOGrQGkXYbsn0+a5aovnlLCbLwIqY9fcS17UX8J235iQ6cdmHNbrPeS84CMm34RA==&affiliate_id=1052423&strip_google_tagmanager=true\" loading=\"lazy\" data-with-title=\"true\" class=\"fiverr_nga_frame\" frameborder=\"0\" height=\"350\" width=\"100%\" referrerpolicy=\"no-referrer-when-downgrade\" data-mode=\"random_gigs\" onload=\" var frame = this; var script = document.createElement('script'); script.addEventListener('load', function() { window.FW_SDK.register(frame); }); script.setAttribute('src', 'https:\/\/www.fiverr.com\/gig_widgets\/sdk'); document.body.appendChild(script); \" ><\/iframe>\n<br \/><a href=\"https:\/\/www.oreilly.com\/radar\/podcast\/generative-ai-in-the-real-world-jay-alammar-on-building-ai-for-the-enterprise\/\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Generative AI within the Actual World Generative AI within the Actual World: Jay Alammar on Constructing AI for the Enterprise Play Episode Pause Episode Mute\/Unmute&#8230;<\/p>\n","protected":false},"author":1,"featured_media":88939,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-88938","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-universe"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly - mailinvest.blog<\/title>\n<meta name=\"description\" content=\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly - mailinvest.blog\" \/>\n<meta property=\"og:description\" content=\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/\" \/>\n<meta property=\"og:site_name\" content=\"mailinvest.blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/freelanceracademic\/\" \/>\n<meta property=\"article:published_time\" content=\"2025-08-08T02:43:40+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-08-08T02:44:47+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/08\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1600\" \/>\n\t<meta property=\"og:image:height\" content=\"1600\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"admin@mailinvest.blog\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin@mailinvest.blog\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"17 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/\"},\"author\":{\"name\":\"admin@mailinvest.blog\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/person\\\/012701c4c204d4e4ebd34f926cfd31a4\"},\"headline\":\"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly\",\"datePublished\":\"2025-08-08T02:43:40+00:00\",\"dateModified\":\"2025-08-08T02:44:47+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/\"},\"wordCount\":3511,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png\",\"articleSection\":[\"Tech Universe\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/\",\"name\":\"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly - mailinvest.blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png\",\"datePublished\":\"2025-08-08T02:43:40+00:00\",\"dateModified\":\"2025-08-08T02:44:47+00:00\",\"description\":\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png\",\"contentUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/08\\\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png\",\"width\":1600,\"height\":1600},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/08\\\/08\\\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mailinvest.blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#website\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/\",\"name\":\"mailinvest.blog\",\"description\":\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis. mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\",\"publisher\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mailinvest.blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#organization\",\"name\":\"mailinvest\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/default.png\",\"contentUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/default.png\",\"width\":1000,\"height\":1000,\"caption\":\"mailinvest\"},\"image\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/freelanceracademic\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/person\\\/012701c4c204d4e4ebd34f926cfd31a4\",\"name\":\"admin@mailinvest.blog\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g\",\"caption\":\"admin@mailinvest.blog\"},\"sameAs\":[\"https:\\\/\\\/mailinvest.blog\",\"admin@mailinvest.blog\"],\"url\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/author\\\/adminmailinvest-blog\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly - mailinvest.blog","description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/","og_locale":"en_US","og_type":"article","og_title":"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly - mailinvest.blog","og_description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","og_url":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/","og_site_name":"mailinvest.blog","article_publisher":"https:\/\/www.facebook.com\/freelanceracademic\/","article_published_time":"2025-08-08T02:43:40+00:00","article_modified_time":"2025-08-08T02:44:47+00:00","og_image":[{"width":1600,"height":1600,"url":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/08\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png","type":"image\/png"}],"author":"admin@mailinvest.blog","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin@mailinvest.blog","Est. reading time":"17 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/#article","isPartOf":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/"},"author":{"name":"admin@mailinvest.blog","@id":"https:\/\/mailinvest.blog\/#\/schema\/person\/012701c4c204d4e4ebd34f926cfd31a4"},"headline":"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly","datePublished":"2025-08-08T02:43:40+00:00","dateModified":"2025-08-08T02:44:47+00:00","mainEntityOfPage":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/"},"wordCount":3511,"commentCount":0,"publisher":{"@id":"https:\/\/mailinvest.blog\/#organization"},"image":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/#primaryimage"},"thumbnailUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/08\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png","articleSection":["Tech Universe"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/","url":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/","name":"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly - mailinvest.blog","isPartOf":{"@id":"https:\/\/mailinvest.blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/#primaryimage"},"image":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/#primaryimage"},"thumbnailUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/08\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png","datePublished":"2025-08-08T02:43:40+00:00","dateModified":"2025-08-08T02:44:47+00:00","description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","breadcrumb":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/#primaryimage","url":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/08\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png","contentUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/08\/Podcast_Cover_GenAI_in_the_Real_World-1600x1600.png","width":1600,"height":1600},{"@type":"BreadcrumbList","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/08\/08\/jay-alammar-on-building-ai-for-the-enterprise-oreilly\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mailinvest.blog\/"},{"@type":"ListItem","position":2,"name":"Jay Alammar on Building AI for the Enterprise \u2013 O\u2019Reilly"}]},{"@type":"WebSite","@id":"https:\/\/mailinvest.blog\/#website","url":"https:\/\/mailinvest.blog\/","name":"mailinvest.blog","description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis. mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","publisher":{"@id":"https:\/\/mailinvest.blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mailinvest.blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/mailinvest.blog\/#organization","name":"mailinvest","url":"https:\/\/mailinvest.blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mailinvest.blog\/#\/schema\/logo\/image\/","url":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2022\/01\/default.png","contentUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2022\/01\/default.png","width":1000,"height":1000,"caption":"mailinvest"},"image":{"@id":"https:\/\/mailinvest.blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/freelanceracademic\/"]},{"@type":"Person","@id":"https:\/\/mailinvest.blog\/#\/schema\/person\/012701c4c204d4e4ebd34f926cfd31a4","name":"admin@mailinvest.blog","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g","caption":"admin@mailinvest.blog"},"sameAs":["https:\/\/mailinvest.blog","admin@mailinvest.blog"],"url":"https:\/\/mailinvest.blog\/index.php\/author\/adminmailinvest-blog\/"}]}},"_links":{"self":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts\/88938","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/comments?post=88938"}],"version-history":[{"count":1,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts\/88938\/revisions"}],"predecessor-version":[{"id":88940,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts\/88938\/revisions\/88940"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/media\/88939"}],"wp:attachment":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/media?parent=88938"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/categories?post=88938"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/tags?post=88938"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}