{"id":103471,"date":"2025-11-23T22:35:24","date_gmt":"2025-11-23T22:35:24","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/"},"modified":"2025-11-23T22:37:25","modified_gmt":"2025-11-23T22:37:25","slug":"new-web-standards-could-redefine-how-ai-models-use-your-content","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/","title":{"rendered":"New web standards could redefine how AI models use your content"},"content":{"rendered":"<p> <a href=\"https:\/\/go.fiverr.com\/visit\/?bta=1052423&nci=17043\" Target=\"_Top\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/fiverr.ck-cdn.com\/tn\/serve\/?cid=40081059\"  width=\"601\" height=\"201\"><\/a>\n<\/p>\n<div id=\"articleContent\" itemprop=\"articlebody\">\n<div class=\"bialty-container\">\n<p>Lately, the open internet has felt just like the Wild West. Creators have seen their work scraped, processed, and fed into massive language fashions \u2013\u00a0principally with out their consent.<\/p>\n<p>It grew to become a knowledge free-for-all, with virtually no method for website house owners to choose out or defend their work.<\/p>\n<p>There have been efforts, like<a href=\"https:\/\/llmstxt.org\/\" target=\"_blank\" rel=\"noopener\"> llms.txt initiative from Jeremy Howard.<\/a> Like robots.txt, which lets website house owners enable or block website crawlers, llms.txt gives guidelines that do the identical for AI corporations\u2019 crawling bots.<\/p>\n<p>However there\u2019s no clear proof that <a href=\"https:\/\/searchengineland.com\/no-llms-txt-is-not-the-new-meta-keywords-458199\">AI companies follow llms.txt<\/a> or honor its guidelines. Plus, <a href=\"https:\/\/searchengineland.com\/google-says-normal-seo-works-for-ranking-in-ai-overviews-and-llms-txt-wont-be-used-459422\">Google explicitly said it doesn\u2019t support llms.txt<\/a>.<\/p>\n<p>Nevertheless, a brand new protocol is now rising to offer website house owners management over how AI corporations use their content material. It could develop into a part of robots.txt, permitting house owners to set clear guidelines for the way AI methods can entry and use their websites.<\/p>\n<h2 id=\"ietf-ai-preferences-working-group\" class=\"wp-block-heading\">IETF AI Preferences Working Group<\/h2>\n<p>To deal with this, the Web Engineering Job Pressure (IETF) <a href=\"https:\/\/www.ietf.org\/blog\/ai-pref-progress\/\" target=\"_blank\" rel=\"noopener\">launched<\/a> the AI Preferences Working Group in January. The group is creating standardized, machine-readable guidelines that allow website house owners spell out how (or if) AI methods can use their content material.<\/p>\n<p>Since its founding in 1986, the IETF has outlined the core protocols that energy the Web, together with TCP\/IP, HTTP, DNS, and TLS.<\/p>\n<p>Now they\u2019re creating requirements for the AI period of the open internet. The AI Preferences Working Group is co-chaired by Mark Nottingham and Suresh Krishnan, together with leaders from Google, Microsoft, Meta, and others.<\/p>\n<p>Notably, Google\u2019s Gary Illyes can be a part of the working group.<\/p>\n<p>The <a href=\"https:\/\/datatracker.ietf.org\/wg\/aipref\/about\/\" target=\"_blank\" rel=\"noopener\">goal<\/a> of this group:<\/p>\n<ul class=\"wp-block-list\">\n<li>\u201cThe AI Preferences Working Group will standardize constructing blocks that enable for the expression of preferences about how content material is collected and processed for Synthetic Intelligence (AI) mannequin improvement, deployment, and use.\u201d\u00a0<\/li>\n<\/ul>\n<h2 id=\"what-the-ai-preferences-group-is-proposing\" class=\"wp-block-heading\">What the AI Preferences Group is proposing<\/h2>\n<p><a href=\"https:\/\/datatracker.ietf.org\/doc\/charter-ietf-aipref\/\">This working group will deliver<\/a> new requirements that give website house owners management over how LLM-powered methods use their content material on the open internet.<\/p>\n<ul class=\"wp-block-list\">\n<li>A typical observe doc masking vocabulary for expressing AI-related preferences, impartial of how these preferences are related to content material.<\/li>\n<li>Customary observe doc(s) describing technique of attaching or associating these preferences with content material in IETF-defined protocols and codecs, together with however not restricted to utilizing Properly-Recognized URIs (<a href=\"https:\/\/datatracker.ietf.org\/doc\/rfc8615\/\">RFC 8615<\/a>) such because the Robots Exclusion Protocol (<a href=\"https:\/\/datatracker.ietf.org\/doc\/rfc9309\/\">RFC 9309<\/a>), and HTTP response header fields.<\/li>\n<li>A typical methodology for reconciling a number of expressions of preferences.<\/li>\n<\/ul>\n<p><strong>As of this writing, nothing from the group is remaining but.<\/strong> However they&#8217;ve revealed early paperwork that provide a glimpse into what the requirements would possibly appear to be.<\/p>\n<p>Two essential paperwork had been revealed by this working group in August.<\/p>\n<p>Collectively, these paperwork suggest updates to the present <a href=\"https:\/\/datatracker.ietf.org\/doc\/html\/rfc9309\">Robots Exclusion Protocol (RFC 9309)<\/a>, including new guidelines and definitions that allow website house owners spell out how they need AI methods to make use of their content material on the internet.<\/p>\n<h2 id=\"how-it-might-work\" class=\"wp-block-heading\">The way it would possibly work<\/h2>\n<p>Totally different AI methods on the internet are categorized and given normal labels. It\u2019s nonetheless unclear whether or not there can be a listing the place website house owners can search for how every system is labeled.<\/p>\n<p>These are the labels outlined thus far:<\/p>\n<ul class=\"wp-block-list\">\n<li><strong>search:<\/strong> for indexing\/discoverability<\/li>\n<li><strong>train-ai:<\/strong> for normal AI coaching<\/li>\n<li><strong>train-genai:<\/strong> for generative AI mannequin coaching<\/li>\n<li><strong>bots:<\/strong> for all types of automated processing (together with crawling\/scraping)<\/li>\n<\/ul>\n<p>For every of those labels, two values could be set:<\/p>\n<ul class=\"wp-block-list\">\n<li>\u00a0y to permit <\/li>\n<li> n to disallow.\u00a0<\/li>\n<\/ul>\n<figure class=\"wp-block-image size-full\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1290\" height=\"1028\" alt=\"Relationship Between Categories Of Use\" class=\"wp-image-464992\" data-srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2025\/11\/relationship-between-categories-of-use.png 1290w, https:\/\/searchengineland.com\/wp-content\/seloads\/2025\/11\/relationship-between-categories-of-use-768x612.png 768w\" data-lazy-data-sizes=\"(max-width: 1290px) 100vw, 1290px\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2025\/11\/relationship-between-categories-of-use.png\"\/><img fetchpriority=\"high\" decoding=\"async\" width=\"1290\" height=\"1028\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2025\/11\/relationship-between-categories-of-use.png\" alt=\"Relationship Between Categories Of Use\" class=\"wp-image-464992\" data-srcset=\"https:\/\/searchengineland.com\/wp-content\/seloads\/2025\/11\/relationship-between-categories-of-use.png 1290w, https:\/\/searchengineland.com\/wp-content\/seloads\/2025\/11\/relationship-between-categories-of-use-768x612.png 768w\" data-sizes=\"(max-width: 1290px) 100vw, 1290px\"\/><\/figure>\n<p>The paperwork additionally notice that these guidelines could be set on the folder degree and customised for various bots. In robots.txt, they\u2019re utilized by a brand new Content material-Utilization subject, much like how the Enable and Disallow fields work right now.<\/p>\n<p>Right here is an instance robots.txt that the working group <a href=\"https:\/\/datatracker.ietf.org\/doc\/draft-ietf-aipref-attach\/#:~:text=Figure%202%20shows%20a%20simple%20%22robots.txt%22%20document\">included in the document<\/a>:<\/p>\n<p>Consumer-Agent: *<br \/>Enable: \/<br \/>Disallow: \/by no means\/<br \/>Content material-Utilization: train-ai=n<br \/>Content material-Utilization: \/ai-ok\/ train-ai=y<\/p>\n<p>Rationalization<br \/>Content material-Utilization: train-ai=n means all of the content material on this area isn\u2019t allowed for coaching any LLM mannequin whereas Content material-Utilization: \/ai-ok\/ train-ai=y particularly signifies that coaching the fashions utilizing content material of subfolder \/ai-ok\/ is alright.<\/p>\n<h2 id=\"why-does-this-matter\" class=\"wp-block-heading\">Why does this matter?<\/h2>\n<p>There\u2019s been a variety of <a href=\"https:\/\/searchengineland.com\/llms-txt-isnt-robots-txt-its-a-treasure-map-for-ai-456586\">buzz<\/a> within the search engine marketing world about <a href=\"https:\/\/searchengineland.com\/llms-txt-proposed-standard-453676\">llms.txt<\/a> and why website house owners ought to use it alongside robots.txt, however no AI firm has confirmed that their crawlers truly observe its guidelines. And we all know Google doesn\u2019t use llms.txt.<\/p>\n<p>Nonetheless, website house owners need clearer management over how AI corporations use their content material \u2013\u00a0whether or not for coaching fashions or powering RAG-based solutions.<\/p>\n<p>IETF\u2019s work on these new requirements looks like a step in the fitting route. And with Illyes concerned as an writer, I\u2019m hopeful that after the requirements are finalized, Google and different tech corporations will undertake them and respect the brand new robots.txt guidelines when scraping content material.<\/p>\n<\/div>\n<hr\/>\n<p class=\"article-disclosure\">\n            <em>Contributing authors are invited to create content material for Search Engine Land and are chosen for his or her experience and contribution to the search neighborhood. Our contributors work underneath the oversight of the <a href=\"https:\/\/searchengineland.com\/staff\/\">editorial staff<\/a> and contributions are checked for high quality and relevance to our readers. Search Engine Land is owned by <a href=\"https:\/\/www.semrush.com\/\" rel=\"nofollow\" target=\"_blank\">Semrush<\/a>. Contributor was not requested to make any direct or oblique mentions of <a href=\"https:\/\/www.semrush.com\/\" rel=\"nofollow\" target=\"_blank\">Semrush<\/a>. The opinions they categorical are their very own.<\/em>\n        <\/p>\n<hr\/>\n<div class=\"author-about py-4\">\n<div class=\"card bg-light\">\n<div class=\"row gx-0\">\n<div class=\"col-12 col-lg-auto\">\n<div class=\"authorImage p-2\">\n\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded avatar-border\" alt=\"Gagan Ghotra\" width=\"140\" height=\"140\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/searchengineland.com\/gagan-ghotra\"\/><img loading=\"lazy\" decoding=\"async\" class=\"img-fluid rounded avatar-border\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/searchengineland.com\/gagan-ghotra\" alt=\"Gagan Ghotra\" width=\"140\" height=\"140\"\/>\t\t\t\t<\/div>\n<\/p><\/div>\n<div class=\"col-12 col-lg\">\n<div class=\"card-body author-body p-2\">\n<div id=\"authorBio-26365\" class=\"author-desc\">\n<p class=\"p1\" style=\"margin: 0px;font-size: 14.7px;line-height: normal;font-family: Arial\"><span class=\"s1\">Gagan Ghotra is an search engine marketing Guide and Google Uncover optimisation specialist based mostly in Melbourne, Australia.<\/span><\/p>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n<p>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<!-- START SIDEBAR LOWER SPACE --><\/p>\n<p><!-- END SIDEBAR LOWER SPACE --><\/p><\/div>\n<iframe data-lazy=\"true\" data-src=\"https:\/\/www.fiverr.com\/gig_widgets?id=U2FsdGVkX18x7XQvttUTrv1oEqmGNGTgvvCUiUoJ\/AP4z\/UyMz8lXGOLpu15jIMxBbTR0gmD5uBoFvhC4KWeALQRp3h\/X\/AwcVD0K8Wj9H\/ZzYKzcCNHosB9oS4SCJJFWiN85P9ICAc4OgCoE\/wHKIY7CDkf2\/DQ1vqGvk4smVe5cRDEmrLPCWi4FC8p40VUhSmWQ5udCm0zoJtorgWv3vbDQw0kKYkwn39ozAnQXDe+YvWMxkLFWA+O3TFwkJvdkIK+\/AUSnRssPKt5WHY0FhNOxnSPcLslEL4G4\/RfP95ve99U+kRnDy3X+KtzdQLY+u935ghON\/o3UE4IMv9oN6JX9RnxzL\/LRcOgnHigxStSGPKsZYtnz8RWNVT\/rOLAibqiWJadC5MYHRbekF3eg6FOGrQGkXYbsn0+a5aovnlLCbLwIqY9fcS17UX8J235iQ6cdmHNbrPeS84CMm34RA==&affiliate_id=1052423&strip_google_tagmanager=true\" loading=\"lazy\" data-with-title=\"true\" class=\"fiverr_nga_frame\" frameborder=\"0\" height=\"350\" width=\"100%\" referrerpolicy=\"no-referrer-when-downgrade\" data-mode=\"random_gigs\" onload=\" var frame = this; var script = document.createElement('script'); script.addEventListener('load', function() { window.FW_SDK.register(frame); }); script.setAttribute('src', 'https:\/\/www.fiverr.com\/gig_widgets\/sdk'); document.body.appendChild(script); \" ><\/iframe>\n<br \/><a href=\"https:\/\/searchengineland.com\/robots-exclusions-new-rules-definitions-ietf-464990\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Lately, the open internet has felt just like the Wild West. Creators have seen their work scraped, processed, and fed into massive language fashions \u2013\u00a0principally&#8230;<\/p>\n","protected":false},"author":1,"featured_media":103472,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[1205],"class_list":["post-103471","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-universe","tag-news"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>New web standards could redefine how AI models use your content - mailinvest.blog<\/title>\n<meta name=\"description\" content=\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"New web standards could redefine how AI models use your content - mailinvest.blog\" \/>\n<meta property=\"og:description\" content=\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/\" \/>\n<meta property=\"og:site_name\" content=\"mailinvest.blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/freelanceracademic\/\" \/>\n<meta property=\"article:published_time\" content=\"2025-11-23T22:35:24+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-11-23T22:37:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/11\/ai-content-crawlers-1920-1024x576.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"576\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"admin@mailinvest.blog\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin@mailinvest.blog\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/\"},\"author\":{\"name\":\"admin@mailinvest.blog\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/person\\\/012701c4c204d4e4ebd34f926cfd31a4\"},\"headline\":\"New web standards could redefine how AI models use your content\",\"datePublished\":\"2025-11-23T22:35:24+00:00\",\"dateModified\":\"2025-11-23T22:37:25+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/\"},\"wordCount\":951,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/11\\\/ai-content-crawlers-1920.png\",\"keywords\":[\"news\"],\"articleSection\":[\"Tech Universe\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/\",\"name\":\"New web standards could redefine how AI models use your content - mailinvest.blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/11\\\/ai-content-crawlers-1920.png\",\"datePublished\":\"2025-11-23T22:35:24+00:00\",\"dateModified\":\"2025-11-23T22:37:25+00:00\",\"description\":\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/11\\\/ai-content-crawlers-1920.png\",\"contentUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/11\\\/ai-content-crawlers-1920.png\",\"width\":1920,\"height\":1080},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/11\\\/23\\\/new-web-standards-could-redefine-how-ai-models-use-your-content\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mailinvest.blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"New web standards could redefine how AI models use your content\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#website\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/\",\"name\":\"mailinvest.blog\",\"description\":\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis. mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\",\"publisher\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mailinvest.blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#organization\",\"name\":\"mailinvest\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/default.png\",\"contentUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/default.png\",\"width\":1000,\"height\":1000,\"caption\":\"mailinvest\"},\"image\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/freelanceracademic\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/person\\\/012701c4c204d4e4ebd34f926cfd31a4\",\"name\":\"admin@mailinvest.blog\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g\",\"caption\":\"admin@mailinvest.blog\"},\"sameAs\":[\"https:\\\/\\\/mailinvest.blog\",\"admin@mailinvest.blog\"],\"url\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/author\\\/adminmailinvest-blog\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"New web standards could redefine how AI models use your content - mailinvest.blog","description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/","og_locale":"en_US","og_type":"article","og_title":"New web standards could redefine how AI models use your content - mailinvest.blog","og_description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","og_url":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/","og_site_name":"mailinvest.blog","article_publisher":"https:\/\/www.facebook.com\/freelanceracademic\/","article_published_time":"2025-11-23T22:35:24+00:00","article_modified_time":"2025-11-23T22:37:25+00:00","og_image":[{"width":1024,"height":576,"url":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/11\/ai-content-crawlers-1920-1024x576.png","type":"image\/png"}],"author":"admin@mailinvest.blog","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin@mailinvest.blog","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/#article","isPartOf":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/"},"author":{"name":"admin@mailinvest.blog","@id":"https:\/\/mailinvest.blog\/#\/schema\/person\/012701c4c204d4e4ebd34f926cfd31a4"},"headline":"New web standards could redefine how AI models use your content","datePublished":"2025-11-23T22:35:24+00:00","dateModified":"2025-11-23T22:37:25+00:00","mainEntityOfPage":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/"},"wordCount":951,"commentCount":0,"publisher":{"@id":"https:\/\/mailinvest.blog\/#organization"},"image":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/#primaryimage"},"thumbnailUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/11\/ai-content-crawlers-1920.png","keywords":["news"],"articleSection":["Tech Universe"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/","url":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/","name":"New web standards could redefine how AI models use your content - mailinvest.blog","isPartOf":{"@id":"https:\/\/mailinvest.blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/#primaryimage"},"image":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/#primaryimage"},"thumbnailUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/11\/ai-content-crawlers-1920.png","datePublished":"2025-11-23T22:35:24+00:00","dateModified":"2025-11-23T22:37:25+00:00","description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","breadcrumb":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/#primaryimage","url":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/11\/ai-content-crawlers-1920.png","contentUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/11\/ai-content-crawlers-1920.png","width":1920,"height":1080},{"@type":"BreadcrumbList","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/11\/23\/new-web-standards-could-redefine-how-ai-models-use-your-content\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mailinvest.blog\/"},{"@type":"ListItem","position":2,"name":"New web standards could redefine how AI models use your content"}]},{"@type":"WebSite","@id":"https:\/\/mailinvest.blog\/#website","url":"https:\/\/mailinvest.blog\/","name":"mailinvest.blog","description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis. mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","publisher":{"@id":"https:\/\/mailinvest.blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mailinvest.blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/mailinvest.blog\/#organization","name":"mailinvest","url":"https:\/\/mailinvest.blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mailinvest.blog\/#\/schema\/logo\/image\/","url":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2022\/01\/default.png","contentUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2022\/01\/default.png","width":1000,"height":1000,"caption":"mailinvest"},"image":{"@id":"https:\/\/mailinvest.blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/freelanceracademic\/"]},{"@type":"Person","@id":"https:\/\/mailinvest.blog\/#\/schema\/person\/012701c4c204d4e4ebd34f926cfd31a4","name":"admin@mailinvest.blog","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g","caption":"admin@mailinvest.blog"},"sameAs":["https:\/\/mailinvest.blog","admin@mailinvest.blog"],"url":"https:\/\/mailinvest.blog\/index.php\/author\/adminmailinvest-blog\/"}]}},"_links":{"self":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts\/103471","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/comments?post=103471"}],"version-history":[{"count":1,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts\/103471\/revisions"}],"predecessor-version":[{"id":103473,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts\/103471\/revisions\/103473"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/media\/103472"}],"wp:attachment":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/media?parent=103471"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/categories?post=103471"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/tags?post=103471"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}