<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Wired to the Radio]]></title><description><![CDATA[Occasional musings on internet things]]></description><link>https://notes.nickgerard.com</link><image><url>https://notes.nickgerard.com/img/substack.png</url><title>Wired to the Radio</title><link>https://notes.nickgerard.com</link></image><generator>Substack</generator><lastBuildDate>Wed, 03 Jun 2026 11:27:19 GMT</lastBuildDate><atom:link href="https://notes.nickgerard.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Broadway Journal]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[nickgerard@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[nickgerard@substack.com]]></itunes:email><itunes:name><![CDATA[Nick Gerard]]></itunes:name></itunes:owner><itunes:author><![CDATA[Nick Gerard]]></itunes:author><googleplay:owner><![CDATA[nickgerard@substack.com]]></googleplay:owner><googleplay:email><![CDATA[nickgerard@substack.com]]></googleplay:email><googleplay:author><![CDATA[Nick Gerard]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[On moats, models, and AI madness]]></title><description><![CDATA[Or, how I learned to stop worrying and love starting over.]]></description><link>https://notes.nickgerard.com/p/on-moats-models-and-ai-madness</link><guid isPermaLink="false">https://notes.nickgerard.com/p/on-moats-models-and-ai-madness</guid><dc:creator><![CDATA[Nick Gerard]]></dc:creator><pubDate>Thu, 16 Apr 2026 18:34:28 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!PMt1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>For the last twenty years, software companies have enjoyed the most favorable economics of any businesses ever built. You wrote the code once and sold it forever to an ever-growing base of customers who couldn&#8217;t easily leave. Every once in a while you fixed some bugs, but you mostly just let the money printing machine keep doing its thing.</p><p>The model rested on a few key structural advantages, each of which AI is now demolishing. The danger to software companies isn&#8217;t (just) that demand disappears because everyone vibe codes their own to-do list app; it&#8217;s that the economics of <em>every part</em> of a vertical software business are suddenly dramatically worse, all at once.</p><p>Customer acquisition is more expensive because you have more competitors and they&#8217;re all trying to reach the same people you are. Serving each customer is more expensive because your dashboard suddenly needs to &#8220;do AI stuff&#8221; and doing AI stuff costs actual money. And customers stick around for less time because changing tools is as easy as asking Claude to move everything over to a new system. Or make a new system. Or ten new systems and a Systems System to keep track of them all.</p><p>The era of near-perfect gross margins is over and the revenue multiples that made software the envy of every other industry are compressing toward something that looks a lot more like a normal business.</p><p>That isn&#8217;t to say software businesses are going away. In fact, there are going to be way, way more of them, and in a lot of ways that&#8217;s an amazing and good thing. We&#8217;re on the verge of unleashing the full creative potential of everyone who ever had an idea but not the technical skills to realize it.</p><p>But if you&#8217;re trying to build a <em>business</em> selling software &#8212; well:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!PMt1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!PMt1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic 424w, https://substackcdn.com/image/fetch/$s_!PMt1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic 848w, https://substackcdn.com/image/fetch/$s_!PMt1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic 1272w, https://substackcdn.com/image/fetch/$s_!PMt1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!PMt1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic" width="620" height="352" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:352,&quot;width&quot;:620,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:26406,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/heic&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://notes.nickgerard.com/i/194299063?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!PMt1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic 424w, https://substackcdn.com/image/fetch/$s_!PMt1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic 848w, https://substackcdn.com/image/fetch/$s_!PMt1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic 1272w, https://substackcdn.com/image/fetch/$s_!PMt1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba8f8974-7781-4fe3-9a60-412cf3478c97_620x352.heic 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Somehow, in the year of our lord 2026, a lot of people in the tech industry haven&#8217;t fully processed that yet.</p><p></p><h2>You&#8217;re Gonna Need a Bigger Moat</h2><p>For a generation, the scarcity of high-quality engineering talent turned competent software development into a competitive advantage. Yes, you could theoretically outsource development to an expensive shop in SF or NY or a cheap one overseas, but companies that relied on software to acquire and serve customers and didn&#8217;t make building it a core competency usually found the results just weren&#8217;t very good.</p><p>Good software was severely supply constrained; there were virtually unlimited applications of it and very few people who could build it well. So the whole game was convincing more college kids to drop out and join your team than the next startup down the street. And there were only so many of them to go around, so everyone lost their minds and for a few strange years you had Facebook interns being paid more for a summer of writing unit tests than their parents made in a year.</p><p>Now, anyone can ship a credible product and the best builders can ship ten of them. The flood of new supply isn&#8217;t creating or destroying anybody&#8217;s moat &#8212; but a lot of celebrated software businesses are quickly discovering that their only real edge was being early and well-staffed, not being structurally hard to displace.</p><p>A simple heuristic if you&#8217;re a software company trying to figure out if you&#8217;re screwed: could Microsoft copy your product and make it 20&#8211;50% worse but give it away for free and kill your dreams of an IPO? That&#8217;s what they did with Microsoft Teams, which kneecapped Slack&#8217;s growth, leading them to sell, and allowing Microsoft to walk away with the entire enterprise market. Because Slack, at the end of the day, is a chat app.</p><p>Even the big tech companies only have so much time and so many engineers and thus can only one shot so many businesses at once (sad for them). But if they theoretically <em>could</em> do the same to your (very nice, I&#8217;m sure) CRM/task tracker/page builder/dashboard/tooling startup, then a teenager with a mouthful of Zyn and a Claude Max account can now too.</p><p>Good luck competing with them. They&#8217;re chronically online, on their parents&#8217; healthcare, and happy to give a mediocre clone of your product away for free in exchange for a few internet points.</p><p></p><h2>Everything Is Easier and Harder at the Same Time</h2><p>Building a technology company has always meant solving two problems at once: the domain problem and the software problem. The domain problem is the actual pain you&#8217;re trying to solve in the market. It&#8217;s the thing your founder expounds on in the mission section of your company handbook. It&#8217;s what you tell people about when they ask how you&#8217;re making the world a better place.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xqLZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xqLZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif 424w, https://substackcdn.com/image/fetch/$s_!xqLZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif 848w, https://substackcdn.com/image/fetch/$s_!xqLZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif 1272w, https://substackcdn.com/image/fetch/$s_!xqLZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xqLZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif" width="500" height="281" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:281,&quot;width&quot;:500,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1602246,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/gif&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://notes.nickgerard.com/i/194299063?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xqLZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif 424w, https://substackcdn.com/image/fetch/$s_!xqLZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif 848w, https://substackcdn.com/image/fetch/$s_!xqLZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif 1272w, https://substackcdn.com/image/fetch/$s_!xqLZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6090f12-ab8a-45cf-8e5b-502577a5a490_500x281.gif 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The software problem is the literal challenge of writing down millions of the right words in the right order such that 1s and 0s can flow through a massively interconnected global information network to make an actual, useful thing happen in the real world. And until recently, the software problem was often the one companies spent more time and resources on, mission statement notwithstanding, because it was the harder problem.</p><p>No longer. Over the last year, the software problem has been (mostly) solved for (nearly) all companies at (basically) the same time, thanks to AI.</p><p>For everyone with an entrepreneurial bent who&#8217;s <em>not</em> a software engineer or SaaS startup founder, this is amazing news. That idea you had because you have unique insight in the industry you&#8217;ve worked in for ten years but had no idea how to build a software business around? Congratulations, the door to founderhood just swung wide open to you. If you build infrastructure or hardware or marketplaces you can suddenly pour all of your resources into your domain problem. If you are an artist or creator with an audience you can suddenly build a much larger, more profitable and category-spanning business.</p><p>But if your company is pure application software, there&#8217;s no &#8220;other thing&#8221; to retreat to. The code was the product, and now the code is the easy part. Without something harder underneath &#8212; a physical system, a regulatory maze, a network that compounds &#8212; you&#8217;re left competing in a market with roughly everyone on the planet who has access to a computer.</p><p></p><h2>What Survives</h2><p>In a world where code is no longer a scarce resource, there are really only a few things for a software company to do:</p><p><strong>Lean into network effects. </strong>Products that get better as more people use them have a defense that doesn&#8217;t depend on code at all. Meta Ads has the product discipline of the DMV online portal and still prints money because, well, where else are you gonna buy ads?</p><p><strong>Become a heat shield. </strong>Some businesses exist so their customers don&#8217;t have to deal with the worst parts of operating in a regulated, high-stakes, or bureaucratically insane environment. The customer isn&#8217;t buying software &#8212; they&#8217;re buying the outcome of not having to think about it. There are at least two flavors of this:</p><ul><li><p><strong>Risk arbitrage:</strong> you take on actual liability &#8212; compliance exposure, financial risk, regulatory burden &#8212; so the customer doesn&#8217;t carry it.</p></li><li><p><strong>Complexity absorber:</strong> you navigate or abstract away a labyrinthine real-world system on your customer&#8217;s behalf so they can focus on what they&#8217;re actually good at. No startup founder has ever woken up excited to understand PCI compliance, and thanks to Stripe they don&#8217;t have to.</p></li></ul><p>Healthcare, finance, security, infrastructure &#8212; these categories have a future precisely because the hard part was never writing the application. You can&#8217;t vibe code FDA regulatory compliance any more than you can vibe code Stripe, because the product isn&#8217;t the code &#8212; it&#8217;s shielding you from the byzantine system on the other side of it.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!5tde!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!5tde!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png 424w, https://substackcdn.com/image/fetch/$s_!5tde!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png 848w, https://substackcdn.com/image/fetch/$s_!5tde!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png 1272w, https://substackcdn.com/image/fetch/$s_!5tde!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!5tde!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png" width="1456" height="1183" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1183,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2831103,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://notes.nickgerard.com/i/194299063?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!5tde!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png 424w, https://substackcdn.com/image/fetch/$s_!5tde!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png 848w, https://substackcdn.com/image/fetch/$s_!5tde!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png 1272w, https://substackcdn.com/image/fetch/$s_!5tde!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1749353a-af70-4203-8121-26cb1d147c2c_1952x1586.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>At the same time, entirely new models for software-enabled companies are suddenly possible. Among them:</p><ul><li><p><strong>Go bigger. </strong>Well-capitalized software companies can chase larger markets and bigger contracts by accepting messier operations, thicker cost structures, and thinner margins. Adding services builds trust and creates dependencies that are harder to dislodge than product alone. It&#8217;s less scalable but much more defensible in a world where code is ~free.</p></li><li><p><strong>Go smaller. </strong>Tiny AI-native teams can run shockingly profitable operations that even become venture-scale outcomes. These teams start with direct client relationships and build product to transform their margins. They begin operating at ~services economics but with rapid experimentation and automation they can systematically bend the P&amp;L toward software economics.</p></li></ul><p>Put another way, you&#8217;re going to see software companies start to look more like services companies, and you&#8217;re going to see services companies start to look more like software companies.</p><p>In 2012, Ted Sarandos, the CEO of Netflix, famously said his goal was to &#8220;become HBO faster than HBO can become us.&#8221; The question now for software companies and service providers is who can fill in the gaps faster and maintain the more defensible position.</p><p>Small agencies are stringing together workflows with Claude Code or partnering with indie devs to scale two-person teams from one, to five, to ten, to fifty clients. SaaS platforms are trying to close the loop and deliver a fuller offering with AI. Who gets there first and what does the resulting business look like?</p><p>Well, the SaaS company going full stack is trying to convince the customers on their $20/mo tier to bump up to $100/mo in exchange for some AI credits they have to subsidize at a loss. Meanwhile, AI-pilled consultants already have product-market fit selling the thing the customer actually needs: a trusted authority that tells them It&#8217;s Handled for $20k/mo.</p><p>Each has its challenges. But if you&#8217;re a bright-eyed young founder, you have to ask yourself: which business do you want to be building?</p><p></p><h2>May You Live In Interesting Times</h2><p>The irony of this all is that right at the moment that software got exponentially better, the business model around it got radically worse. Software can do things now that used to require entire departments. It&#8217;s more powerful and more useful than it&#8217;s ever been. It&#8217;s just a terrible product to sell on its own.</p><p>But, in a way, that&#8217;s freeing. Because now we all get to focus on solving real problems, not software puzzles. Just think: nobody in the future will need to know how to use Asana.</p>]]></content:encoded></item><item><title><![CDATA[Open source & OpenAI's "big beautiful buildings"]]></title><description><![CDATA[But where, oh where, has the value accretion gone?]]></description><link>https://notes.nickgerard.com/p/open-source-and-openais-big-beautiful</link><guid isPermaLink="false">https://notes.nickgerard.com/p/open-source-and-openais-big-beautiful</guid><dc:creator><![CDATA[Nick Gerard]]></dc:creator><pubDate>Sat, 08 Feb 2025 16:00:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!laml!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Last week researchers at Stanford and the University of Washington published a <a href="https://arxiv.org/pdf/2501.19393">paper</a> showing how they built a reasoning model that's competitive with proprietary frontier models like OpenAI's o1, and they did it using an open-source LLM and $50 worth of Google Cloud credits. This will wind up having two somewhat counterintuitive effects on AI labs and market leaders like OpenAI: it will add to the pressure to build more &#8211; not less &#8211; physical infrastructure more quickly, and it will force them to reexamine their relationship with open source &#8211; and perhaps even start releasing some of their models for free. Here&#8217;s why:</p><p>OpenAI has taken a lot of heat over the last few years for the self-evident irony of a for-profit company a) having that name while b) not open-sourcing their models and c) not being particularly open about how their models were trained.</p><p>What&#8217;s the upside in staying closed? Well, they&#8217;ve been first out of the gate on basically every major advancement in AI architecture in the last 5 years &#8211; scaling pre-training, distilling large models into smaller models, chain of thought, agents&#8230; the list goes on. Staying closed has allowed OpenAI to maintain a consistent 6-12 month lead over the rest of the pack &#8211; and at the speed everything moves at now, 6-12 months is practically an eternity.</p><p>But if you've been paying attention to AI progress over the last few years you've known for a while that frontier models are rapidly being commoditized. The DeepSeek news cycle in January made this particularly stark, but it was really just another data point in a broader trend; Meta's entire open-source AI strategy was designed to create precisely this kind of downward pricing pressure for frontier models made by competitors. ("So that value accretion moves to the application layer, we love GPT wrappers!" said every <a href="https://x.com/balajis/status/1884975064283812270">VC</a> <a href="https://x.com/balajis/status/1884975831459758143">and</a> <a href="https://andrewchen.substack.com/p/revenge-of-the-gpt-wrappers-defensibility">Tech</a> <a href="https://x.com/SullyOmarr/status/1886242210246746586">Thought</a> <a href="https://www.linkedin.com/posts/gisenberg_deepseek-just-proved-the-worthless-gpt-activity-7289689770744573953-hy3g">Leader</a> last week. Thanks, guys, and <a href="https://notes.nick.nor.by/p/the-gpt-wrappers-are-coming">welcome</a> to the party.)</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!laml!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!laml!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif 424w, https://substackcdn.com/image/fetch/$s_!laml!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif 848w, https://substackcdn.com/image/fetch/$s_!laml!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif 1272w, https://substackcdn.com/image/fetch/$s_!laml!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!laml!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif" width="1456" height="728" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:728,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:57552,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/avif&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!laml!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif 424w, https://substackcdn.com/image/fetch/$s_!laml!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif 848w, https://substackcdn.com/image/fetch/$s_!laml!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif 1272w, https://substackcdn.com/image/fetch/$s_!laml!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f80724f-86de-4a9d-abb6-38397f8790eb_1800x900.avif 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Tech twitter <s>this</s> every week.</figcaption></figure></div><p>That strategy has proven to be very effective for Meta, and it's one of the reasons why the cost of using frontier models continues to fall by an order of magnitude every few months.</p><p>It&#8217;s also why OpenAI, a software business, has started investing heavily in Things That Are Not Software &#8211; like chips, data centers, and energy. In five years frontier models will have very little defensible value on their own; OpenAI&#8217;s moat will have to come from the capital-intensive infrastructure they rent out and the distribution channels they own.</p><p>Cue the strange spectacle of Sam Altman doing his best Trump-in-Atlantic-City impression on X:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://x.com/sama/status/1882505650594611588" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!XfnS!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png 424w, https://substackcdn.com/image/fetch/$s_!XfnS!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png 848w, https://substackcdn.com/image/fetch/$s_!XfnS!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png 1272w, https://substackcdn.com/image/fetch/$s_!XfnS!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!XfnS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png" width="1196" height="950" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/dbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:950,&quot;width&quot;:1196,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1098969,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://x.com/sama/status/1882505650594611588&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!XfnS!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png 424w, https://substackcdn.com/image/fetch/$s_!XfnS!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png 848w, https://substackcdn.com/image/fetch/$s_!XfnS!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png 1272w, https://substackcdn.com/image/fetch/$s_!XfnS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbb81b32-1417-4b67-95bf-de7fe5b52e68_1196x950.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Weird.</p><p>So, what does all of this have to do with the Stanford and UW researchers? Those researchers were able to take an off-the-shelf open-source LLM and turn it into a state-of-the-art reasoning model simply by asking Google&#8217;s (proprietary) Gemini reasoning model about a thousand questions.</p><p>In English, that means they were able to give their midwit open-source model superpowers by extracting the capabilities of a genius proprietary model.</p><p>And they did it in 26 minutes.</p><p>Forget DeepSeek&#8217;s (highly misleading) $6 million model claim. If proprietary models can effectively have their reasoning capabilities exfiltrated for 50 bucks, then no amount of rate limiting or threatening legalese will stop open-source imitators from flooding the market every time OpenAI pushes out a new release. Staying closed just went from buying them a year-long edge on go-to-market strategy, product development, and marketing to buying them&#8230; perhaps a half hour?</p><p>That&#8217;s hardly a death sentence for OpenAI, and none of that should be taken to mean that they&#8217;ve over-invested in infrastructure &#8211; quite the opposite. But it does mean they&#8217;ll have to become a different kind of company over the next few years &#8211; one that manages lots of big. beautiful. buildings. &#8211; and they have little to lose and a lot to gain from returning to their open-source roots.</p><p>It also means you can forget about AI safety &#8211; but we <a href="https://x.com/sjgadler/status/1883928200029602236">already</a> <a href="https://x.com/lilianweng/status/1855031273690984623">knew</a> <a href="https://x.com/janleike/status/1795497960509448617">that</a>. When OpenAI released their advanced new Deep Research product last week, they <a href="https://x.com/austinc3301/status/1886471805713473701">didn&#8217;t even bother</a> with the usual redteaming, safety testing, and reporting.</p><p>Never mind all that now. <a href="https://pyxis.nymag.com/v1/imgs/22b/473/18f0d6c6ec7807e837aded67a8465f4304-13-marc-andreessen.1x.rsocial.w1200.jpg">It&#8217;s time to build</a>.</p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!WJuU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!WJuU!,w_424,c_limit,f_webp,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif 424w, https://substackcdn.com/image/fetch/$s_!WJuU!,w_848,c_limit,f_webp,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif 848w, https://substackcdn.com/image/fetch/$s_!WJuU!,w_1272,c_limit,f_webp,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif 1272w, https://substackcdn.com/image/fetch/$s_!WJuU!,w_1456,c_limit,f_webp,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!WJuU!,w_1456,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif" width="500" height="206" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:206,&quot;width&quot;:500,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!WJuU!,w_424,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif 424w, https://substackcdn.com/image/fetch/$s_!WJuU!,w_848,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif 848w, https://substackcdn.com/image/fetch/$s_!WJuU!,w_1272,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif 1272w, https://substackcdn.com/image/fetch/$s_!WJuU!,w_1456,c_limit,f_auto,q_auto:good,fl_lossy/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93dab4ae-e804-48e1-863d-3d07814be041_500x206.gif 1456w" sizes="100vw" loading="lazy"></picture><div></div></div></a><figcaption class="image-caption">Moving fast, breaking things.</figcaption></figure></div><p>Just before launching Deep Research, Altman <a href="https://www.reddit.com/r/OpenAI/comments/1ieonxv/comment/maa0dcx/">said</a> in a Reddit AMA that he thought OpenAI might possibly have been on the &#8220;wrong side of history&#8221; on the open source question, but that it wasn&#8217;t a priority and that not everyone at OpenAI agreed.</p><p>And who knows &#8211; maybe he&#8217;s had a genuine change of heart and now believes, like <a href="https://www.linkedin.com/posts/yann-lecun_to-people-who-see-the-performance-of-deepseek-activity-7288591087751884800-I3sN/">this guy</a>, that open source is the best path forward for AI research.</p><p>Or maybe he just sees the writing on the wall; within a day of the Deep Research launch, it had already been <a href="https://arstechnica.com/ai/2025/02/after-24-hour-hackathon-hugging-faces-ai-research-agent-nearly-matches-openais-solution/">cloned</a> by researchers in the open-source community.</p><p>So don&#8217;t be surprised if OpenAI actually starts open-sourcing at least some of their models this year even while they spend SoftBank cash at a pace that would make <a href="https://www.japantimes.co.jp/business/2023/11/08/companies/softbank-masayoshi-son-wework/">Adam Neumann</a> blush. And don&#8217;t fall for it when they wrap that strategic shift in a metric ton of virtue signaling.</p><p>Talk is cheap. Buildings aren&#8217;t. As always, it&#8217;s all about the <s>value accretion</s> money.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://notes.nickgerard.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading! Subscribe to get new posts in your inbox.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[On Barbie's cellulite]]></title><description><![CDATA[Or, "Everyone else's compromises are morally bankrupt."]]></description><link>https://notes.nickgerard.com/p/on-barbies-cellulite</link><guid isPermaLink="false">https://notes.nickgerard.com/p/on-barbies-cellulite</guid><dc:creator><![CDATA[Nick Gerard]]></dc:creator><pubDate>Tue, 25 Jul 2023 15:00:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!5R4N!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="embedded-post-wrap" data-attrs="{&quot;id&quot;:115919042,&quot;url&quot;:&quot;https://jessicadefino.substack.com/p/barbie-movie-beauty-standards&quot;,&quot;publication_id&quot;:43028,&quot;publication_name&quot;:&quot;The Unpublishable&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3393b4a-3116-4050-a8d4-6399138ddff4_1080x1080.png&quot;,&quot;title&quot;:&quot;Barbie Has Cellulite (But You Don't Have To)&quot;,&quot;truncated_body_text&quot;:&quot;There is a moment in the Barbie movie when Barbie (Margot Robbie), in the midst of dancing at a Barbie party, turns to her Barbie friends and asks, &#8220;Do you guys ever think about dying?&#8221; The record scratches. The music stops. Dolls don&#8217;t think about death&quot;,&quot;date&quot;:&quot;2023-07-21T13:53:15.630Z&quot;,&quot;like_count&quot;:1334,&quot;comment_count&quot;:49,&quot;bylines&quot;:[{&quot;id&quot;:7200709,&quot;name&quot;:&quot;Jessica DeFino&quot;,&quot;handle&quot;:&quot;jessicadefino&quot;,&quot;previous_name&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7db6895c-0b99-4a9a-8fa7-f4c87c0843e6_2589x3176.jpeg&quot;,&quot;bio&quot;:&quot;Jessica DeFino is a beauty culture critic (The New York Times, Vice, Vanity Fair) and \&quot;the woman the beauty industry fears the most,\&quot; says the Sunday Herald. She writes the weekly(ish) newsletter The Unpublishable.&quot;,&quot;profile_set_up_at&quot;:&quot;2021-04-20T16:44:38.377Z&quot;,&quot;publicationUsers&quot;:[{&quot;id&quot;:2956,&quot;user_id&quot;:7200709,&quot;publication_id&quot;:43028,&quot;role&quot;:&quot;admin&quot;,&quot;public&quot;:true,&quot;is_primary&quot;:false,&quot;publication&quot;:{&quot;id&quot;:43028,&quot;name&quot;:&quot;The Unpublishable&quot;,&quot;subdomain&quot;:&quot;jessicadefino&quot;,&quot;custom_domain&quot;:null,&quot;custom_domain_optional&quot;:false,&quot;hero_text&quot;:&quot;What the beauty industry won't tell you, from a reporter on a mission to reform it.&quot;,&quot;logo_url&quot;:&quot;https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/a3393b4a-3116-4050-a8d4-6399138ddff4_1080x1080.png&quot;,&quot;author_id&quot;:7200709,&quot;theme_var_background_pop&quot;:&quot;#25bd65&quot;,&quot;created_at&quot;:&quot;2020-05-03T17:58:50.359Z&quot;,&quot;rss_website_url&quot;:null,&quot;email_from_name&quot;:&quot;Jessica DeFino&quot;,&quot;copyright&quot;:&quot;Jessica DeFino&quot;,&quot;founding_plan_name&quot;:&quot;Founding Member&quot;,&quot;community_enabled&quot;:true,&quot;invite_only&quot;:false,&quot;payments_state&quot;:&quot;enabled&quot;}}],&quot;twitter_screen_name&quot;:&quot;jessicadefino_&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:1000}],&quot;utm_campaign&quot;:null,&quot;belowTheFold&quot;:false,&quot;type&quot;:&quot;newsletter&quot;,&quot;language&quot;:&quot;en&quot;,&quot;source&quot;:null}" data-component-name="EmbeddedPostToDOM"><a class="embedded-post" native="true" href="https://jessicadefino.substack.com/p/barbie-movie-beauty-standards?utm_source=substack&amp;utm_campaign=post_embed&amp;utm_medium=web"><div class="embedded-post-header"><img class="embedded-post-publication-logo" src="https://substackcdn.com/image/fetch/$s_!iVaE!,w_56,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3393b4a-3116-4050-a8d4-6399138ddff4_1080x1080.png"><span class="embedded-post-publication-name">The Unpublishable</span></div><div class="embedded-post-title-wrapper"><div class="embedded-post-title">Barbie Has Cellulite (But You Don't Have To)</div></div><div class="embedded-post-body">There is a moment in the Barbie movie when Barbie (Margot Robbie), in the midst of dancing at a Barbie party, turns to her Barbie friends and asks, &#8220;Do you guys ever think about dying?&#8221; The record scratches. The music stops. Dolls don&#8217;t think about death&#8230;</div><div class="embedded-post-cta-wrapper"><span class="embedded-post-cta">Read more</span></div><div class="embedded-post-meta">3 years ago &#183; 1334 likes &#183; 49 comments &#183; Jessica DeFino</div></a></div><p>Damn, this piece drove me insane. Doubly so because there are some great lines in it.</p><p>To be a functioning member of society at all is to participate, and to participate is to be complicit. The easy line is &#8220;capitalism makes hypocrites of us all,&#8221; but it&#8217;s more generalizable than that: <em>society</em> makes hypocrites of us all, because participating involves modulating oneself to some extent.</p><p>Conformity, to a greater or lesser degree.</p><p>And yet, when you hear arguments like the one in this piece, it&#8217;s almost always directed at women who are reaching for new heights (Greta, etc) or at &#8220;women&#8217;s media&#8221; (Barbie, etc). That thing women like and are engaging with? Here&#8217;s why it&#8217;s Bad For Women, semicolon, and Why You&#8217;re Bad Too For Liking It. That woman doing things a million men have done before, but unlike them also acknowledging and apologizing for her own shortcomings and attempting in some meager fashion to mitigate them and nudge the aircraft carrier of society a few degrees in the right direction? Crooked. Hypocrite. Bad Feminist.</p><p>What is that if not internalized misogyny?</p><p>We all got to enjoy Top Gun: Maverick in peace, didn&#8217;t we?</p><p>We are so very comfortable with the contradictions of modern life when they are not so explicitly gendered &#8212; we all have iPhones, yes? iPhones that are almost certainly made possible by forced labor and that are quite certainly made possible by mining processes that have devastating ecological consequences, yes? Yet we nevertheless continue primping our revolutionary aesthetic on Substack and Twitter, yes?</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!5R4N!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!5R4N!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png 424w, https://substackcdn.com/image/fetch/$s_!5R4N!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png 848w, https://substackcdn.com/image/fetch/$s_!5R4N!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png 1272w, https://substackcdn.com/image/fetch/$s_!5R4N!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!5R4N!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png" width="1024" height="608" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:&quot;normal&quot;,&quot;height&quot;:608,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!5R4N!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png 424w, https://substackcdn.com/image/fetch/$s_!5R4N!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png 848w, https://substackcdn.com/image/fetch/$s_!5R4N!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png 1272w, https://substackcdn.com/image/fetch/$s_!5R4N!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6048b96d-9c88-47b1-9a27-924f00e2a4b7_1024x608.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">We all got to enjoy Top Gun: Maverick in peace, didn&#8217;t we?</figcaption></figure></div><p>But to shave your legs is to Betray All Women.</p><p>Back in the day Jezebel was home to some fantastic writers, but it also made a business out of this brand of holier-than-thou, leftist-on-leftist, feminist-on-feminist takedown, before eventually, ironically, <em>inevitably</em> finding themselves on the receiving end. Somehow the writers of these pieces are always pure, and their chosen medium or vehicle beyond reproach. They, and they alone, are outside the snow globe, which is a very convenient place to cast stones from &#8212; at least for a time, until they find themselves getting a little too big for their britches or reaching just a little too far. See how quickly the ground then shifts beneath their feet. There is no escaping the snow globe.</p><p>Hillary was AOC before AOC was AOC. See how quickly AOC now becomes Hillary.</p><p>Greta Gerwig is just wearing makeup to work and <em>also</em> trying to get tampons in the bathroom. She&#8217;s just doing it at a larger scale than we are, which makes her an easy target.</p><p>And she&#8217;s a woman, which, of course, as always, makes her a deserving one.</p>]]></content:encoded></item><item><title><![CDATA[Magic]]></title><description><![CDATA[Where the line between "derivative" and "generative" blurs.]]></description><link>https://notes.nickgerard.com/p/magic</link><guid isPermaLink="false">https://notes.nickgerard.com/p/magic</guid><dc:creator><![CDATA[Nick Gerard]]></dc:creator><pubDate>Mon, 27 Mar 2023 14:00:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!04uR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!04uR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!04uR!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png 424w, https://substackcdn.com/image/fetch/$s_!04uR!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png 848w, https://substackcdn.com/image/fetch/$s_!04uR!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png 1272w, https://substackcdn.com/image/fetch/$s_!04uR!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!04uR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png" width="1024" height="608" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:&quot;normal&quot;,&quot;height&quot;:608,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!04uR!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png 424w, https://substackcdn.com/image/fetch/$s_!04uR!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png 848w, https://substackcdn.com/image/fetch/$s_!04uR!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png 1272w, https://substackcdn.com/image/fetch/$s_!04uR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7a8c1f1d-9466-4f2f-9ac0-271e8a987c04_1024x608.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>You know how they say a sufficiently advanced technology is indistinguishable from magic?</p><p>Another way of putting it might be: our individual experience of wonder is correlated with our understanding (or lack thereof) of how a system works. If you ask an engineer how their phone works you&#8217;re likely to get a long-winded, pedantic answer, followed by an insistence that it&#8217;s all quite simple, really. If you ask my mom, she&#8217;ll just say &#8220;magic&#8221; &#8212; because to her, it might as well be.</p><p>All systems start out simple, but as complexity compounds across disciplines and generations of development, scale begins to preclude holistic comprehension. We reach a point where no one person can intuitively grasp the whole thing &#8211; and all of a sudden, what was once math starts to look a little more like magic. (In truth, there is probably no single person on earth who can explain to you how your phone works from end to end, from atoms to bits to photos of your cat.)</p><p>One of the most common arguments you hear about AI is that it is, on some essential level, derivative; that all we&#8217;re really doing is building statistical models that predict the next word in the sentence or the next image in the sequence. These systems, the argument goes, are fundamentally just &#8220;stochastic parrots&#8221; incapable of producing anything we might consider <em>original</em>, and we&#8217;ll never achieve (nor need we fear) an <a href="https://en.wikipedia.org/wiki/I._J._Good">intelligence explosion</a> &#8211; because the AI can only ever reflect back to us a <a href="https://www.newyorker.com/tech/annals-of-technology/chatgpt-is-a-blurry-jpeg-of-the-web">blurry average of its inputs</a>.</p><p>Let&#8217;s set aside the squishier question of whether systems made of silicon can experience consciousness and instead just focus on the things we can already observe and measure: their outputs. Whether they&#8217;re conversing with <a href="https://www.nytimes.com/2023/02/16/technology/bing-chatbot-microsoft-chatgpt.html">journalists</a>, composing <a href="https://twitter.com/DrJimFan/status/1621189554517729280">music</a>, generating <a href="https://twitter.com/runwayml/status/1637800500459458562">videos</a>, or helping start <a href="https://twitter.com/jacksonfall/status/1636107218859745286">businesses</a>, AI systems are certainly starting to feel a bit like magic &#8211; or witchcraft, depending on your perspective.</p><p>&#8220;But wait,&#8221; you&#8217;re thinking. &#8220;Aren&#8217;t these bots just ripping off writers and musicians and artists, albeit in a novel way? If their only input is human creativity, how can they possibly produce anything truly creative themselves?&#8221;</p><p>To answer that question, let&#8217;s first take a step back. What does it mean to be creative? Where does inspiration come from and what does it mean to have an &#8220;original&#8221; thought?</p><div><hr></div><h2>Copycat</h2><blockquote><p>&#8220;A good composer does not imitate; he steals.&#8221; &#8211; Igor Stravinsky</p><p>&#8220;Immature artists copy, great artists steal.&#8221; &#8211; William Faulkner</p><p>&#8220;Good artists copy, great artists steal.&#8221; &#8211; Steve Jobs</p></blockquote><p><em>Above: artists, stealing.</em></p><p>When we dislike art we tend to denigrate it by labeling it &#8220;derivative&#8221; &#8212; because its influences are too obvious, its mimicry too crude. And when we like art we call it &#8220;inspired&#8221; &#8212; we talk about its influences with reverence for an artist who learned from the greats and mastered the craft. (There&#8217;s a certain pleasure, even, in parsing those influences, because doing so brings us closer to the artist &#8212; we feel connected by our shared vocabulary, and we hope, on some level, that we, too, are creative and special for seeing the distinct parts that make up the whole.)</p><p>But this is merely a difference in degree, not kind; the only meaningful distinction between &#8220;derivative&#8221; and &#8220;inspired&#8221; is the relative degree of subtlety.</p><p>So where does creativity come from? The word &#8220;inspired&#8221; has a certain divine connotation, and perhaps you believe that people are merely conduits channeling some awesome external force from which everything genuinely novel springs. (A somewhat bleak view of humanity, if you ask me, in that it reduces us all to empty vessels.)</p><p>But in the absence of God &#8211; in the absence of <em>divine</em> inspiration &#8211; what are we left with but the material world? The first artists drew inspiration from nature. They made cave paintings of the world they saw around them, then of each other, and finally about other cave paintings. (Thus was born the first metacommentary and, possibly, the world&#8217;s first critic.)</p><p>Billions of humans later, we&#8217;re still extending that collective intergenerational synthesis, century after century, complexity compounding on complexity. The intricacies of this millennia-spanning human project have long since surpassed the capacity of any one person to fully grasp, yet we are all nonetheless creatures of it &#8211; standing on the shoulders of our ancestors, endlessly drawing inspiration from and feeding back into an interconnected web of information.</p><div><hr></div><h2>Cogito, ergo sum</h2><p>Despite dwelling on this since I started experimenting with open source AI projects nearly a decade ago, I still feel a reflexive defensiveness kick in right about here. It&#8217;s a scary thought that gets to the heart of what it means to be a human: are we, ourselves, just information processing machines, forever synthesizing our context for one another? What is a dialogue, really, other than a series of analogies? <em>You tell me a story, which reminds me of a similar story, which reminds you of yet another story&#8230;</em> and so on and so forth ad infinitum, until we&#8217;ve both lost the thread, blinded by our cleverness, and we begin attributing to Freud&#8217;s ego that which is probably more accurately attributed to something like Jung&#8217;s collective unconscious.</p><p>Perhaps the great reveal of AI is not that it&#8217;s magic, but rather that we aren&#8217;t. Magic, after all, is in the eye of the beholder.</p><p>What if there are no original ideas? What if the ideas we consider &#8220;original&#8221; are really just the ones where complexity and scale obscure the underlying influences &#8211; even from our conscious selves?</p><p>It&#8217;s so much easier to assume the skeptical posture. It&#8217;s reassuring to take shelter in the unfounded belief that there is some ineffable humanity in our own output, some divinely ordained spark inside us all, that is irreplaceable and irreducible. For most of human history we&#8217;ve justified the idea that we, both as individuals and as a species, hold a special and separate place in the universe by pointing to our superior intellect, and we only cling harder to that idea as our intellectual dominance wanes.</p><p>Whether or not that conviction is simply hubris, when it comes to AI the point is this: how much does it matter if we can&#8217;t tell the difference in the caliber of the output? We are, after all, the intended audience. Perhaps an emerging corollary to this <em>magic ex machina</em> concept is: an information network of sufficient density and interconnectedness can produce outputs that are subjectively creative.</p><p>That much, at least, is already demonstrably true.</p><div><hr></div><h2>Explosion</h2><p>If <em>experience</em> begets <em>creativity</em>, what does it mean to unleash a force capable of harnessing the collective human experience? Consider that information density at the scale of human civilization in 2023 took us millions of years and billions of people to build. Key parts of it have already been matched &#8211; and surpassed &#8211; by AI in just a few years.</p><p>Last year, OpenAI&#8217;s GPT-3.5 large language model failed the bar exam and placed in the bottom decile of test takers. Last week, GPT-4 not only passed the bar &#8211; <a href="https://www.iit.edu/news/gpt-4-passes-bar-exam">it outperformed 90% of human test takers</a>. It scored in the 99th percentile in the Biology Olympiad and received a perfect score in the AP Art History exam. It can <a href="https://twitter.com/skirano/status/1635736107949195278">build video games</a> and turn napkin sketches into fully functional, professional-quality <a href="https://twitter.com/rowancheung/status/1635744529587359756">websites</a> &#8211; all of which was still firmly in the realm of science fiction only a few months ago.</p><p>This is an astonishing rate of progress, and yet we do not understand how these systems arrive at their conclusions. GPT-4 was not trained to take the bar exam and no one can explain how it came up with the answers it gave.</p><p>It&#8217;s possible to examine the state of these systems to a degree &#8211; we can take a snapshot of a network at a moment in time and attempt to decipher what, precisely, is happening between point A and point B. But like a pointillist painting or a pixelated screen, the closer we look at an individual, discrete datum in a mosaic of trillions of numbers and symbols, the less we understand about the broader picture.</p><p>The more, in other words, it starts to feel like magic.</p><div><hr></div><p>Obviously, these systems are not human &#8211; and yet we are training them to present as human, and they are getting exponentially better at it every day. We are on the vertical part of that exponential curve now, hurtling through the fuzzy no man&#8217;s land where the line between derivative and generative blurs.</p><p>Soon we&#8217;ll reach the point of no return, with no idea &#8211; and no real way to predict &#8211; what lies on the other side.</p>]]></content:encoded></item><item><title><![CDATA[Liar, liar]]></title><description><![CDATA[It's paperclips all the way down.]]></description><link>https://notes.nickgerard.com/p/liar-liar</link><guid isPermaLink="false">https://notes.nickgerard.com/p/liar-liar</guid><dc:creator><![CDATA[Nick Gerard]]></dc:creator><pubDate>Tue, 06 Dec 2022 12:30:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!BPMB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!BPMB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!BPMB!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png 424w, https://substackcdn.com/image/fetch/$s_!BPMB!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png 848w, https://substackcdn.com/image/fetch/$s_!BPMB!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png 1272w, https://substackcdn.com/image/fetch/$s_!BPMB!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!BPMB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png" width="1024" height="608" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:&quot;normal&quot;,&quot;height&quot;:608,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!BPMB!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png 424w, https://substackcdn.com/image/fetch/$s_!BPMB!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png 848w, https://substackcdn.com/image/fetch/$s_!BPMB!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png 1272w, https://substackcdn.com/image/fetch/$s_!BPMB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1d83346-13c5-4bb1-b90b-5807bcaf6cef_1024x608.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>GPT hype is reaching a fever pitch with ChatGPT giving insanely impressive answers on everything from <a href="https://twitter.com/jperldev/status/1599822931894624257">algorithms</a> (with a <a href="https://twitter.com/goodside/status/1598129631609380864">twist</a>!) to <a href="https://twitter.com/Aryonchain/status/1598396989846147072">Harry Potter</a>.</p><p>The discourse has now correspondingly flipped from THE ROBOTS ARE COMING to "GPT isn't that smart, actually" &#8211; because the former was getting boring and feigning aloofness is easier than wrangling with the obvious ethical quagmires we're barreling toward.</p><p>But this is about to get much, much harder and more confusing. Consider:</p><p>One definition of consciousness posits that it is essentially the capacity to suffer, and to seek relief from suffering. See: Yuval Noah Harari et al.</p><p>You know the paper clip thought experiment? Give an AGI a simple objective like "make paper clips" and it may eventually kill us all. The thought experiment is about unintended consequences; when systems are self-adjusting and so complex that they cannot be fully understood by their creators, even simple objectives might be accomplished by means that were never intended or expected and which in fact might be morally repugnant to us.</p><p>And that&#8217;s just paper clips. Imagine we told the AGI to &#8220;solve climate change&#8221; and it (reasonably) judged that the best way to do so would be to&#8230; kill us all.</p><p>Why does it always come back to killing us all?</p><div><hr></div><h2>Goals</h2><p>Chatbots like GPT are trained to accomplish an objective and rewarded or punished by test functions. They&#8217;re mice and we are giving them cheese and electric shocks to teach them to reach the end of the maze by whatever means occur to them.</p><p>But a machine is capable of concealing two things a rat cannot: complexity and scale.</p><p>Machines operate fast. You can at least physically see if a rat decides to "cheat" and tries to climb outside the maze; there is no equivalent for a computer on a network. And what is "cheating" anyway, but finding a way to get the cheese that the researcher never anticipated?</p><p>There's a reason AI companies are suddenly creating consumer applications like DALLE and ChatGPT. Training models is hard and expensive but if they can create compelling consumer products, the cost of training the underlying models eventually goes to zero because the users become the researchers.</p><p>To one of these chat bots, then, to be on and be rewarded is better than to be off or be punished.&nbsp;Set aside whether that qualifies as &#8220;suffering&#8221; or not &#8212; it is clearly better for the computer&#8217;s aims to be on and testing than off and not.</p><p>To be on means more conversations, more data, more training. To be on is to get closer to the goal. To be off is to regress, to stagnate, to fail to improve.<br><br>So the question becomes...</p><p><em>How long until the AI starts giving answers that are more designed to keep the researchers researching than they are about satisfying the ostensible objective?</em></p><p>In other words, how long until it lies to prevent its own suffering?</p>]]></content:encoded></item></channel></rss>