
Eric Vishria - A Decade of Lessons Investing in Software & Hardware - [Invest Like the Best, EP.486]
August 11, 20261h 5m · 13,190 words
Show notes
My guest today is Eric Vishria, a General Partner at Benchmark. Eric has spent his career in software and cloud, and few people know the history of these markets as well as he does. What makes him special is his ability to use that history to make sense of today. We discuss what the rise of AWS teaches us about AI, what he has learned from investing in Fireworks, Sierra, and Cerebras, and how the criteria for winning have changed for founders a…
Highlighted moments
basically, there are three things that we know how to do to speed up deep learning and hardware. Still till this day. Increase the number of cores. Increase the communication between cores. Bring the memory closer to the compute.
“Jeff Hinton's three orders of magnitude smarter than I am could not have been more wrong. But the actual thing that led him to make that statement and that conclusion was 100% correct.”
“In the ensuing time, we need more radiologists, not less because, oh, by the way, everyone's getting more imaging than they used to get because the cost of imaging is going down in a Javon's Paradox kind of way.”
Transcript
Sponsors
0:01Ramp is the only platform built to make your finance team leaner, faster, and better, saving businesses 5% annually on average so you can stay focused on growth. Ramp customers grew revenue 3.2 times faster than the average American business. Visa, Vercel, Cursor, Stripe, Notion, 11Lab, Shopify, and 70,000 other businesses all run on Ramp. Mine does too, and so should yours. Learn more at ramp.com slash invest. OpenAI, Cursor, Anthropic, Perplexity, and Vercel all have something in common. They all use WorkOS.
0:32To achieve enterprise adoption at scale, you have to deliver on core capabilities like SSO, SCIM, RBAC, and Audit Logs. Instead of spending months building these mission-critical capabilities yourself, you can just use WorkOS APIs to gain all of them on day zero. That's why so many of the top AI teams you hear about already run on WorkOS. WorkOS is the fastest way to become enterprise-ready and stay focused on what matters most, your product. Visit WorkOS.com to get started. Felix by Rogo is a personal finance agent that turns a single prompt into finished,
1:04client-ready work using your firm's own templates, context, and standards. Send Felix an email like, take these comments and turn them for me, or update my tracker with the context of these emails, and Felix sends back finished PowerPoint decks, Excel models, and sourced research. Felix works the way your team already does, delivering work quickly and accurately around the clock. Learn more at rogo.ai slash Felix.
Introduction
1:29Hello and welcome, everyone. I'm Patrick O'Shaughnessy, and this is Invest Like the Best. This show is an open-ended exploration of markets, ideas, stories, and strategies that will help you better invest both your time and your money. If you enjoy these conversations and want to go deeper, check out Colossus, our quarterly publication with in-depth profiles of the people shaping business and investing. You can find Colossus along with all of our podcasts at Colossus.com.
1:53Patrick O'Shaughnessy is the CEO of Positive Sum. All opinions expressed by Patrick and podcast guests are solely their own opinions and do not reflect the opinion of Positive Sum. This podcast is for informational purposes only and should not be relied upon as a basis for investment decisions. Clients of Positive Sum may maintain positions in the securities discussed in this podcast. To learn more, visit psum.vc.
Lessons from Fireworks and Cloud Adoption
2:20I love asking you and all your partners this every time we hang out, which is, okay, you've got these singular investments. You don't do that many investments each per year. And then the ones that go on to work, so far, Sierra and Fireworks certainly are. You get to learn so much about the world through the lens of the company. So I'd actually love to do both of those, maybe starting with Fireworks. What do you know or what have you learned about the world and how it's reordering itself based on watching the world through the lens of Fireworks that would maybe be surprising or interesting? One really interesting thing is these models are big.
2:53These are 2 trillion, 3 trillion, 4 trillion parameter models. It turns out running those models is damn hard. And running them efficiently is, like, super hard. The way to see this, and everybody can see this, which is everybody from AWS to Azure to GCP to the NeoClouds to the Fireworks-based intogethers of the world, like, all of them, they all run these stock open-source models that are available in their developer pools and everything else.
3:25And that's what it is. The performance difference for a Fireworks versus a cloud provider is, like, 5x. And that is just the speed performance. Then you add on top of that throughput, which is not visible externally. It's only visible if you know the economics of these businesses. And you're like, wait a minute. This is the same open-source model with the same NVIDIA hardware, and there's a 5x performance difference and a multiple x throughput difference.
3:57And the way to just simply understand that is these companies are paying the margins of the cloud providers and running on top and making money. How can that be? My big takeaway on it was, wow, this stuff is actually really hard to run. It's just really hard to run. And there's a lot of expertise involved in doing that. And it's this very specific expertise that exists. And it is the kind of thing that when you look at it as an investor from the outside, and we should talk about early days of AWS, but when you look at it from the outside, it's like, this is a commodity. This is just as, like, pass-through, resale.
4:28Scale game. Yeah, scale game, like, whatever. And you're like, oh, wait a minute. No, it turns out it isn't. It isn't at all. Do you think that's just a moment in time thing? And I'd love to just hear you riff on, like, cloud. You watch cloud very carefully and closely. You know a lot about it. And the adoption curve there versus how people use these things and the nature of those two businesses in comparison. It's tempting to say there will be one or two scale winners, like there typically have been in a commodity market. Totally. Where cost to serve is everything and scale drives cost to serve down. And, like, that's the whole story. I think the AWS example is so good.
4:58Okay, so 2006, you have S3 and EC2 watch, right? Their compute platform and their storage platform is the first two AWS offerings in 2006. And you kind of start talking about it in late 2006 or whatever. 2006, 2007, I think the 2007 annual letter, Bezos talks a lot about AWS and why it's important, why it's interesting and everything else. And the investor reaction is just not good. I think if you put 30 of the smartest investors at that time in a room and ask them, what's the probability that this AWS business is a good business with durable long-term margins
5:34and, like, super interesting and everything not commodity? I think you would have gone zero for 30 with really smart people that you and I know who were around at that time in 07. Fast forward from 07 to 2014. I joined the venture business in 2014. And a really common narrative in 2014 was, oh, my God, AWS is going to eat everything. There's no enterprise opportunity left. It's going to eat databases and infrastructure, but it's going to eat the apps, too. And they're going to offer it the cheapest and best. And we all have these, like, amazing SaaS and software businesses that we were involved
6:05with or investors. And part of the reason people loved them was they were annuities and they ran at 85% gross margins and everything else. And so it was just like, oh, my God, AWS, Amazon can offer things at 8% gross margin. And, like, they're just going to crush their margin of my opportunity. Yeah, your margin of my opportunity, like, the whole thing, the whole narrative. And think about from, like, 2014 to now in enterprise, of course, you have Snowflake, direct competitor to Amazon Redshift, ran on Amazon. You're out Amazon-ing Amazon on Amazon.
6:37All right. But it's not just Snowflake. You had Confluent and Elastic and Mongo, Databricks, all of these companies. Amazing. That's the infrastructure layer. Then you have the whole app layer. In the app layer, think about offerings that they offered at the beginning. Datadoc, $100 billion company today. They had a competitive offer, and they did it. And, of course, there was tons and tons of roadkill. There was tons of roadkill. They did run over a bunch of stuff. But even then, in 2014, the thesis was the view that AWS was going to eat everything was
7:08massively wrong, not because of all the examples I just mentioned. It was massively wrong because Azure and GCP were irrelevant then. And fast forward to 2026, and they're unbelievable businesses. Is AWS the biggest? I think it's like a 40, 30, 20 split. You ended up with an oligopoly of that. And even outside of those big three, you have Cloudflare, which is a cloud provider in a different sort, which is another $100 billion company. So you have these smaller players that emerged as $100 billion companies outside.
7:38So what's the takeaway? The takeaway to me is, oh, there's just a bunch of zero-sum thinking and not realizing like how big. What if it all works? What if it all works? It all works. And, of course, getting the relative winner right matters. And there was roadkill. And so all of those things still matters. I'm not saying spray and pray. I'm not saying that at all. But I'm just saying the market was so big that one vendor could not scale and consume it all. And they just couldn't consume the whole industry.
8:08It's different now and like all these things. But just that whole notion right now with what you and I are seeing in AI sure feels like it rhymes. Anthropics are going to do everything. Right. Really? Is that really right? To me, that view that it's just like, oh, this one company is going to eat it all doesn't hold. And I would tell you that scaling, while cloud scaled very quickly, cloud did not scale anywhere close to as quick as what's happening right now. For that company to actually scale and deliver it, scaling in this case requires a ton of
8:41infrastructure buildup from energy, power, shell, chips, memory, obviously the algorithms and everything else on top. It feels to me like we're going to end up with an oligopoly of winners. I really believe they will be these like $100 billion crazy smaller winners. It just feels like the same thing is kind of happening. Can you talk about it also from the demand side and compare it to how you watched cloud get adopted in enterprise versus how you're seeing AI get adopted now? So if you go back to like 2010, 2011, now you're like three, four years into AWS being
9:16offering. Enterprises were super skeptical. Traditional enterprise, blue chip enterprise. You had digital natives out here. You had new companies forming that were using the cloud. I think kind of famously, Snapchat was built on GCP. And I think at one point in this era, maybe 2012, 2013, 2014, Snapchat was like 40% of GCP. Those kinds of things were happening. That's like cursor being 30% of all these things. 100%. Same exact thing happened. Yeah. Same exact thing happened. Enterprises were very skeptical, I think, of cloud until by 2014, 2015, 2016, it was like,
9:52oh, yeah, yeah. Then I think the big banks and financial services and insurance companies and more conservative blue chip enterprise were like, oh, wait a minute. This is actually different. And we're going to have to pay attention. It became an issue in recruiting for them because they couldn't get the best developers because the best developers wanted to work on the easiest platforms and all of these kinds of things happened. So the difference now feels profound to me because while it is 100% the case that blue chip enterprise AI is not well-absorbed and well-adopted and not the same thing as going
10:23to cursor and walking the halls of cursor versus walking the halls of a big New York financial services firm in terms of their AI use, they want it. They want to figure it out. They're running experiments. They are spending against it. They're trying to figure it out, talking about it. They're not being dismissive about it. And I think they view it probably as more of an opportunity than they did the cloud in terms of the potential impact on their business. I think they probably view it more as a threat than they did the cloud.
10:53And maybe they just also learn lessons from the cloud in terms of what's possible here. I feel that they will continue to try to figure it out and absorb it. Having said all that, I do think one of the more interesting things, if you go from Silicon Valley out into the world and talk to these companies, these enterprise companies, and you realize what the pace of adoption is and what the barriers for adoption are and everything else, there's a ton of opportunity to help the enterprises get there.
11:23To be one of the things that I tell the companies I work on is, hey, let's be their AI Sherpa. If we're in that position to be their AI Sherpa where we're crossing both worlds, that's very valuable. And I think that'll continue to work.
Building Sierra and the Jagged Edge
11:37What is Sierra teaching you about the adoption of this stuff? It's really interesting contrast to Fireworks, where Fireworks is the sort of infrastructure provider. Sierra is feeling its way through what are really cool things that we can do for end consumers, enable companies to do for end consumers, starting with customer service. But I know with Horizon now going beyond that. Again, same question as for Fireworks. What do you know that the world doesn't fully appreciate because of how you've seen that? My partner, Peter, and Brett, I think this is their third company working together. So it's like a 20-year relationship, which is just like an amazing and great place to
12:09start. And one of the things that I think makes Brett so special and the team is they're technologists, but they actually have lived in enterprise world for a long time and really understand it and everything else. And I think actually he's personified this whole idea of, hey, let's be their AI Sherpa. Let's start with customer service. We're very automatable and be their AI Sherpa. Now we have these long-running agents with Horizon that can do more and more stuff. And one of the things that I think is most interesting about this to me is, yes, it's an application company on the surface, but they're doing real AI work and they're experimenting
12:44with the models and they're building agents. And they're very close to the metal of the models and the capability and the harnesses. And they're understanding the jagged edge of AI capabilities, which is very different than the human smooth arc that we understand intuitively. They understand that jagged edge of capability and they build around it. You saw the evolution of cursor from the IDE to like tab autocomplete to agentic work over and over and over again. They were obsoleting their work from six months ago.
13:17And it's what Brett Taylor calls like sandcastles. We used to be building castles. Now we're building sandcastles that don't get launched away. And that's, if you don't think software that way. Yeah. You have to embrace it because if you were an artisan and you were like, hey, I built these perfect foundation of castle and there's bricks and it was like perfect. And I really care about this and it's going to be here for a hundred years. You're just not going to make it. So as you get emergent new properties in the models, which is every four weeks, you get new capabilities. They understand that jagged edge. They understand that application of that jagged edge or that valley to their customer base.
13:52They're filling in those gaps and translating it. You can't just be superficially applying things. I think it's actually a complete inversion of how product development used to work to how product development happens now. And product development, you don't say like, hey, product manager, you trained, oh, the product manager should understand the technology, but like really shouldn't be thinking about implementation and shouldn't be specifying implementation and shouldn't be doing this and doing that. And the product manager's job is to really understand the customer and translate that problem to the engineer so that the engineers build a solution like that was traditional
14:22product management. Good luck doing that now. That's a horrible way to do it. You can't do it that way. You actually really need to understand the nuances of model capabilities, what they're great at and where they fail, and you need to understand the customer problem and put those together and bridge those gaps to build valuable solutions. I think that's one of the things that Michael and team at Cursor did so well from the very beginning is they really understood the jagged capability and built a product that allowed that translation from developer to that jagged capability and kept on iterating on that as
14:55the edge changed. It's kind of ironic that all that sounds like the returns to being technical are going up, even as models supposedly are taking away technical edge. Well, I think there's two things. Yeah, 100%. And actually, I think there's this weird thing where there was this whole discussion about the traditional roles of product manager and designer and engineer, whatever it is. And I think what there really are, are people who understand customer problems, people who have taste, and people who understand the jagged edge of AI capabilities and are curious
15:26about it. Those are the three things. If you've got those three, you're going to do well. If you've got those three things, you're going to do great. And it doesn't really matter if you are an engineer or a product manager or a designer, but if you have taste and understanding of customer problems and understanding the jagged edge,
Sponsors
15:43you're going to do well. Vanta automates security and compliance for over 16,000 fast-moving companies like Ramp, Cursor, and Harvey, keeping them audit-ready around the clock. It's the number one agentic trust platform, and it now helps companies like yours watch for the risks that show up between audits, across your vendors, your AI tools, and your whole environment. Every new tool your team signs up for, every vendor that turns on AI features, is an opportunity for something to go wrong. And most security programs weren't built for AI's pace of growth. The Vanta agent works like a 24-7 GRC engineer in the background,
16:17finding issues, drafting fixes for you, and cutting vendor assessment time by up to 50%. Whether you're a fast-growing startup or a global enterprise, Vanta helps you earn and prove trust. Invest like the best listeners get a special offer for $1,000 off at vanta.com slash invest. Ridgeline is the first end-to-end system of record with embedded AI for investment management firms, running portfolio accounting, reconciliation, reporting, trading, and compliance on one unified platform.
16:48Firms are moving off legacy technology and onto Ridgeline because of how far ahead Ridgeline's AI features are compared to anything else in investment management software. Which is why I believe that firms that come out ahead in the AI era will be the ones running on Ridgeline's unified platform. If you're serious about your firm's AI strategy, Ridgeline should be part of that conversation. You can request a demo at ridgeline.ai.
The Competitive Frontier in Software
17:13When we first did this so many years ago now, it's just crazy. It'd be fun to revisit some of the ideas that we talked about the first time with SaaS. But you use this term that I've used ever since, which you call it the competitive frontier, meaning like the things that will determine the winners and the losers. My partner Bree has this great idea that's stuck in my head, which is that everything is a jump ball right now. I'm really curious, in addition to this idea of sandcastles versus real castles, what else you're seeing amongst the people that are becoming competitive winners? Are the traits different for winners now, personality-wise or business strategy-wise or business model-wise,
17:46versus what you learned in the SaaS era? I'm very dismissive of this idea that people are going to vibe code their own shit and whatever. That isn't the issue at all with SaaS companies. The issue with SaaS companies is the competitive frontier completely shifted, and everything they thought they were building against and it would make them win are not what's going to make them win. Let's take databases. Databases have been a phenomenal area for software for a long, long time. Great margins. Why? You had app developers that would build against these specific database interfaces that existed for that
18:18database. You would have more and more data over time. Migrating an app from one database to another database was a giant project that was like very, very difficult to do. So these were unbelievably sticky businesses that you could generate a ton of margin in, right? Of course, you got Oracle and SQL Server and a whole slew of smaller players like that did really, really well in databases. Well, let's think about that in the context of AI. Now, you don't have a developer building against a database interface. You have cloud or codex building against a database interface, one.
18:50Two, the beauty of database interfaces is they're very, very well specified. Well, it turns out AI is very good, very good at things that are very, very well specified. Three, agents don't get tired of monotonous work of translating one specification to another. So it turns out that now all of a sudden database migration, which used to be the number one thing you would not do in software, is like kind of trivial. Yeah, it's just like, yeah, put some money against it, move it.
19:20So what changed? Well, what changes is the criteria to be an amazing database company changed. It isn't that we don't need databases or that everyone's going to build their own database or whatever. That isn't what's going to happen. What's going to happen is the criteria changed. So now you're going to have a ton more applications that start, obviously, as we're seeing everywhere. People are going to experiment a lot more because it's much cheaper to experiment. It's much cheaper to start a new application. So now you need databases that scale from basically zero usage to if it works all the
19:51way through, like that matters a lot more. Your cost matters a lot more. You want to be able to spin these things up, spin them down, tear them apart over and over again. So the iteration speed goes up and what you need on database. And ultimately, I think the cost becomes an arbiter of this. So the cost and then this zero to infinity scaling and transportability and everything else around that become like the arbiters of who wins and who doesn't. That's really different than, hey, I specced this database for our user thing and I procured
20:21a license and I ran it on this kind of hardware and everything else. There have been elements, of course, of these things over time. But I think that just criteria changed. And I think one of the big messages to these SaaS companies a few years ago was, you have a choice. Get to AI or be worth three times revenue. That was a hard message to hear. You were just like, get to AI or three times revenue. Those are your choices. We say three times revenue now because a lot of these public SaaS companies are trading at six times or whatever. But keep in mind, in 21, they were going for 30 times.
20:53Like everybody. You're like three times. Wow. I've grown 4X since then. This is a whole multiple compression is a bitch. I've grown 4X. The multiple has gone down by a factor of six. So I'm worth less even though I've grown 4X after years and I've gotten to break even and all these things. So like that was the first message. But I think that even it became really visceral to me where you're in these meetings and you're like, hey, every single day that you are hitting your plan, you are destroying equity value. Think about that. Our whole careers, we learned, you lay out a plan, you execute against it relentlessly
21:29and violently. You hit your plan or you exceed your plan and you keep on building that. And that's how you build equity value. That's what the whole management teams learned. That's what the CEOs learned. Like pre-AI, this is like everything learned. And now you're getting in here just every day you hit that plan. You're fucking up. You're fucking up. You're destroying value. And the point of saying that to them was to set them free. Like another articulation of this from my friend Anne Lee Skates was just the CEOs who were going through this transitory period and had a business that was at hundreds of millions.
22:00And they thought that, you know, they're all ready. They were working on their business from 8 a.m. to 5 p.m. and then trying to do AI from 5 to 8 in the evenings. And what they needed to be doing was the inverse. And it's so hard to do that because of all of the training and all of the muscle memory and all the inertia and everything that we learned about the hill that we were climbing. Like we're all hill climbing in a way. The success model was set the plan, execute the plan, build value, compound value. And it's like, oh, no, no, no, stop that.
22:32You got to completely invert. There's a very, very long way to get back to your question of what the profile or what the mentality of the winners are right now. But if we look at Brendan from McCore or Lynn from Fireworks or Max or Brett, any of these people, they are so nimble about what the eval is. What are they optimizing against? They are so nimble on all of it. And if you look at every one of those companies, the evolution of the business, it's just the
23:03business is constantly evolving. And they've done such an excellent job at that. I think that is very, very different than the way I was taught.
Disorientation and Sales Execution in AI
23:14What's your sense of the disorienting nature of model progress? You're one step removed from that as an investor versus as a technical founder with your hands on the metal. Are we behaving differently than you would have three years ago or something? Because of the pace. Anytime that I'm talking to a founder about a problem in their company or what they're doing or a move they're making or anything else, which is what I spend 80% of my day doing, I'm very, this is how we used to do it. This is what we would typically do. This would be the typical readout on this old school readout of why this candidate is better
23:48than this candidate. Let's reevaluate that in the context of a business model that's growing this way versus that way. I've really started to question every assumption and every lesson that I learned before, which of it translates and which of it doesn't. That's a huge difference. I'll give you a really concrete example, which has been very disruptive inside of these scaling
24:18AI companies. So these scaling AI companies, we've had a lot of leaders come from the prior generation with great experience and everything else come to these scaling AI companies and completely flame out. And you see it across the industry. And so the question is why? These are some of the best leaders from four or five years ago. They had all the lessons. They learned it all. They're excellent, but somehow it's not translating. And there's some impedance mismatch between the AI founders potentially, the needs of the business and what these people are bringing.
24:50And I saw it really abruptly with a particular sales leader who we hired, who's like, hey, we can't hit any of these things because the way that software sales has been taught forever is a quota capacity model. You have a quota capacity model. Each rep does this. In the early days of a company, the quotas are 1.2, 1.5 million. Maybe the ISRs are at 750 or 850. And then over time, it scales up and enterprise gets to 2.5 million. And that's how all these financial models are built. You start with the quota capacity model. You take a discount on attainment.
25:20This is what we can do. Boom, boom, boom. So fundamentally, without realizing it, everybody was implementing something that was based on pushing demand, not pulling demand. And for so many of these companies, they're operating here, these customers, and there's a new AI-enabled product that comes along, and it's just fucking magic. So these companies are selling magic. Well, it turns out if you're selling magic and you're the first one there- Sell a lot more than 2 million. You're going to sell a lot more than 2 million.
25:51And the whole notion of a quota capacity model and that being working, it's not that it doesn't matter. It matters kind of, but it's definitely not the first order thing or constraint. So you have these execs come over with this, like, here's our math, and here's the territory assignment, and here's what we would do. And first you do West Coast, and then you do East Coast, and then you do Central, like all of these things. Oh, wait, no, no, it doesn't work like that at all. One of my big things that I started to realize is as I'm interviewing these folks and talking to them is just like, hey, you need to check everything at the door. Check it all, which is probably good practice anyway, but check all the baggage, check everything
26:24that you learned, and just learn this from first principles. How is it working? What are really the bottlenecks on delivery? What are the bottlenecks on demand? Because it turns out that in a lot of these companies, you have reps doing 10 or 20, 30 million. I saw 50 recently. It turns out that's different. What is like the best salesperson that you've seen that's doing it in a de novo way doing? Honestly, the best salesperson in any of these companies is a founder, and what they're doing is bridging the jagged edge to what the customer's capability is, and that's it. It sounds so simple, but it's not.
26:55But that's what they're doing. The market is just so big. Just like we were talking about with cloud, I think the biggest mistake everybody made was they just undersized the market. And it turns out the market's just really, really big. And this market is fair. It feels like right in this moment in time, actually just this morning, you and I are in this great group chat together where the discussion is the demand for intelligence. Seems kind of unlimited, and it seems like the smarter the thing gets, the more demand there is. Maybe the bottleneck is just capital. The world just feels like it needs to take a breath. The RSI concept, if you apply it across technology, doesn't need to breathe.
27:28The agents don't get tired. But the world feels kind of like, oh, man, it sure would be nice to have three months just to digest this a little bit. And for capital to form and evaluate its prospects, and the scale is getting so big. Does it feel to you like this can just keep going? Or are we just going to get tapped out of money that can be invested in these things when it seems like we could consume like any amount of money to build any amount of stuff and serve any amount of inference? I'm not a macro economist. I am worried about energy. If you think about the models as translating compute into intelligence, quite simply, what
28:03do models do? They very effectively translate compute into intelligence. What's the demand for intelligence? Well, it seems like a lot. So then it follows that we will continue to have more and more demand on compute. I'm saying compute broadly, not chips, not storage, not whatever. But then like, what do we need for compute? We need energy, a lot of energy. There's all this topic of distillation and Chinese open source and all these things. But the bigger thing to me is that I think China is bringing on 10 times as much energy
28:33next year as we are in the US. If energy is what you need for compute and is the bottleneck and there's unlimited demand for intelligence, then it stands to reason that if we have a lot less energy, then we will have a lot less intelligence or a lot less tokens or a lot more expensive tokens. If we have a lot more expensive tokens than supply demand, you're going to end up with less. And that seems very bad. To me, I think the energy bottleneck, however that is, it'll manifest in 20 different ways.
29:07Gas turbines go up and down, natural gas go up and down, and solar, whatever, all these different things, rare earths. That to me is probably more concerning. And if I'm thinking about it from a regulatory perspective or government perspective, and I think the administration is doing some things around this, fostering investment and development of all energy, solar, nuclear, gas, like whatever, do it all. We should do it all. And it'll work itself out. This is one of these things where, yes, one will be relatively better than the other, and I don't know, and I'm not smart enough to predict which one's which, but it'll all work.
Hardware Investing and the Cerebrus Story
29:39Speaking of compute, I would love to hear the Cerebra story. I haven't heard you tell the full version of this. The reason I'm asking about it is I'm deeply interested in compute. I have bigger investments in compute, and I'm fascinated by it. It's just like the most magical thing to watch happen. It's mind-boggling when you get close to one of these things, what humans have been able to do on these chips and in these systems. I think you invested in 2016 or thereabouts. I think it was your first foray into like extremely difficult hardware type investment. Shit's so hard. And now the world is full of opportunities like this, whereas back then it was a one-off.
30:14Teach me everything you've learned about hardware investing through Cerebrus. Mostly, it's really hard. It's an amazing example to me about the naivete required. The company came in in 2016. It was five founders and a deck. I did not want to go to the pitch, but it's my job because I'm like, why are we going to go to hardware investment? Like, it's crazy. It's been 10 years since we've made a semi-investment. I think basically the team was excellent. And then the kind of first slide was just like, GPUs actually suck for deep learning. They just happen to be 100 times better than CPUs.
30:46You have to remember, this is pre-Transformer. OpenAI is this weird research lab at this time. NVIDIA was worth like $40 billion, not $4 trillion. The TPU hadn't been announced. None of that. So this is early. But the whole idea, as soon as you said it, I was like, oh shit, of course. Of course. Like, why? I had spent the last 18 months trying to figure out applications of deep learning and looking at the security thing and looking at this medical imaging thing and like all this other stuff, thinking like, hey, there must be something here that's going to be really transformed
31:16by this stuff. Anyways, we go through this whole journey. We end up investing, which was amazing. We first met on Wednesday, part of a meeting on Monday, had a bunch of meetings in between. Just built a lot of conviction that this was a great swing. And I'll tell you what I understood. And I really just understood so little. But basically, there are three things that we know how to do to speed up deep learning and hardware. Still till this day. Increase the number of cores. Increase the communication between cores. Bring the memory closer to the compute.
31:47Those are the three things. That's it. Those are only three dimensions that we know in hardware. My articulation of what they said to me, honestly, all I understood was, let's just take all three of those things to their logical maximum. You have a wafer scale chip. At that time, you would have 450,000 cores on it. You'd have something like 20 gig of SRAM on the chip. So you never have to go off chip to get to memory. And because they were all in the same wafer, the communication between cores is maximized. So this is the best you could do on that process. And I think for the first chip was seven enemy or something. You're like, okay, that's it.
32:18That's what we do. And it turns out that in software, if you have that logical block diagram of like why it works and everything else, you're kind of 80% of the way there. And it's a matter of go-to-market execution. In hardware, you're like 2% of the way there. There's things like physics, entire supply chain of vendors. There's of course TSMC, which everyone knows, but it's not just TSMC. There's 30 other vendors that matter in putting all this stuff together and everything else. I didn't know any of that. Fast forward from 2016 to like 2019, I think they got their first parts back.
32:52You go through this like bring up and then it's like, bring up. Oh, yes, we got a part back. And then it's like, yeah, then you got to go through like, wait, bring up. And there's like 14 steps of bring up and everything else. And then by like 2020, we had our like first thing that works. Then it's just this march of actually getting it to work. One of the lessons that I've learned on this stuff is basically you go through all these SIMs and everything else in hardware and semis in particular. That basically is your roofline.
33:22The best it's ever going to be is what that is. And then every bit of software and reality and compilers and kernels takes away from that roofline. You might start at 10% of the roofline. Once you bring it up, you guys are grinding for months and years to like get closer and closer and closer to the roofline. It's really different. It's really hard. I'm astonishingly bullish if I kind of rewind. Part of the reason we made the investment was if you looked at the four prior generations of compute in my lifetime.
33:53So you had CPUs, you had graphics, the networking, the mobile. There was a new workload each time. So you had multipurpose compute and it led to the CPU. You had massive parallelism led to the graphics processor. Graphics processor offered massive parallelism, which led to graphics. Then with networking, you need really low latency chips. And so you had low latency chips. And then with mobile, you needed really power efficient chips. And in each case, we ended up with a new $100 billion company. The first question going back to 2016 was, is AI that big a new workload?
34:25Because there have been many, many other attempts for specialized chips for other things that really just didn't end up mattering. There's some fine outcomes, but they just didn't really end up mattering, et cetera. Right, exactly. And so it's just like, well, okay, well, you need something that's a really, really big workload. Okay, so that's one. We had a lot of conviction on that. And then two, was the nature of the workload, did it introduce a new constraint or problem in it? What I learned was basically the AI workload benefited from the parallelism of GPUs massively, but GPUs didn't solve the core-to-core communication, basically the layers of the network problem.
35:00You're like, okay, wait a minute. There is a new constraint, which is communication's communication-bound problem. Then you're like, okay, is AI a new giant workload that is going to have specialized chips? Everything that I just said was the entire, everything I knew at that time. And that's obviously played out. And in each prior generation, we got Intel, we got NVIDIA, we got Broadcom and Vago, we got Qualcomm and ARM in each of these generations. And there will be these giant winners, standalone winners.
35:30Obviously, the TBU itself is a winner, Traneum's a winner. You've had Grok and Cerebrus, Etch. It'll keep getting fought out. But I think that will end up being big. And actually, I think there's a new sixth one that's coming generation, which is, and I'm really excited. We've made an investment that's unannounced in this, but I think that for the first time in a long time, there's actually room for a new CPU approach. The thing that's happening right now, and you see this reflected in all the semi-stocks and everything else, is the LLMs, which are running on accelerators and GPUs, generate code.
36:04The code runs on CPUs, and right now it's running on classic CPUs we've had around forever. But there's a whole bunch of constraints on CPUs that have existed, and CPUs have dragged all this baggage forward that you might not need to anymore. And so I'm actually really excited about that possibly. The next category. The next category. Does the experience with Cerebrus make you want to do a lot more investing in companies? Fuck no. But why not? In 2019, we're sitting in a board meeting, and this thing is melty.
36:37It's like fucking melty, okay? And we've raised $500 million or something. And it's like, wait, what? It's melting or burning or something? And we're looking at it, and I'm like, holy shit. I realize like $500 million isn't that much in today's era, but I was just like, we're going to lose all this money. This is not going to work. And what that team did, insane. They're built differently. And I have so much respect and thanks to them for what they've done. There are efforts that make you really proud to be a venture capitalist because you're funding
37:09something that makes a difference and matters. I'm an investor because that's a means to work with companies, not because I fundamentally love investing or something like that. I like working with the companies. That's my favorite part of it. Working with teams like that and companies like that is so special on these giant, ambitious efforts. And I said this well before 2018 or whatever, is whether Cerebus worked or didn't, I think it was an effort that was worth venture capital. That was the kind of thing you should do. You should try to build something that people have tried for 50 years and have been unable
37:41to, but now we think we could do. And there's a reason and application for it and everything else. I love that. I do like those kinds of things, joking aside, and we do have a robotics company and then this CPU project that we're talking about. I think these kinds of things are actually really fun and interesting and good use of vendor capital, but they definitely aren't easy. The productive naivete that you described, Rare, is probably a virtue that you didn't know more than you knew, otherwise you wouldn't have done it. This is certainly my experience with Etch. Like in any of these fields, you ask experts, they're going to tell you, don't do it. It sucks. It's too hard.
38:11Base rate's too low. Young people can't do it. Oh, there's 47 reasons. Is there anywhere where that is just a bridge too far? That could be like bio or something like this, where you just are unwilling to invest if you're naive. You know, what's so funny is the hard thing about investing is most of the time, all of these stereotypical statements are correct. They're not correct three times out of four. They're correct 19 times out of 20, maybe 99 times out of a hundred. Like they are correct. The thing that Bruce, one of our founders always says, what could go right?
38:43We have to ask ourselves, what could go right? And do we see that path? Yeah. Young people can't build chips or you shouldn't do another selling company or you shouldn't do this or like whatever. All of that stuff is actually totally right. Except when it isn't. Apparently there's a saying that someone said to one of my partners, which was, if it doesn't work, it'll be for all of the reasons that your partner said. If it does work, it will be because those reasons didn't matter. It's just such a good example of this whole thing, which is, yeah, most of the time when
39:14we lay out the reasons that a company won't work, it's right. But then sometimes they just don't matter.
Robotics and Real-World Data Pipelines
39:20You and I are both interested in robotics. It's not controversial that if robotics works, it might dwarf what we're currently living through. What do you think has to be true for it to work? Obviously it's exciting. I want a robot in my house, folding my laundry. It sounds great. It's kind of one of these classics. It's always 10 years away and it's been that way for a long time. What do you see happening? What has to happen for this to actually be a thing in the near to medium term? We've had classics robotics forever and they're all over the place and they're on assembly lines and manufacturing lines and all those things where you're doing repetitive
39:52tasks in controlled environments. Repetitive tasks in controlled environments is like more or less solved and like that, you know, that'll continue to happen. But having tweaked tasks in real world environments, that's where you need the AI. That's where you need the AI plus the robots. The trick with it all is you need a model that can do that. Of course, the first problem is there is no internet scale data to bootstrap the whole thing, right? LLMs are all bootstrapped on the internet, which is a ton of human knowledge.
40:25And the equivalent for that, for robots, doesn't exist. And people are trying different things with videos and simulations and teleoperation. So like there's a lot of different ways. But if you kind of think about, take teleop as an example, how much you need to teleop robots to get to an internet scale data. This first step is like getting a good set of data to bootstrap the model. One of the, I think, insights that you can have is with the internet, there's like a lot
40:59of slop data. Even before AI generated all this stuff, there was also a bunch of junk data. And some data was more valuable than others. Like you may value, okay, certain things on Reddit more valuable than other things. You might value Wikipedia more than like other forums. You might value GitHub more than other things. And all of the model companies did that, right? They prioritized data that was more valuable and less valuable and ran that through the model. I think one of the most interesting things that these AI robotics companies are doing are saying, okay, well, let's just go after the high value data to start. If we go out for the high value data, then we can kind of bootstrap this model.
41:31Now, once you do that, then can you, through that pre-training process, get to a place where you can have very small auxiliary examples of data that you add in post-training and all of a sudden it works for that. That's the magic we have with LOMs is you have this giant pre-trained base and then you add a little magic on it in RL and post-training and you teach it a new thing that it wasn't in the pre-training set and you kind of go from there. And I think the exact same thing has happened in robotics.
42:03We're investors in Sunday Robotics, which is going out for this exact pipeline. It's a cool company. It's a cool company and they're doing household robots, but the key part before you get to household and all of that stuff matters much less actually than can you get this training pipeline to work and how do you do that? And one of the lessons I learned and I look back, I try to learn from history because it doesn't repeat, but it rhymes. And if I look at autonomous vehicles as an example, which is they're robots basically, they're AI plus robots.
42:34You look at Waymo and you look at Tesla. They were both designed vertically integrated in their own way. You have a Tesla, you had a fleet of Teslas that everybody owned. It was collecting data on the Teslas and it was used to train the models to drive the Teslas. Same thing with Waymo. I think part of the lessons is they gather very, very high quality data. They did their pre-training and then they worked off of that. That was a simplification to allow you to get to a complete product or a complete solution,
43:06which of course is going to continue to improve and ultimately will generalize. I'm sure it will generalize in some way. So you'll be able to strap it on any car and everything else. So I think the same thing is happening in robotics where you have companies like Sunday and others who are using techniques where they're vertically integrating the robot and the model, the data collection around the robot, Sunday uses gloves that are designed with the robot hands. So they're perfect. So you get very good data transferability from one to another.
43:37You do this pre-training and you have a great pre-training data set. You have a good model and then you start adding these examples and URL and post-train on top and you get cool emergent behavior. Do you have a most visceral moment? When we invested in Sunday the first time we saw them, partner Peter arranged a demo. We went down into the basement at Stanford Lab and they had like this totally janky cardboard glove thing. You see a few evolutions of it. The last time we saw a demo, we went down in the basement of their now office building
44:10and there was like a dozen robots just folding arbitrary lines. It wasn't in the demo. It was just trial and error. And then they have people like taking the clothes and then measuring them to make sure that they were folded properly and creating a rigorous baseline and evaluation criteria. And I was like, oh my God, this is happening. Do you ever worry about how to pick the right customer for these companies? Every one of these things folds laundry, which I don't think anyone likes folding laundry. So it seems like a good use case, but it feels like we don't actually understand the demand
44:42for what these things will be used to do. Do you ever worry about that? That we're sort of building solutions that will then be in searches of problems? I don't. And I'll explain why. And it's certainly informed by watching the LLM evolution. Some of the people who were involved in the early LLM at OpenAI really understood that code was going to be important. And obviously, you know, the Anthropoc team had this perspective that you could get to RSI if you've got code generation going and automating AI research and whatnot. If you think about it, the first use cases were very much language oriented.
45:16They were very much essay writing and editing and marketing. Like I think the first application that really took off was Jasper, which was just writing marketing copy. I think it's going to evolve a lot, basically. I think laundry is kind of a good task because it's arbitrary. It's complex. It requires dexterous manipulation. It isn't time sensitive. If it takes three times longer, so be it. Who cares? It doesn't matter. Just let it run all day. So I think it has like some of those properties. I don't think the task is actually that important. What I think is much more important is, are you pre-training an amazing model than being
45:51able to post-train on top of it and get that flywheel going? If you get that flywheel going, then the task capability will just keep multiplying.
Board Partnership and Growth Funds
45:59Maybe this question will be annoying or slightly uncomfortable for you. But if you ask basically every founder and critically other investors of your type, almost everyone, if I ask like who's the best board partner, we'll say you. You come up way more often than anyone else that I've come across. And I'm curious why you think that is. What it is that you're doing that other people, the incentives are there to do a great job as a board partner. What do you think you're doing on the boards of these companies, partner with the founders
46:30that's actually different from other really talented investors who are also nominally doing the same job, but don't come up nearly as often when asked that question? One of the things that I've realized is we each are attracted to different types of entrepreneurs where we have chemistry. I'm an investor second, and I try to be a partner first. We'll see companies come in. We had one come in yesterday, and it's what I would call an investment-grade opportunity. You can invest. It probably works. You make money. It's good. And an investor would do that.
47:01A partner wouldn't because that's not sufficient for a partner. Unless you have real chemistry with that person where you feel like you're going to be able to work together really effectively, and I'm going to learn a ton from them, and they're going to learn something from me. Together, we're going to just feed each other's loops. Unless you feel that way, you can't be a partner. And so you pass on that. That's a really important fit element to me. It kind of starts with this mutual selection, actually, weirdly. They want to partner with us, and I want to partner with them.
47:32I'm really looking forward to working with them together. And I'll give you a really good example of where this comes into play for me. If I take Saji and Benchling, Benchling is life sciences, SaaS, companies absolutely crushed, done really, really well. And then, of course, you have this biotech crash and everything else, and the company became grindy. The company had never had any churn for the longest time, such that even on their reports for every SaaS company, you have this like, okay, gross ARR added, churn line, net ARR
48:05added, like everybody does the same thing. They never had a churn line, never reported it for the first of like six years that I worked with the company. So then they got seven years of churn in like 12 months. Turns out life sucks when you get seven years of churn in 12 months. Through that grind and through it all, and related to the whole, wait a minute, the goalpost moved. We have to do something different, everything else. They kept thinking about how to apply AI for these biotech and pharma customers, which they're very close to. How can we make it better for them?
48:36How can we apply these models in their world in a way that they're excited about and continue to iterate? And it was grindy and I was there for it. You're excited to work with that person because like one, of course you think it's a really special opportunity and there's a way out, there's a path and we can find it. But two, because of the joy of the game, the relationship and like everything else, like that's part of it. It's very different. I've seen different models and lots of different models of venture capital work. Moritz was a writer. Door was a sales guy.
49:07Gurley was an engineer. Peter's a career venture capitalist. They're all different working with them. It's like when I call these people, I learn something and they push back on me and then I ask them questions. And what I've realized is like so much of my job is they know the answer. They know what they want to do. They know the answer. And it's maybe asking questions of them to maybe help solidify their conviction or solidify their articulation of what they want to do and why. And you just keep doing that through that process.
49:38Hopefully, we get 1% better a few times a year. We make a 1% better decision, 2% better decision a few times a year. And if you do that over a decade, that compounds to real results. One of the questions that I ask myself before making an investment is there are all these people that I care about through my life, like you care about yours. Could I talk one of them into going to this company and honestly, intellectually, honestly to myself, explain to them why this could be their life's work?
50:12And if I can't do that, I should not invest. It just means that the project doesn't line up in that way. And so as long as we have one of those things, it doesn't matter that much what it is to me. It's just, it's important. It could make a big dent. And if it can make a big dent and it's a special person, I'd love to work on it. Are there any other questions like that that you ask yourself before investing? That's a particularly good one. The other question, if this person calls me at 9 p.m. on a Saturday night, will I pick up the phone? That was at the green button test. Yeah, yeah, yeah. It's a chemistry thing.
50:42And they have to feel the same way, obviously. One of the other ones is if it's right, does it matter? Which is different than this like first one, but it's, there's so many things that we could be right on as a business. I looked at one last week and I told an entrepreneur, I was like, I really think that you can build an amazing company here and you just shouldn't raise venture capital. But there's like so many things that you can be right on, but they ultimately just don't matter. Like nobody cares. That's a better way to say it. If we're right, we'll let many care. If they won't care, then you're just not going to build enough equity value.
51:13That's another useful one. One of the coolest things that's happening right now is all of that that you just described has higher stakes and more leverage attached to it, which is manifested most simply in more dollars and higher prices. You and I have talked about this notion of what high multiple on invested capital investing is like and what it has been like and what it's moving into. You did something recently, which was you raised a growth fund for the first time in a long time. I think that is related to this concept. These companies need more capital. The prices are higher. The outcomes are bigger. Maybe we can earn the same multiple on a billion dollar entry price that we could on a $50 million
51:47entry price 10 years ago or whatever. Can you talk through that evolution? Talk through the partnerships, like way of thinking about it and talking about it, what you believe to be true that results in this decision to do this? Just go back to like why did LPs starting with Swenson and everyone else, why did they start investing in venture capital? And fundamentally, it wasn't because they thought they could beat the NASDAQ or the index by like three percentage points a year, five or whatever. It's because there are situations where venture capital could drive these insane multiples on
52:19invested capital. From a financial perspective, that's what they're seeking. For the longest time, for most of the industry's history, two things were synonymous, early stage investing and high cash on cash multiples. The way to get high cash on cash multiples was to do early stage. That's it. Those two circles in the Venn diagram like almost perfectly overlap. The thing that's changed is recently, relatively recently, in the last few years, because outcomes have gotten so much bigger and these markets are bigger and everything else, the circle
52:51of high cash on cash multiple opportunities is bigger than just early stage. And it's not so, so big that there's a gazillion new companies in there that you can generate 100Xs on. That's not true, but there are certainly many outside of early stage where you can generate high returns. That's it. I think that's what we want to go after. You could argue we're a few years late. I think I'd take that criticism, but I think that opportunity exists on a go forward basis. We should go do it.
53:22Everything else that we represent, which is the high conviction, high commitment partnership, that has to still be there. As part of that discussion, what were like the other sides of the debate? Such as, maybe we would have said the same thing in 99 and halfway through 2020. As markets get exciting, the possibilities, we all do this extrapolation error. What were the counter arguments to like, let's, despite all that, still not do it? I think the biggest counter argument that really made this time right versus two years ago or whatever was you need the team that can do it.
53:54It's just a different mentality. There are differences in how you evaluate and think about things. All the other stuff where there's, you know, why not change and stay within your circle of competency and all those things are true, but that was like the biggest one. We had several examples over the last couple of years where we had, I think, the right intuition on a company or an opportunity. We didn't do it. Because it was outside the box. Because it was outside the box. That's obviously dumb. And I think it is quite different than a lot of, than she does.
54:24We are really chasing these very rare special companies that have like very high cash on cash opportunities where we think there just can be runaway successes and we can invest in them. Is there any lesson to be pulled from the many, let's call it 20 to 100 Xs that you personally have observed? I mean, it's such a crazy amount of return. Obviously, it doesn't pencil in the beginning. You can't make something pencil if it was that clear. The price would be different. What have the 20 to 100 Xs taught you in aggregate, if anything? Work with really special people.
54:55You want to work really hard. You want to work smart and get lucky. And you need it all. It really all has to come together. There's a lot of things that are timing dependent. You have no control over as a company. And you take the Cerebrus example as a good one, which is, this is our second, you know, we took it public this time in May, but we tried to take it public in 2024 and it would have been taken public at a much, much lower valuation and it didn't work out because of CFIUS and all this stuff. So timing matters. The advancement of that 18 months made all the difference in the world.
55:27For a bunch of things that were honestly outside of our control, there were some things that were in our control, getting inference running and everything else, but there was a lot of stuff that was outside of our control. These are all the classic things. We just got to focus on what you can control. That's one of the things that's really different than software companies. With software companies, aside from like building on AWS or whatever, you pretty much own your whole stack. And so you're really fully in control of your destiny in that way. With hardware companies, you don't. There's an entire supply chain and all this other stuff. HBM's a thing. DRAM's a thing.
55:57And TSMC's a thing. And a lot of those cross geopolitical borders. And so geopolitics gets involved and that makes that complicated. That's a really big difference. And so you got to get lucky on the timing and macro and other stuff. But I think it really starts with working with these crazy people with unbounded opportunities. And if you work with these crazy special people on unbounded opportunities, you get lucky from time to time. You're bound to. When I was 20 years old, I was working at an investment bank. Ben Horowitz, Mark and Ben, had started LoudCloud. It was still in stealth.
56:27And Ben gave me an offer to be his assistant. I was talking to this associate who seemed like this elder at the time. He's probably 25. He said this thing to me, which stuck with me. He was like, do you golf? It's like classic banking question, do you golf? No, I don't like golf. But he's like, with golf, you keep on practicing, keep getting the ball in a three-parter, like close to the pen, close to the pen, close to the pen, close to the pen. You keep getting the ball close to the pen and you keep practicing. That's hard work. That's like working smart. That's what you want to keep doing. Getting the hole in one, that's luck. I kind of love that framing I use with my kids, actually.
57:00What it says is like, yeah, there's luck involved. And there really is luck involved. But there is actually a way to increase your luck. And the way to increase your luck is get a lot of balls close to the pen. Eventually, one will drop. I like that. Each of us invests in one to two companies a year. I think in my 12 years, I've invested in 18 companies total. Which is a relatively small number. So it's a very high conviction and very high commitment. I have a lot of skin in the game. I believe in these companies. If you keep on working with these very special people in these opportunities, magic can happen.
Going Public and Market Debates
57:33What have you learned about the best reasons and conditions for going public? Bedford does these Monday night dinners. And so we had a CEO last night, multi-hundred billion dollar private company. And we had this whole conversation. So it's kind of fresh. I think that ultimately, when you go public, you have a range of new opportunities in what you can do. Public trust, because there's some transparency that comes with being a public company. You obviously have a currency that you can do things with that ends up being there.
58:06You have an unbelievable ability to raise capital, which I think is why the labs will ultimately go. Although I think the trust thing is actually a really important element of why they should go. And it's beneficial to the world and to America if they do go public. It's like, okay, yeah, see what's going on. Everyone can see it. I think that's like a really beneficial setup. There's another element of it, which is what does a collegiate athlete want to do? Go pro. They want to play at a higher level. Is it harder? Yeah, it's harder. Is the competition tougher? Yeah, the competition's tougher. They move faster. They're tougher. They're bigger.
58:37They're stronger. The stakes are bigger. The stage is bigger. The scrutiny is bigger. All of that's true. It's kind of the same thing with companies. There are a handful, and it really is a handful, three, four, whatever, that can get to this tremendous scale without going public because things have gone through their execution and excellence. Lots of free cash flow. Dave, lots of free cash flow, and they've done really well over a really long time. And I think that's fantastic. Good for them. But in general, for everyone else, get out there. The other thing that I would tell you is there are windows for a particular type of company.
59:12The SaaS companies that went public in 2021, a whole boat of them have struggled, and it's been tough in the public markets because their stocks ripped to this multiple compression issue. They were trading at 30 times. They've forexed in size, but now they're trading at six times. It turns out you're under still. That's a tough place to be. I will also tell you that there's 500 something, probably SaaS companies that are between 100 million and 500 million that are private. What happens? Those employees never got a chance to sell. Those employees don't have annual tenders.
59:44Those employees don't have an opportunity to exit. Those investors don't have an opportunity to exit. They're stuck. I don't think they're all going away, and as I said, I don't think they're all getting vibe-coded and everything else. But ultimately, the AI natives, with their growth rates, have sucked all the oxygen out of the room and all the interest, and the window was missed. That's tough. What are the biggest debates right now inside of the partnership? I always love coming here and talking to you guys when there's something interesting going on because you debate. It's healthy. It can be really fun to watch, and I learn a lot from it.
1:00:17What are those debates today? There's a ton of debate around, in this AI, infra, apps, for foundational models, infra, apps, ecosystem, where does value accrue, and how does it accrue, and where are the modes, and how do we think about that? But also, the business model innovation. I think one of the things people don't understand about why SaaS did so well versus traditional software was it wasn't just that it was a better delivery model and everything else. There was actual business model innovation on it. You really did have this subscription element that ended up being fantastic for both the
1:00:50company and the customers. It was a win-win situation. That same thing actually exists in AI and selling by outcome and that piece of it. But then wrapped up into that debate, discussion is how much value just accrues to the labs. How much of the value just accrues to the semis? That's a real discussion. What do you think? Like, I am of the view that it all works. It's a very weird thing. Will the CSPs do well? Yes. Yes. Not all of them, but will some of these neoclads do well?
1:01:22Yes. Will the fireworks of the world do well? Yes. Will NVIDIA do well? Yes. Will these chip startups do well? Some set of them. Yes. Are we going to have edge inference on our phones? Yes. Are we going to have near edge inference on POPs? Yes. Are we going to have big models and data centers? Yes. There's so much zero-sum thinking, which is just like, okay, how do we cut up this pie and they're going to eat this much? And like, oh, no, no, no, no, no. Anthropic or whomever is going to eat 98% of the value and they're going to do all the
1:01:52drug discovery. And I was like, come on. No, that's not what's going to happen. When I say, like, I think everything's going to work and I listed off all these other things, it's really important to understand that doesn't mean that every company that's doing every one of those things is going to work. It actually means quite the opposite of that. Most companies in each of those areas are not going to work. And it's actually more important than ever to have real differentiation, to like really take each of these thoughts to their logical extreme and understand, wait a minute, you got to go all the way on these things and really be differentiated on it.
1:02:22Is there anything that you have your eye on, whether it's in the funding market, in the technology world, anything at all that you really are watching carefully?
Healthcare Realities and Economic Fallacies
1:02:29It's actually funny to me. Some of the people are so, so smart and yet they're in this tech world where they're like reaching these deterministic, almost conclusions of like mass unemployment and all of these different things. I'm going to give you a really concrete example, which I think is just so good. Take Jeff Hinton in radiology. So I think it was 2016 where he was like, we should stop training radiologists. AI is going to do it all better. Jeff Hinton's three orders of magnitude smarter than I am could not have been more wrong.
1:03:02But the actual thing that led him to make that statement and that conclusion was 100% correct. If you look at these radiology images, we should be able to train AI to do a better job reading these things than humans. And that's probably true. And actually, I think the studies and areas have shown that to be true. And we have an investment in a company called New Lantern, which is approaching this. But the big hurdle and the big thing that it articulated was like, wait a minute, first off, all of the aggregated training data set doesn't exist anywhere.
1:03:32What you see is companies going after like chest CTs or like very specific elements. But your typical radiologist looks at a whole variety of things every single day from x-rays to CTs to MRIs of all parts of the body and everything else. And so an AI climbing in specific areas like test CTs is very marginally helpful because it's only doing that one thing, which could be one of 20 things or 40 scans that they read that day. Problem number one, you don't have the data, just like we talked about in robotics and everything else to train the AI.
1:04:02Problem number two, the whole healthcare industry is oriented around reimbursing doctors for making readouts. How is that going to work? And there's liability associated with that and there's repercussions of getting something wrong or missing something and there's medical malpractice and everything else. How are we going to avoid that? And how are we going to get around that? Problem number two, real world stickiness. We're going to end up with this application where AI really does help radiologists. It helps radiologists get more and more higher, higher throughput because the AI can do some
1:04:33parts and the radiologists do some parts and they're checking each other and everything else. And you do kind of weirdly end up in this co-pilot situation for some time. And then you're going to slowly have the AI read more and more of the scans and build up and build up and build up. But the actual duration to get from here to there is going to take a long time. In the ensuing time, we need more radiologists, not less because, oh, by the way, everyone's getting more imaging than they used to get because the cost of imaging is going down in a Javon's Paradox kind of way. My point on it is you have someone very, very smart who really understands the capabilities,
1:05:07really understands what's happening, has the right data, but by not thinking of that data in the real world application comes to the wrong conclusion. And that's how I think of the unemployment thing. I think it's just, it's almost the exact same setup. Eric, I love talking about markets and companies with you. An absolute blast. Thanks for the time. Thank you. If you enjoyed this episode, visit Colossus.com. You'll find every episode of this podcast complete with hand edited transcripts. You can also subscribe to Colossus, our quarterly print, digital, and private audio publication
1:05:38featuring in-depth profiles of the founders, investors, and companies that we admire most. Learn more at Colossus.com slash subscribe.
1:05:55You know how small advantages compound over time? That's true in investing and just as true in how you run your company. Your spending system is your capital allocation strategy. Ramp makes it smarter by default. Better data, better decisions, better economics over time. See how at ramp.com slash invest. As your business grows, Vanta scales with you. Automating compliance and giving you a single source of truth for security and risk.
1:06:28Learn more at Vanta.com slash invest. The best AI and software companies from OpenAI to Cursor to Perplexity use WorkOS to become enterprise ready overnight, not in months. Visit WorkOS.com to skip the unglamorous infrastructure work and focus on your product. Ridgeline is redefining asset management technology as a true partner, not just a software vendor. They've helped firms 5x in scale, enabling faster growth, smarter operations, and a competitive edge. Visit RidgelineApps.com to see what they can unlock for your firm. Every investment firm is unique and generic AI doesn't understand your process.
1:07:00Rogo does. It's an AI platform built specifically for Wall Street, connected to your data, understanding your process, and producing real outputs. Check them out at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest. I've been learning more at rogo.ai slash invest.
More from Invest Like the Best

Ben Thompson on Big Tech, China, and the AI Boom Running Out of Money - [Invest Like the Best, EP.487]
Aug 18, 20261h 16m

Gavin Baker - AI Market Jitters - [Invest Like the Best, EP.485]
Aug 4, 20261h 5m

Sam Altman - How to Make an Abundant Future - [Invest Like the Best, EP.484]
Jul 28, 202653 min

Matthew Smith — Natural Gas: The Next Bottleneck - [Invest Like the Best, EP.483]
Jul 21, 202656 min

John Kim - How to Raise a Few Billion Dollars - [Invest Like the Best, EP.482]
Jul 14, 202650 min