Show notes
Check out Gemini Audio: Every time a new AI model drops, companies face the same dilemma: Figure out what’s new and how to use it, or focus on getting work done. Every solves this dilemma with a frontier team: a small group that tests new models and turns useful experiments into tools and workflows for the rest of the company.
Highlighted moments
The reason why you need a frontier team is it separates things out. So you get this nice separation of concerns where you're both keeping up with what's going on on the frontier, and you're actually getting your work done.
“Pirates are people like me who are just like, I just want to like go really fast and I'm going to do stuff that's it's kind of be a little bit sloppy, but I'm going to try like a billion things in the in the space of a couple days and I'm going to figure out what's useful.”
“So I made up my own job title, which is very me. But it's head of evals. So what that means, evals is short for evaluations. And so it's my job to kind of take the kind of vibe checks that we've been doing with models that are more like qualitative and then try and put some numbers behind them.”
“I asked Opus to go back through all my Slack messages, go back through all my granola notes and then pull the narrative of the video together with receipts or like with references to the specific things that I'd said in Slack or in meetings.”
Transcript
Why you need a frontier team
0:00You need a frontier team. Here's why. Every single person in your company is caught in this dilemma. Do I get my work done? Or do I stay up to date with AI and figure out what all these new tools and workflows mean for what work I should do? That's just crazy. It's so hard to figure out. Every single company is struggling with this right now. Because, I mean, on the one hand, you could ignore the frontier, and that'll probably work for a little while until you get disrupted by some agent-native version of your product that you didn't see coming. Or you can keep up with the frontier and just chase shiny objects and never build anything that lasts.
0:37The reason why you need a frontier team is it separates things out. So you get this nice separation of concerns where you're both keeping up with what's going on on the frontier, and you're actually getting your work done. And I had my co-host, Natalia. Welcome, Natalia. Hey, Dan. Good to be here. Who is our head of enterprise AI adoption. Come in and do a little bit of digging into our frontier team. So we've been running the frontier team at Every for, I guess, a couple of months now. And it has been kind of transformative.
1:09And I think Natalia is one of the best people to come in and take a peek and be like, what are we actually doing? So actually, I might turn the tables a little bit to you, because it was your idea to have a frontier team. Yeah, I mean, yeah, the frontier team, I think, has been a huge unlock. And it's because of this separation that I've been talking about. I think there's so many people at Every, like me, who just love playing with new things. And that's super important. But if that's all you're doing, then you're not going to make progress as a business. Like, you actually do need to go execute on products and services, things that people can rely on.
1:43And it felt like we needed to choose one or the other, either just like constantly be playing with new stuff or make a product that we just build once and then we add features to and we support forever. And the frontier team was in a sort of an attempt to say, OK, what if we take all the people like me who love all the new stuff and we just unleash us to just run experiments? And at the at the, you know, at the low end, the experiments are just they're just really good content.
They just teach us something interesting and they become good tweets or YouTube videos or anything like that. And then on the high end, they they get pushed up from from the frontier into the products that we build into the services that we offer without the rest of the company feeling like they always have to be paying attention to every single model that drops in every single new experiment that we're running.
2:28So I felt like it's allowed me and the other people on the frontier team the space to just figure out what the future looks like without forcing that on the rest of the company until it's actually ready for them to pay attention to it.
Pirates and architects
2:43Now, one of the things that you seem to have figured out pretty early in the formation of the frontier team is that you wanted to have both pirates and architects. Can you describe what that is? I think there's two archetypes that work really well together, pirates and architects. Pirates are people like me who are just like, I just want to like go really fast and I'm going to do stuff that's it's kind of be a little bit sloppy, but I'm going to try like a billion things in the in the space of a couple days and I'm going to figure out what's useful. But it's going to be a mess.
3:14Architects are people who are really good at being like there's a whole big messy thing.
3:20What would it look like to compress it a little bit and form it into a shape that actually works that that we can actually use? Because what we try to do with on the frontier team is we're experimenting with lots of stuff. Most of that stuff gets thrown out and some of it ends up getting pushed into the rest of the team to see if the rest of the team likes it. And at that point, like there's a point right before we do that, that an architect becomes really useful to come in and say, like, this is messy. We can't actually maintain this and it wouldn't work for these five different ways for the people internally at the company and helps turn it into a system that we can actually understand and build on instead of just being like a kind of one off vibe coded project.
4:02Dan, what do you think is has been the most impactful thing you've seen about having a frontier team at every? I think it lets us it lets us move incredibly quickly on what's new without distracting the whole team. And that has a deeply it's like confidence building for the team because you feel like, hey, I'm going to know when things change. We're going to we'll be able to handle it. And I'm not feeling crazy and frazzled and distracted all the time.
4:33And I think that is like the core important thing that affects the day to day experience of building and working and running a company in this environment. Absolutely. Thanks, Dan.
Head of evals
4:44Thank you.
Head of evals
4:45So, Mike Taylor, welcome. We're so excited to learn about the work that you're doing on the frontier team as the head of evals. So can you tell us a little bit of what you're doing as part of the frontier team? Yeah. So it feels like it's different every week or maybe every day, sometimes every hour.
5:16But the the goal of the frontier team is really just to kind of push the models to the limits and see what is now possible and like what is a new way to work, given that the models are constantly getting better. And there's still a lot of capability overhang. What I mean by that is the models are able to do much more than we have had time to try. And so we're trying to like find those edges. And specifically, what is your title as part of the frontier team?
5:49Yeah. So I made up my own job title, which is very me. But it's head of evals. So what that means, evals is short for evaluations. And so it's my job to kind of take the kind of vibe checks that we've been doing with models that are more like qualitative and then try and put some numbers behind them. So I've been working with a lot of the team to help them build their own personal benchmarks, including with you. And, you know, we're trying to roll that out as like more of an internal product initially to get more people involved with testing the models.
6:25And I can talk a bit more about that, but also just running more experiments. Like when we say that AI is sycophantic, like what do we mean by that? How do we define that? And can we test that? You know, those sorts of things. And then just also just like pushing it a little bit further. And so what are you most excited about now? Yeah, one of the things I've been finding more is that Opus is like very good at video editing. And this is, you know, maybe obvious to some people who have been testing it, but I've been testing AI on video editing for a while.
7:00I have a popular Udemy course and it's like the worst part of that side project is having to edit the videos afterwards. So for me, I've been testing a bunch and it's like finally working. And that's opening up a lot of like a lot that I can do that I couldn't previously have done. So one of the things I did recently was I made an explainer video for the Chex product, for the personal benchmark product that we're making. I asked Opus to go back through all my Slack messages, go back through all my granola notes and then pull the narrative of the video together with receipts or like with references to the specific things that I'd said in Slack or in meetings.
7:41And then it like cut that whole video together and like then I had an explainer video. So I feel like that that's opening up a lot for people who are like me, who may be too busy running experiments to ever like tell anyone what we're doing. So cool. Can you show us an example? So this is the one I was talking about. So this prompt goes back a really, really long way. But I went back and forth with Opus on this. And initially it was in UltraCode, which if you don't know, is like one of the settings that is like the highest effort setting.
8:18And so it will use hundreds of agents basically that it's orchestrating to do the task. And the reason I chose UltraCode for this is I knew that I had a lot of context that I wanted it to read. And like one model can't read all of that context. So what it does is it sent hundreds of agents, you know, one agent per meeting that I had and then pulled everything back into this like library essentially. These are all the sources, right?
8:48So you can see all the different calls I had with different people and it found all the ones that are relevant. But now we have it all. We have this big library of sources. But it didn't just do that, right? Like it also then created this story spine, which is like it tried to boil it down to what is the narrative? Like if someone doesn't know the Chex product, what is Chex? And it boiled it down to like these 12 sentences. So like personal benchmark is a small set of your own real work saved so that AI models can run on it again.
9:19So that's the definition I just gave you earlier. But now we have like the receipts, right? Like I can click in and see like where did that sentence come from? Back to the insight card and then from the insight card back to the specific things I said in meetings. So it's all auditable. And then, you know, it puts everything together. And then we have this explainer video, right? Yeah, so the interesting thing is, so like see all these screenshots? Like it went and found those screenshots from my Slack.
9:50These are things that I shared, you know, and then like it put everything together. It annotated the screens. It did the voiceover. It used Google Gemini. I gave it a Gemini API key. And so these are the 12 sentences, but like shown in video form. And that is, again, pretty amazing. And then I can share that with the rest of the company. And then now they understand like, oh, yeah, a score is a count of yeses, right? So like now they understand the checks product. So maybe last question for you would be, you know, as head of evals, you're evaluating a bunch of models.
10:26You're seeing what actually works, what the new capabilities are. What is like the cheat sheet that you could give someone? I know it's like late October 2026. So this might be outdated in a matter of days. But what's the, can you give us a cheat sheet for what we should know about using models today? Yeah, so what is my cheat sheet? So I think one thing that people are not doing enough of is just giving all their context over to AI. I think previously, if you've tried this in the past and you've asked AI to look through your call notes or, you know,
11:00maybe been hesitant to give it access to your Google Drive or whatever. And I was that person like earlier in the year. I didn't have it cooked up to my Gmail or my Slack. And living within the every community, like being in the team, it's like now I'm like full on. Like AI has access to everything. And I would say, like, just make that leap because it's amazing how good it is at picking out good context once you give it access. So I'd say like that's gotten so much better and people need to do more of that. And you can trust it more to use its judgment in what it brings into that task.
11:34The second thing is that I feel like it's your job, like now that you're producing a lot more, hopefully, if you're using AI more, it's your job now to protect other people's context. So I'm like regularly accused of saturating the company LinkedIn, like every channel I'm posting in. It's like Mike, Mike, Mike. And I'm really conscious of that. So creating that video, you know, creating more videos like that, making the work that I'm doing more digestible, I think is now actually my job.
12:05I'm coming up with good ideas. I'm giving it to Claude. Claude's finding those ideas more automatically for me when I've said them. But now I'm like flooding people with new ideas. So that's the other part that I'm working on. I think that that's where a lot of people's jobs are going to go. Super cool. Thanks so much for joining us, Mike Taylor. Yeah, good to talk to you.
The frontier wrangler
12:26So welcome, Arielle. So excited to have you. And can you tell us what your role is as part of the Frontier team at Every? Yes, I'm officially the Frontier Wrangler, which means that I help make sure that our experimentation is in some ways organized enough for us to then harvest and synthesize learnings and digest it for the outside world and direct our exploration internally. So I work on the systems and processes that allow us to do that internally, and I partner closely with Dan on that.
13:00And then I'm also running my own experimentation. So unlike other folks on the team, I'm less technical, but I'm an operator. And so there's a lot of interesting opportunity for practical systems that we can experiment with using some of these new tools and techniques on the inside that I'm playing around with pretty consistently. Why does the Frontier team need a Wrangler? I think one of the cool things about working with folks in the org is that everybody is a meta-thinker.
13:37People are so creative, and they're so excited to just sort of chase the next thing. And that's great. We need people like that. And then we also need an organizational layer to say, like, what are we learning from this? And how can we actually digest everything that's coming out of these experiments for our audience? And so I think it's pretty important to have a layer that basically looks at everything that people are doing, maps it to digestible themes, and tries to find some of the meaning in all of this experimentation,
14:13and then creates a layer that allows us to turn it into content and products and even concepts that we're teaching in consulting. So it's a way of, like, harvesting all of this and then translating it into other areas of the business. So what are you working on now? With all of these models coming out constantly, the Frontier of AI capability keeps pushing forward, and that's really exciting. That also means that there's so much to play with and experiment with that we are constantly burning through tokens like Wildfire.
14:45And that's an important investment in our business and experimentation, but also understanding at a meta level, like, what experimentation are we doing? How much money are we spending on that? And what are we getting out of it in return is pretty important. Can you show us an example of kind of like a recent, like, insight or maybe process that you've tried to apply lately in your job as a Wrangler? Yeah, definitely. So this is what the usage dashboard looks like.
15:17Some of this is going to be a retrospective because we don't have a full month of spend for October yet. But what this basically allows us to do is understand, like, what is the total dollar value that we've spent? What are the tokens? Like, what's the token count that we've spent it on? And then there's actually a breakdown by person. So we created a skill that looks, you know, across all the different harnesses that you're using on your computer to harvest. These are the tokens that you used across each of these harnesses.
15:52You can also click in and see there's, we're collecting data in real time. So it gives you the actual, like, model and effort level. And this dashboard also includes a workflow that basically looks across all of your sessions and categorizes at a high level what you spent those tokens on and then runs it by you for approval so that you can see, you know, both the percentage share of the work, of the sort of token spend
16:28that's gone to each different work bucket, and then what the estimated dollar value of those tokens are so you can make a sort of quick calculation of, like, oh, like, was that worth it or not? All right, and Arielle, maybe last question for you. What are you most excited about next as the Frontier Team Wrangler? I think what I'm most excited about is as these models get smarter and smarter, my ability to actually build, like, the capacity for that grows. It's not a power that I've had before, and it feels magical, and it feels really exciting.
17:01And being able to take some of the ideas that I have and will them into existence is actually a totally new thing. So in my previous life as an operator, I would have had to wait for different model companies to add this kind of tracking capability that I'm looking for, or I would have had to partner with an engineer to do any of this. And now I actually have the ability to create some of it myself. So what I'm looking forward to is as these models get better and better,
17:31my capacity to actually build systems to do this work for us gets better and better. And I'm really excited about diving into that. I'm excited to see you, Arielle. Thanks for joining us, Arielle. Cool. Thanks so much. One of the great things about working with AI is you can just talk to it now. If you're interested in groundbreaking voice experiences, you need to check out Gemini Audio. Gemini Audio is the new voice models from Google DeepMind.
18:03Gemini 3.5 Transcribe turns speech into clean formatted text. If you say, let's meet Tuesday, no Wednesday, it'll detect the correction and handle it automatically and remove filler words. There is less cleanup between a rough thought and something you can actually use. And now with Gemini 3.8 Live Extended Thinking, you can talk through more complex work. It can reason and speak simultaneously, which keeps conversations going while it's working
18:33in the background on your behalf. You can even ask follow-up questions and give feedback as you go on together. It makes voice a useful way to develop an idea. With room to change your mind along the way. You should check out the link in the description and learn more about Gemini 3.5 Transcribe and Gemini 3.8 Live Extended Thinking. And now, back to the episode.
Building a custom browser
18:58Yeah, so I'm Jack Chang. I'm a senior editor at Every. And yeah, part of the Frontier team.
19:09I think my role on the Frontier team, I think we're all figuring out what our roles are on the Frontier team. And, you know, I've definitely been testing more of the early access models that we've been getting. And something I've really started doing more of there is basically just like creating these like interactive experiences and games and things like that. And to just really like try to push out like what is even capable now with, you know, each new model release.
19:45Like what can it do that it maybe like wasn't good enough? Like it wasn't good enough that I would even think to try with a model before. And so lately that's kind of meant I'm just like creating video games and things like that. And then the other piece of it is just actually like making my own applications. So, you know, I was finding that I was really getting overwhelmed by my browser's like tabs and being constantly forced like context switch.
20:20And I was like, well, wouldn't it be nice if I had a browser that didn't have tabs and that you could like turn off the tabs?
20:29And I think before I would have maybe like built a Chrome extension or something like that. And but now like the models are so good that I was like, no, I can I can just build my own. So here is my browser, basically. Yeah, like I mentioned, it's a tabless browser. And that was the originally like intent is to, you know, have this browser where I'm not sort of like tempted to, you know, switch tabs and open things in the background and like never, you know, get to them.
21:01But like once I had this going, I was like, well, you know, a lot in order for me to use this day to day, I have like, you know, my whole editing workflow that I normally like use ChatGPT in the browser for. So basically, I added this agent pane that could let me like pick any, you know, any model provider and use any model for editing, which, you know, I couldn't really even do with Claude and the Gemini models because their plugins for Chrome weren't as good.
21:32But there are things like, you know, like just in sort of daily use, I'm like, oh, there are times when I actually do need to like peek at something. And so the latest thing I added was sort of this kind of like peek mode where I could like very quickly temporarily open up a page and then like, you know, like, like look up something and then go back to my document. And I think like what I'm starting to learn with this is just the way that like, you know, I think we had this concept of like plugins and extensions and for a while.
22:08But like those things never really let you get close to the actual like application and changing how the application worked. And now with sort of the latest generation of like frontier models, it's really like possible to build this like, you know, fully like personalized to you or personalized to your team and their workflows application that you couldn't, yeah, you couldn't do before. All right. I think maybe a good closing question might be, um, what are you most excited about building next?
22:44I think, um, I think I'm most excited about, um, building more things that help basically like protect my attention. Um, and I think, you know, like with all this, um, like, like, first of all, it's like, I, I have, uh, you know, I have ADHD, um, have a diagnosis of ADHD and that's always just been a huge challenge throughout my life. And I've kind of had to come up with like, like these like adaptive strategies throughout the years in order to manage it.
23:19And, and I think like now, you know, it's even more kind of like tempting to kind of just like try to do a million things. And, um, and, and, and yeah, and I do feel like I, I am like doing much, so much more now, but at the same time, I've never felt such strain on my ability to focus and ability to like keep my attention, um, on something for long enough that, you know, that, um, uh, it's, it's sort of, yeah, for, for long enough that I think it, it makes a meaningful difference, uh, in my life.
23:54Um, and, you know, experimenting and experimentation is definitely like important to me, but I think there's also this other side of me that's like, yeah, you know, I want to build things that like help me write more, help me like create more beautiful things in the world. Um, I want to build things that, you know, connect me closer to like my local community. Um, and so really like thinking about it, not as just like building something for creativity sake, but like doing it in a way that like also helps, um, you know, reinforce and serve and deepen my values.
24:35Wonderful. Thank you so much for joining us, Jack.
Compound writing
24:37Welcome Katie. Uh, so excited to be back on the pod with you and to be talking about your role as part of the Frontier team. What do you do in the Frontier team? Yeah. So there are a couple of different things that I do on the Frontier team. Um, number one, I'm on the, you know, is I'm on the, the testing team for the new Frontier models that come out from OpenAI, um, Anthropic, Gemini, Gemini, Grok. We, um, you know, we are on the test where we get early access to these models.
25:09We're putting them through our workflows and just seeing, okay, what is it like to use this model? Um, so we can turn around and pass that information along to the people who read our vibe checks. So that's kind of one of my lanes. The other lane is writing the vibe checks themselves. And in other ways, kind of like sharing out what we're learning on the Frontier team. So I'm kind of like the resident writer embedded inside the Frontier team to write about, um, what the Frontier team is learning. And then I'm building stuff myself. And that's where stuff like my plugin Compound Writing comes in.
25:43That's, um, where you, using new models, um, that are fine-tuned for writing comes in. And that also includes, um, crash test driving, being a crash test dummy for some of the things that other people on the Frontier team are building, like Kieran and, um, Mike as well. And can you give us an example of something that you're working on now? Yeah. So right now I am, I'm continuing to build out Compound Writing. Uh, and so for folks who don't know, that is my plugin that sort of takes you through the writing process.
26:16From ideation through planning and outlining through drafting to finalization. Uh, and the whole thing is, up to this point, has been built around two core documents. The voice guide that captures how your voice sounds on, like, a sentence level and, like, the word choice that you use. And then style.md, which covers, um, what you, what you write about, how you like to talk about your subject matter. And right now what I'm doing is I'm adding a third document, which actually, in hindsight, feels very obvious to the writing process.
26:50And that is audience.md. Um, so that, so who is the reader that is ultimately going to be receiving this content? And so I'm adding that to my plugin and saying, okay, how does this change the, the experience of using this plugin? And doesn't make it more, more useful. So I can share my screen. And so for anyone who's not familiar with, uh, Katie Parrott's compound writing plugin, you can find it on our GitHub. And you can just point your AI of choice to the page and you can download it and it'll take you to this.
27:25Yes. And so what are we seeing here? So this is me setting up my audience.md for my column working overtime, which is where I write about my misadventures and regular adventures, um, you know, applying AI in my own working life. Um, so I wanted to set up an audience.md folder for, for that work that's specific to this column. Um, and it gives me this readout of who the working overtime audience is. So the, what the territory it covers, you know, the main reader being a combination of like the early seeker, who's kind of AI curious.
28:01And then that operator who's looking for like practical applications to their day-to-day work. Something I kind of baked into, um, how the audience.md is structured is the idea of a hero's journey, um, which I really like. Like every piece of reading should take the reader on their own hero's journey in some form or other. You're looking to enact some kind of transformation in them. And so I wanted to include that in my audience.md. Um, and then what that unlocks for us in compound writing, I went ahead and did a pre-bake where I just asked, uh, it to review my most recent working overtime draft for audience fit,
28:38which was my piece about how I accidentally made all of my context worse by trying to make it better. Um, and it's using, um, it's using the audience.md that I updated today to then give like an overview of what already works. So it says it's clear context gets an explanation. The fix is personal, not, um, universal, which is something that I've said that I don't like to prescribe things. I like to describe things. Um, and then, um, here is, um, where it loses the seeker side.
29:13So shit, and this is really good feedback. It's like, where am I not being accessible to people on the earlier side of that spectrum that I might want to be reaching? Um, so this is really good stuff that I'd want to engage with. And then some smaller operator notes, like what was the damage, like what was the cost to me when like, I wasn't getting the results I wanted out of AI. So this is the kind of like higher visibility, like higher detail feedback and like high and like, like more value that I think we can bring to tools like compound writing to help empower people, like make better writing.
29:46Do you have a sense of what your next experiment might be? My next experiment, um, so well, I'll be working with Kieran, uh, on every type, which is his bid to get us all to stop using Google Docs. So I'll be sort of like test driving that and being very annoying in my feedback and my particular preferences as a writer. I'm also kind of like building my own word processor. I always, I joke, it's like a rite of passage. Like everyone at a certain point decides to vibe code their own word processor.
30:19So I'm like building my own word processor word better on the side just to, because it's easier for me to articulate what I want in a tool just to build it at this point to just build it myself. And then I can show it to Kieran and say, here's what makes more sense to me. Um, so that is kind of what I'm doing now, um, is like, I'm just on that part of my journey where I feel like I can build a better word processor than Kieran. So. Fantastic. I love it. Well, thank you for compound writing. I've personally really enjoyed using it and thank you for joining us.
The architect role
30:51So welcome Yannick. So excited to have you. And can you tell us what is your role as part of the Frontier team? Um, yeah, sure. Like I'm mostly working as like an architect, uh, on some of the projects. Um, I took over a lot of projects from Dan. Um, like I think my first project here was like working on proof, getting it production ready, um, getting it back to life, I would say. And, uh, nowadays I'm mostly focusing on like compounding, um, basically working on Cape Bench.
31:23Um, having like a skill which tries to replicate, uh, the judgment and taste of our editor-in-chief to, yeah, reduce some of her work, basically. And maybe tell us a little bit about that because I think a lot of people, you know, have tried vibe coding something, building a product, and then it can break in all kinds of ways. You're the person that gets brought in to kind of clean up the mess and see what's really there. So what's that experience like? I think AI is really good at like bringing something to life, um, just making assumptions, looking up what to use and just build something that, that looks good and potentially also works for that demo case or initial implementation.
32:09Um, but I think, um, I think there's like still need for like the architect role who has like that background knowledge, um, into like knowing how to build stuff that's reliable, um, that's like maintainable over time. Um, how you should like structure code, what libraries to use, um, how to deploy it, um, know like what's important on like the software side. And, um, yeah, to make it ready for the future, I would say. Now, can you give us an example of something you're working on now?
32:42Sure. I think like, um, I'm currently working on like two work streams. Um, one is compounding with like Cakebench I mentioned earlier. Um, and the other one is, um, more explorative where I see how should we work with AI. All right.
32:59So this is my orchestrator. Um, it's called Minga. And what I can do here is, uh, create a project. For example, I created a new project called Replyguy. Um, the idea is that we give, uh, a colleague, Becky, a tool which she can use to like explore what's trending on Twitter and basically reply to it with one of our new vibe checks, for example. And the main goal for this tool was I want to take the work to like a higher level.
33:33Um, so I want to work on the, on the level of like goals and like a plan, but not focus too much on the individual like coding sessions itself.
33:46And we have an orchestrator agent here. Um, that's like my main interface. So I can talk to that agent, um, discuss what we're trying to build, um, tell it like the requirements, what text like I want to use. Um, and it can take all of that and break it down into the individual tasks of a plan, basically. And this plan has like, uh, separate steps. It shows the dependencies, what needs to happen in which order.
34:18And, um, it has like some autonomy to kick off work in the background. Um, so it's like implementing it and whenever it needs me, it can, uh, ping me for like a decision, um, where it needs my input. It can show me like, um, drafts or mock-ups of some UIs where I can give my input on. And I just give it my feedback and it continues working basically by itself. Super cool. Um, thanks for sharing. Uh, what do you think your next experiment might be?
34:49Like for this week, I'm probably going to focus on this orchestration, uh, idea. There are like some, some, uh, questions I want to explore. Um, for example, the idea is that this could be like multiplayer as well. So you could invite other people from your team, um, or potentially even the whole company and have like a shared context of what you're working on. Um, and everybody can bring their strength. So like the pirate and architect, um, ideas, like the pirate can bring his ideas and what he wants to experiment on.
35:20And the architect can bring like the technical knowledge. Um, but like at the same time, so we don't have to like hand off the work after one is done, but we can, yeah, like build the same project at the same time with a shared context. Um, and everybody brings in their expertise. Great. Thank you so much, Janik. Really good to see you.
Experiments and integration
35:40Thank you. So welcome here in. So excited to be talking about the work that you're doing as part of the frontier team. What are you doing on the frontier team? Yeah, it's, it's really cool. I love the frontier team because I basically, when I started with every, I started building Quora and experimenting with stuff and out of that came combat engineering and so many more things. And I just felt this team was already there, but we never gave it a name and now saying, Hey, we're the frontier team.
36:15We're allowed to do experiments to, um, figure out what might work and what might not work. Uh, yeah, it's great. So what I'm doing now is, um, I'm just trying out what we can build with AI today. And that changes every time a new model comes out. I'm, I'm running an experiment every week, at least one, most of the time, multiple, and I learned something. And the big part is then to share what I learned with the team, uh, with every subscribers to make sure they can adopt or they can like direct whatever they do in the direction that I learned from.
36:58So that's the biggest part, inspire the team to do bigger things, to be more ambitious. And it's a little bit less scary if someone already did it and said, yeah, it's actually working. This is a good pattern. Or someone says, this is not a good pattern. You should go this other direction. So that's really my job to, yeah, go wide, but also go deep. It's, it's both. And I'm, I'd be curious, Kieran, you know, when you started playing with, uh, with the models, kind of like really testing what was possible.
37:31Could you give us maybe just a, could we back up and could you share an example of like how the capabilities have evolved in terms of like what you were testing, say GP3 for, you know, uh, GPT-5 for, OPUS 484 versus what you are now doing with the models that you have access to? Yeah, it's, it's every time something new. And, and the whole point is to see it fail. Like it's, it's like, how far can you push it, uh, until it fails? Like a lot of models are very good and they do a lot of things.
38:03So like the hard part is like, how do we test even whether it's good or not? And how far can it go? And in the beginning it was like, can it write code? Wow. It can write code. GPT-4 suddenly could like write pretty good code. And that was like the first unlock. And then we had Sona 3.5 that could write like code across multiple files pretty well. Like multiple pieces of code together and UI, like you could like create UI with it.
38:35Then we went a little bit further and started to see agentic work. Like models could pass work along. Like before it was just like a prompt in and then something came out and then you iterate on it. And the agentic work with 3.7, Opus 3.7 with 4.4.1, like suddenly the agents could do work. And with Opus 4.5, it shifted again to doing more complicated work.
39:08Like we could suddenly create like text editors with CRDT and like real-time editing and all of that, like which is very complicated. But suddenly an AI could just do that in a week. And you saw Dan make Proof. This was like the Proof era, like GPT-5.5. So suddenly we're like, oh, like we can be more ambitious. We can create bigger things without hand-holding too much.
39:39And especially with Fable now, with Fable 5.1, is that like you have a model that can run even longer, even more deep. You can trust even more. Like I'm a musician, so I always try to build a DAW. So I started maybe a year ago, and every time a new model comes out, I just try it again and say, hey, can we work more on it? And we're now at a point where I can just do that, which is insane. So maybe I should do a video editor because that's what we need.
40:13Could you tell us a few examples of things that you've built recently? So you are doing a lot of video stuff, for example. Yeah, my favorite is the video stuff. So I do a video editor, but it's not just a video editor. It's also like a live streaming, like a meeting recorder, like the whole thing that we have so many people at Avery that say and have such interesting ideas, but like they get lost in meetings. So this is also a way to record all of that, but also give that into a format that editors know, like, but also agent native, obviously.
40:50So everything agent native. And the other is an editor for writing. So this is also similar to like Proof, but we're like, I'm just experimenting. Can we make the next version of Proof? Can we make it better? Can we do even more? For anyone else who is on a frontier team, maybe at their company, right? Maybe it's a startup, maybe it's a large enterprise team. What is one tip that you would have for them about how to succeed as someone who's operating at the frontier embedded in a larger organization?
41:27Yeah, I think the most important thing of a frontier team is that you inspire your team, but also you listen to your team. If you do a hundred experiments and don't let it land and don't integrate it, it doesn't work. You need to listen to your team, get inspired by your team and then do stuff and then make sure that some things will be adopted. So it's really about integration. Yes, you should be free and like have the freedom to do everything. But in the end, it is about integration and actually bringing it back to the actual organization.
42:02So I would urge everyone, make sure people get what you do and don't get overwhelmed because it's very easy to overwhelm the entire organization by just dumping a hundred experiments in a channel. Make sure some stick, make sure people understand what you do. Like that's your job as a frontier team. Amazing. Thanks so much, Kieran. If you like this video, you should check out every.to. We have a two week free trial for anyone who's watching or listening at the link in the description. Every is the only subscription you need to stay at the edge of AI.
42:34It is the one subscription that if you're super AI pill and you want to learn how to use it to do the best work of your life, it's got everything you need. It has education and equipment. On the education side, we review every new model that drops and tell you what's good. On the equipment side, we have software tools specifically made for you, like an agent that helps you AI pill your whole company, all bundled together under one subscription. So get two weeks free now at the link in the description.
More from AI & I
How Hugging Face’s Investor Spots Winners
Oct 14, 202651 min
Why Every Traded Personal Agents for One Company Agent
Oct 7, 202633 min
How Sam Altman Uses Dots to Take Back His Time
Sep 30, 202633 min
How a Professional Writer Writes With AI
Sep 2, 202647 min
A $10B Hedge Fund’s AI Playbook (Best of the Pod)
Aug 26, 20261h 7m