Interconnects

Home
Audio
Interviews
Leaderboard
About
The end of the “best open LLM”
Modeling the compute versus performance tradeoff of many open LLMs.
 • 
Nathan Lambert
We disagree on what open-source AI should mean
How to read what multiple people mean by the word openness and see through the PR speak.
 • 
Nathan Lambert
DBRX: The new best open model and Databricks’ ML strategy
Databricks’ new model is surpassing the performance of Mixtral and Llama 2 70B while still being in a size category that's reasonably accessible.
 • 
Nathan Lambert
1
Most Popular
View all
The Q* hypothesis: Tree-of-thoughts reasoning, process reward models, and supercharging synthetic data
 • Nathan Lambert
5
Behind the curtain: what it feels like to work in AI right now (April 2023)
 • Nathan Lambert
21
Llama 2: an incredible open LLM
 • Nathan Lambert
7
The AI research job market shit show (and my experience)
 • Nathan Lambert
How RLHF actually works
 • Nathan Lambert
3
Evaluations: Trust, performance, and price (bonus, announcing RewardBench)
Evaluation is not only getting harder with modern LLMs, it’s getting harder because it means something different.
 • 
Nathan Lambert
Model commoditization and product moats
Where moats are tested now that so many people have trained GPT4 class models. Claude 3, Gemini 1.5, Inflection 2.5, and Mistral Large are here to…
 • 
Nathan Lambert
The koan of an open-source LLM
A proposal for a new definition of an “open-source” LLM and why no definition will ever just work.
 • 
Nathan Lambert
Interviewing Louis Castricato of Synth Labs and Eleuther AI on RLHF, Gemini Drama, DPO, founding Carper AI, preference data, reward models…
An interview I've wanted to bring you for a while.
 • 
Nathan Lambert
1:26:27
How to cultivate a high-signal AI feed
Basic tips on how to assess inbound ML content and cultivate your news feed.
 • 
Nathan Lambert
Google ships it: Gemma open LLMs and Gemini backlash
Google rejoins the open model party and gets some backlash for a frequent problem for generative AI.
 • 
Nathan Lambert
2
10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and more
The cutting edge technical discussions beneath the wow factor.
 • 
Nathan Lambert
3
Interconnects
Interconnects
Linking important ideas of AI. The border between high-level and technical thinking. Read by leading engineers, researchers, and investors on Wednesday mornings.
Recommendations
View all 13
Latent Space
Latent Space
swyx & Alessio
The Palindrome
The Palindrome
Tivadar Danka
TechTalks
TechTalks
Ben Dickson
Supervised
Supervised
Matthew Lynley
Generating Conversation
Generating Conversation
Joseph E. Gonzalez
Social
Author info
Twitter
Linkedin
© 2024 Nathan Lambert
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture