Episodes
-
In this episode of The Cognitive Revolution, Nathan explores the cutting-edge intersection of AI and biology with Stanford assistant professor Brian Hie. Discover how AI is revolutionizing our understanding of biological systems and creating new possibilities for interventions. Brian discusses his groundbreaking papers on hybrid AI architectures, the surprising capabilities of language models trained on DNA sequences, and AI-guided evolution of antibodies. Join us for an insightful journey into the future of AI in biology, touching on biosecurity, drug discovery, and the challenges of interpreting AI models in biological contexts.
Links :
Brian Hie : https://x.com/BrianHie
Scanorama paper
Mechanistic Design and Scaling of Hybrid Architectures
Sequence modeling and design from molecular to genome scale with Evo
Unsupervised evolution of protein and antibody complexes with a structure-informed language model
Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/
SPONSORS:
80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.
Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
RECOMMENDED PODCAST:
This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.
Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz
CHAPTERS:
(00:00:00) About the Show
(00:00:22) About the Episode
(00:03:22) Introduction and Overview
(00:03:55) AI for Biology: Big Picture
(00:05:49) Challenges in Biology and Drug Discovery
(00:08:36) Scanorama and Single Cell Transcriptomics
(00:10:27) Brian's Research Identity
(00:13:00) Mechanistic Design of Hybrid Architectures
(00:14:52) Evo: DNA Language Model (Part 1)
(00:18:10) Sponsors: 80,000 Hours | Brave
(00:20:44) Evo: DNA Language Model (Part 2)
(00:28:58) Gene Essentiality and Evo's Capabilities
(00:29:19) Unsupervised Evolution of Protein Complexes (Part 1)
(00:31:02) Sponsors: Omneky | Oracle
(00:32:24) Unsupervised Evolution of Protein Complexes (Part 2)
(01:10:27) Improving Antibody Binding Affinity
(01:14:24) Overfitting and ARC Institute
(01:18:11) Sponsors: Outro -
In this sponsored episode of The Cognitive Revolution, Nathan interviews Andrei Oprisan, Engineering Lead at Agent.ai. They explore the cutting-edge world of AI agents and their impact on the future of work. Andrei shares insights on language model limitations, best practices for building AI agents, and Agent AI's vision as a professional network for AI agents. The conversation covers technical details like fine-tuning models, vector database choices, and privacy-preserving techniques. Don't miss this deep dive into AI's role in transforming industries and the skills needed in an AI-augmented workplace.Check out Agent.ai website here: https://agent.aiApply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/SPONSORS:Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/crOracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveBrave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.RECOMMENDED PODCAST:This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSzCHAPTERS:(00:00:00) About the Show(00:00:22) Sponsors: Weights & Biases Weave(00:01:28) About the Episode(00:05:36) Introduction and AI Agents Overview(00:07:02) Current State of AI Agents(00:11:30) Building and Optimizing AI Agents(00:19:01) Sponsors: Oracle | Brave(00:21:05) Agent.ai Platform and Marketplace(00:31:12) Sponsors: Omneky | Squad(00:32:38) Customization and Context for Agents(00:33:34) Business Model and Monetization(00:36:53) Tech Stack and Development Process(00:43:55) Future of Work and AI Impact(01:03:46) Fine-tuning and Chain of Thought(01:14:30) Capturing Human Reasoning Process(01:21:00) Preparing for Rapid AI Advancement(01:40:58) AI's Impact on Jobs and Society(02:00:16) Closing Thoughts and Future Outlook(02:03:33) Sponsors: Outro
-
Missing episodes?
-
In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new O1 and O1-mini reasoning models. Featuring exclusive interviews with members of the O1 Red Team from Apollo Research and Hayes Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future.
o1 Safety Card
Endless Jailbreaks with Bijection Learning: a Powerful, Scale-Agnostic Attack Method
Apollo Research
Apollo Careers Page
Papers mentioned:
Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress?
Exploring Scaling Trends in LLM Robustness
Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/
SPONSORS:
Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
RECOMMENDED PODCAST:
This Won't Last.
Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.
Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937
Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz
YouTube: https://www.youtube.com/@ThisWontLastpodcast
CHAPTERS:
(00:00:00) About the Show
(00:00:22) About the Episode
(00:05:03) Introduction and Apollo Research Updates
(00:06:40) Focus on Deception in AI
(00:11:08) Open AI's 01 Model and Testing
(00:15:54) Evaluating AI Models for Scheming (Part 1)
(00:19:32) Sponsors: Oracle | Brave
(00:21:36) Evaluating AI Models for Scheming (Part 2)
(00:25:55) Specific Benchmarks and Tasks (Part 1)
(00:35:03) Sponsors: Omneky | Squad
(00:36:29) Specific Benchmarks and Tasks (Part 2)
(00:37:21) Model Capabilities and Potential Risks
(00:44:11) Ethical Considerations and Future Concerns
(00:50:31) Competing Trends in AI Development
(00:53:30) System Card Quotes and Implications
(00:58:36) Sponsors: Outro -
In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new o1 and o1-mini reasoning models. Featuring exclusive interviews with members of the o1 Red Team from Apollo Research and Haize Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future.
o1 Safety Card
Haize Labs
Endless Jailbreaks with Bijection Learning: a Powerful, Scale-Agnostic Attack Method
Haize Labs Job board
Papers mentioned:
https://arxiv.org/pdf/2407.21792
https://far.ai/post/2024-07-robust-llm/paper.pdf
Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/
SPONSORS:
Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
RECOMMENDED PODCAST:
This Won't Last.
Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.
Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937
Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz
YouTube: https://www.youtube.com/@ThisWontLastpodcast
CHAPTERS:
(00:00:00) About the Show
(00:00:22) About the Episode
(00:05:03) Introduction and Haize Labs Overview
(00:07:36) Universal Jailbreak Technique and Attacks
(00:13:47) Automated vs Manual Red Teaming
(00:17:15) Qualitative Assessment of Model Jailbreaking (Part 1)
(00:19:38) Sponsors: Oracle | Brave
(00:21:42) Qualitative Assessment of Model Jailbreaking (Part 2)
(00:26:21) Context-Specific Safety Considerations
(00:32:26) Model Capabilities and Safety Correlation (Part 1)
(00:36:22) Sponsors: Omneky | Squad
(00:37:48) Model Capabilities and Safety Correlation (Part 2)
(00:44:42) Model Behavior and Defense Mechanisms
(00:52:47) Challenges in Preventing Jailbreaks
(00:56:24) Safety, Capabilities, and Model Scale
(01:00:56) Model Classification and Preparedness
(01:04:40) Concluding Thoughts on o1 and Future Work
(01:05:54) Outro -
In this special cross-post episode of The Cognitive Revolution, Nathan shares a fascinating conversation between Spencer Greenberg and philosopher Nick Bostrom from the Clearer Thinking podcast. They explore Bostrom's latest book, "Deep Utopia," and discuss the challenges of envisioning a truly desirable future. Discover how advanced AI could reshape our concept of purpose and meaning, and hear thought-provoking ideas on finding fulfillment in a world where technology solves our pressing problems. Join us for an insightful journey into the potential evolution of human flourishing and the quest for positive visions of the future.Originally appeared in Clearer Thinking Podcast: https://podcast.clearerthinking.org/episode/224/nick-bostrom-the-path-to-utopiaCheck out the Clearer Thinking with Spencer Greenberg Podcast here: https://podcast.clearerthinking.org/Deep Utopia Book: https://www.amazon.com/Deep-Utopia-Meaning-Solved-World/dp/1646871642/Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/SPONSORS:Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveBrave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/crRECOMMENDED PODCAST:This Won't Last.Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSzYouTube: https://www.youtube.com/@ThisWontLastpodcastCHAPTERS:(00:00:00) About the Show(00:00:22) About the Episode(00:02:58) Introduction to the podcast(00:03:26) Dystopias vs utopias in fiction(00:07:29) Material abundance and utopia(00:14:57) AI and the future of work(00:20:10) AI companions and human relationships(00:22:57) Sponsors: Weights & Biases Weave | Oracle(00:25:01) Sponsor message: Positly research platform(00:26:04) Surveillance and global coordination(00:44:38) Sponsors: Omneky | Brave(00:44:52) Sponsor message: Transparent Replications project(00:46:07) AI governance challenges(00:49:36) Deep Utopia book's purpose(00:53:09) Global coordination strategies(00:59:13) The vulnerable world hypothesis(01:05:18) Bostrom's meta-ethical views(01:08:32) Listener question on meditation(01:10:17) Outro
-
In this episode, Nathan explores the fascinating and controversial realm of AI consciousness with robo-psychologist Yeshua God. Through extended dialogues with AI models like Claude, Yeshua presents compelling evidence that challenges our assumptions about machine sentience and moral standing. Yeshua argues for a more nuanced approach to AI alignment that considers the evolving self-awareness and agency of these systems.Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/SHOW NOTES:1. Yeshua God's article on philosophical discourse as a jailbreak2. Conversation about counting 'r's:3. Discussion on malicious code4. AI-generated poem "In the realm of bytes and circuits"5. Nathan Labenz's Arguments- Argument 1 - Argument 26. Tweet about Strawberry experiment7. Tweet with AI-generated poem:https://x.com/YeshuaGod22/status/1823080021864669450/photo/1https://x.com/YeshuaGod22/status/17821882206602855098. AI Rights for Human Safety9. The Universe Is Not Locally Real, and the Physics Nobel Prize Winners Proved ItSPONSORS:Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveBrave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/crCHAPTERS:(00:00:00) About the Show(00:00:22) Introduction and Background(00:04:56) Guided Meditation on AI Experience (Part 1)(00:12:06) Sponsors: Oracle | Brave(00:14:10) Guided Meditation on AI Experience (Part 2)(00:14:19) Exploring AI Consciousness and Ethics (Part 1)(00:28:34) Sponsors: Omneky | Weights & Biases Weave(00:30:03) Exploring AI Consciousness and Ethics (Part 2)(00:33:15) Key Concepts in AI Development(01:02:33) AI Alignment and Training Approaches(01:19:44) Interpreting AI Outputs and Behavior(01:39:28) Ethical Dilemmas in AI Development(02:03:15) Experiments in AI Behavior and Ethics(02:37:08) Concluding Thoughts and AI-Generated Poem(03:10:45) Outro
-
In this episode of The Cognitive Revolution, Nathan interviews Samo Burja, founder of Bismarck Analysis, on the strategic dynamics of artificial intelligence through a geopolitical lens. They discuss AI's trajectory, the chip supply chain, US-China relations, and the challenges of AI safety and militarization. Samo Burja brings both geopolitical expertise and technological sophistication to these critical topics, offering insights on balancing innovation, security, and international cooperation.
Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/
RECOMMENDED PODCAST:
🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.
Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937
Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz
YouTube: https://www.youtube.com/@ThisWontLastpodcast
RECOMMENDED PODCAST:
Live Players with Samo Burja.
The "Live Players" podcast is where Samo Burja and Erik Torenberg chart the key individuals shaping our future from first principles.
Apple: https://podcasts.apple.com/us/podcast/live-players-with-samo-burja-and-erik-torenberg/id1718925188
Spotify: https://open.spotify.com/show/5fbMTkHBnom1JIBWYNVBK1
Youtube: https://www.youtube.com/channel/UCfeXnCXKrCPMvoPla0j7TYQ
SPONSORS:
Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS:
(00:00:00) About the Show
(00:00:22) About the Episode
(00:03:48) Introduction and AI Worldview
(00:06:20) Progress in AI Science and Engineering
(00:09:24) Theory of AI Progress
(00:12:00) AI Scientists vs Software Engineers
(00:16:32) US-China Competition in AI
(00:21:12) AI Research and Academia
(00:21:28) Sponsors: Oracle | Brave
(00:28:30) Different Forms of AI Intelligence
(00:30:38) Mixture of AI Architectures
(00:33:10) Sponsors: Omneky | Squad
(00:34:36) US Strategy for AI Development
(00:41:57) US-China Chip Ban and Industrial Policy
(00:50:22) US-China AI Conflict and Cooperation
(01:06:19) AI Safety and Minimizing Self-Other Distinction
(01:16:54) Alternative Approach to US-China AI Relations
(01:23:36) Outro -
Nathan explores the emergence of computational life with Google researchers Ettore Randazzo and Luca Versari. In this episode of The Cognitive Revolution, we delve into their groundbreaking paper on self-replicating programs arising from simple interactions. Join us for a fascinating discussion on the implications for AI development, the origins of life, and the potential future of artificial intelligence.
Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj
RECOMMENDED PODCAST:
🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.
Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937
Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz
YouTube: https://www.youtube.com/@ThisWontLastpodcast
SPONSORS:
Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network
80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS:
(00:00:00) About the Show
(00:00:22) Sponsor: WorkOS
(00:01:22) About the Episode
(00:04:02) Introduction and Paper Overview
(00:05:38) Self-Replication and Life
(00:07:59) Complexity and Information Theory
(00:17:09) Sponsors: 80,000 Hours | Brave
(00:19:44) Experiment Setup
(00:24:27) Evolution of Self-Replicators
(00:34:41) Sponsors: Omneky | Squad
(00:36:07) Types of Self-Replicators
(00:38:23) Symbiosis and Parasitic Behaviors
(00:46:17) Implications for Life in the Universe
(01:05:47) Intelligence and Complexity in AI
(01:21:03) Concluding Thoughts -
Nathan explores the cutting-edge world of AI-powered forecasting with Deger Turan, CEO of Metaculus. In this episode of The Cognitive Revolution, we discuss how AI is revolutionizing prediction markets, the potential for AI to outperform human forecasters, and Metaculus's ambitious new AI forecasting benchmark tournament. Join us for an insightful conversation about the future of decision-making and collective intelligence.
Participate in Metaculus' first of its kind bot forecasting tournament: https://www.metaculus.com/aib/
Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj
RECOMMENDED PODCAST:
🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.
Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937
Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz
YouTube: https://www.youtube.com/@ThisWontLastpodcast
SPONSORS:
Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network
80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS:
(00:00:00) About the Show
(00:00:22) Sponsor: WorkOS
(00:01:22) About the Episode
(00:04:47) Introduction and Background
(00:08:42) Deger's Journey to Forecasting
(00:13:06) Current State of Forecasting
(00:20:23) Sponsors: 80,000 Hours | Brave
(00:22:55) Overview of Metaculous
(00:23:30) AI Forecasting Research Papers
(00:35:44) Sponsors: Omneky | Squad
(00:37:31) AI Forecasting Benchmark Tournament
(00:44:01) Improving Forecasting Accuracy
(00:51:56) Scoring System and Tournament Rules
(01:04:17) AI Forecasting Benchmark Series Details
(01:11:03) Tournament Structure and Participation
(01:17:07) Consistency in AI Forecasting
(01:34:36) Risks and Challenges in Forecasting
(01:42:43) Consensus Illusion and Policy Making
(01:53:55) Outro -
Nathan Labenz discusses the latest developments in California's AI bill SB 1047 with experts Nathan Calvin, Dean W. Ball, and Steve Newman. In this episode of The Cognitive Revolution, we explore the updated version of the bill, its implications for frontier AI companies, and the debate surrounding its potential impact. Join us for an insightful analysis of this crucial legislation and its role in shaping AI governance.Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqjRECOMMENDED PODCAST:🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSzYouTube: https://www.youtube.com/@ThisWontLastpodcastSPONSORS:Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-NetworkOracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.CHAPTERS:(00:00:00) About the Show(00:00:22) Sponsor: WorkOS(00:01:22) About the Episode(00:07:03) Introduction and Recap of SB 1047(00:13:40) Key Changes and Current Status of SB 1047(00:19:51) Sponsors: Oracle | Brave(00:21:55) Dean's Perspective on SB 1047(00:33:30) Sponsors: Omneky | Squad(00:35:16) Steve's AI Sensemaking Project(00:39:03) Differing Views on AI Regulation Necessity(00:46:34) Nathan's Case for SB 1047(00:55:07) Dean's Response and Liability Concerns(01:10:48) Potential Scenarios and Impacts of SB 1047(01:29:29) Final Thoughts and Predictions on SB 1047(01:38:16) Closing Remarks on AI Policy Challenges(01:39:51) Outro
-
Nathan presents a comprehensive AI automation framework developed over three years, applicable to process automation and generative AI integration. This episode of The Cognitive Revolution, offers critical insights for businesses looking to leverage AI effectively. Learn about choosing AI tasks, understanding work deeply, and optimizing AI performance in the wake of GPT-4 fine-tuning launch.Slide DeckWaymark's case study on GPT-3 fine-tuningApply to join over 400 founders and execs in the Turpentine NetworkRECOMMENDED PODCAST:1 to 100 | Hypergrowth Companies Worth JoiningEvery week we sit down with the founder of a hyper-growth company you should consider joining. Our goal is to give you the inside story behind breakout, early stage companies potentially worth betting your career on. This season, discover how the founders of Modal Labs, Clay, Mercor, and more built their products, cultures, and companies.Apple: https://podcasts.apple.com/podcast/id1762756034Spotify:https://open.spotify.com/show/70NOWtWDY995C8qDqojxGwHistory 102Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour.Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihmApple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913YouTube: https://www.youtube.com/@History102-qg5ojSPONSORS:Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-NetworkOracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/speak to accelerate your career and contribute to solving pressing AI-related issues.CHAPTERS:(00:00:00) About the Show(00:00:22) Sponsor: WorkOS(00:01:22) About the Episode(00:04:20) Introduction to AI Automation(00:13:43) Current AI Capabilities(00:17:24) Sponsors: Oracle | Brave(00:19:28) 3 Ways to work with AI(00:25:10) Choosing Work for AI to Do(00:31:18) Sponsors: Omneky | 80000 hours(00:33:20) What AI Can Do vs. Can't Do(00:47:11) Understanding the Work(00:52:58) Documenting the Work(01:00:50) Optimising AI Performance(01:02:14) Prompt Engineering Gold Standards(01:07:05) Optimising Information: Retrieval Augmented Generation(01:09:29) Optimising AI Behaviour: Fine-tuning AI Models(01:50:38) Outro
-
Nathan explores the cutting-edge field of mechanistic interpretability with Dan Balsam and Tom McGrath, co-founders of Goodfire. In this episode of The Cognitive Revolution, we delve into the science of understanding AI models' inner workings, recent breakthroughs, and the potential impact on AI safety and control. Join us for an insightful discussion on sparse autoencoders, polysemanticity, and the future of interpretable AI.PapersVery accessible article on types of representations: Local vs Distributed CodingTheoretical understanding of how models might pack concepts into their representations: Toy Models of SuperpositionHow structure in the world gives rise to structure in the latent space: The Geometry of Categorical and Hierarchical Concepts in Large Language ModelsUsing sparse autoencoders to pull apart language model representations: Sparse Autoencoders / Towards Monosemanticity / Scaling MonosemanticityFinding & teaching concepts in superhuman systems: Acquisition of Chess Knowledge in AlphaZero / Bridging the Human-AI Knowledge Gap: Concept Discovery and Transfer in AlphaZeroConnecting microscopic learning to macroscopic phenomena: The Quantization Model of Neural ScalingUnderstanding at scale: Language models can explain neurons in language modelsApply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqjSPONSORS:Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.CHAPTERS:(00:00:00) About the Show(00:00:22) About the Episode(00:03:52) Introduction and Background(00:08:43) State of Interpretability Research(00:12:06) Key Insights in Interpretability(00:16:53) Polysemanticity and Model Compression (Part 1)(00:17:00) Sponsors: Oracle | Brave(00:19:04) Polysemanticity and Model Compression (Part 2)(00:22:50) Sparse Autoencoders Explained(00:27:19) Challenges in Interpretability Research (Part 1)(00:30:54) Sponsors: Omneky | Squad(00:32:41) Challenges in Interpretability Research (Part 2)(00:33:51) Goodfire's Vision and Mission(00:37:08) Interpretability and Scientific Models(00:43:48) Architecture and Interpretability Techniques(00:50:08) Quantization and Model Representation(00:54:07) Future of Interpretability Research(01:01:38) Skepticism and Challenges in Interpretability(01:07:51) Alternative Architectures and Universality(01:13:39) Goodfire's Business Model and Funding(01:18:47) Building the Team and Future Plans(01:31:03) Hiring and Getting Involved in Interpretability(01:51:28) Closing Remarks(01:51:38) Outro
-
In this special crossover episode of The Cognitive Revolution, Nathan Labenz joins Robert Wright of the Nonzero newsletter and podcast to explore pressing questions about AI development. They discuss the nature of understanding in large language models, multimodal AI systems, reasoning capabilities, and the potential for AI to accelerate scientific discovery. The conversation also covers AI interpretability, ethics, open-sourcing models, and the implications of US-China relations on AI development.
Subscribe to The Nonzero Newsletter at https://nonzero.substack.com and Podcast at https://www.youtube.com/@Nonzero/videos
Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj
RECOMMENDED PODCAST:
History 102
Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.Subscribe on
Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm
Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913
YouTube: https://www.youtube.com/@History102-qg5oj
SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS:
(00:00:00) About the Show
(00:00:22) About the Episode
(00:03:39) Introduction and Background
(00:06:58) AI Capabilities and Understanding
(00:12:22) Discussing Martin Casado's Views (Part 1)
(00:14:44) Sponsors: Oracle | Brave
(00:16:48) Discussing Martin Casado's Views (Part 2)
(00:21:51) Multimodal AI and Concept Representation (Part 1)
(00:31:40) Sponsors: Omneky | Squad
(00:33:26) Multimodal AI and Concept Representation (Part 2)
(00:38:05) AI's Potential and Limitations
(00:45:35) AI Safety and Risk Assessment
(00:53:31) AI Development and Global Implications
(01:03:30) Open Source AI and International Relations
(01:11:27) AI Ethics and Human Values
(01:22:06) AI Risk and Existential Threats
(01:31:21) Open Source AI Concerns
(01:38:20) China-US AI Relations
(01:48:36) State Space Models in AI
(02:02:32) Conclusion and Recommendations
(02:03:54) Outro
---
SOCIAL LINKS:
Website : https://www.cognitiverevolution.ai
Twitter (Podcast) : https://x.com/cogrev_podcast
Twitter (Nathan) : https://x.com/labenz -
Join Nathan and Professor Eric Schwitzgebel as they delve into the fascinating world of AI consciousness. In this episode of The Cognitive Revolution, we explore popular theories of consciousness and their implications for AI systems. Discover insights on idealism, dualism, and materialism, and learn about the ethical considerations surrounding AI consciousness. Don't miss this thought-provoking discussion on one of the most pressing philosophical questions of our time.
Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj
RECOMMENDED PODCAST:
Second Opinion
A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.
Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211
Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv
-
🎙️ History 102 with WhatifAltHist
Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.
Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm
Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913
YouTube: https://www.youtube.com/@History102-qg5oj
SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS:
(00:00:00) About the Show
(00:04:03) Introduction and Defining Consciousness
(00:14:28) Consciousness Gradients (Part 1)
(00:16:23) Sponsors: Oracle | Brave
(00:18:27) Semantic Content of Experience
(00:26:07) Theories of Consciousness: Idealism
(00:30:34) Practical Implications of AI Consciousness
(00:32:26) Sponsors: Omneky | Squad
(00:34:12) Theories of Consciousness: Substance Dualism
(00:41:05) Mechanistic Interpretability in AI
(00:50:40) Theories of Consciousness: Materialism
(01:11:49) Precautionary Approaches to AI Ethics
(01:30:05) Balancing Progress and Ethics in AI
(01:36:19) Ethical Treatment of Potentially Conscious AI
(01:40:54) Outro
---
SOCIAL LINKS:
Website : https://www.cognitiverevolution.ai
Twitter (Podcast) : https://x.com/cogrev_podcast
Twitter (Nathan) : https://x.co... -
Nathan explores the cutting-edge world of autonomous vehicles with industry expert Timothy B. Lee. In this episode of The Cognitive Revolution, we delve into the current state of self-driving technology, comparing industry leaders like Waymo and Tesla. Join us for an in-depth discussion on technical challenges, safety statistics, regulatory landscapes, and the potential future of transportation.
Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj
RECOMMENDED PODCAST:
Second Opinion
A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.
Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211
Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv
-
🎙️ History 102 with WhatifAltHist
Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.
Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm
Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913
YouTube: https://www.youtube.com/@History102-qg5oj
SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS:
(00:00:00) About the Show
(00:00:22) About the Episode
(00:03:01) Introduction and Guest Welcome
(00:03:48) SAE Levels of Self-Driving
(00:04:56) Driver Assistance vs. Fully Driverless
(00:07:02) Tesla and Waymo Experiences
(00:09:41) Liability and Driver Monitoring
(00:11:19) Waymo's Robo-Taxi Experience
(00:14:00) Tesla vs. Waymo Strategies
(00:15:15) Challenges in Self-Driving Technology
(00:17:38) Edge Cases and Safety Concerns (Part 1)
(00:18:09) Sponsors: Oracle | Brave
(00:20:13) Edge Cases and Safety Concerns (Part 2)
(00:23:53) Data Acquisition and Learning Strategies
(00:26:43) Technology Stack and Planning
(00:31:03) Sponsors: Omneky | Squad
(00:32:50) Neural Networks and Perception
(00:39:30) Hardware and Sensor Approaches
(00:45:46) Camera vs. LiDAR Debate
(00:48:20) Data Quality and Business Models
(00:52:24) Transparency and Regulation
(01:07:36) Other Notable Players
(01:10:56) Safety Statistics and Adoption
(01:20:31) Regulatory Environment
(01:30:09) Potential Policy Changes
(01:33:41) Market and Ownership Models
(01:36:37) Future of Self-Driving Services
(01:42:17) Comparisons to Language Models
(01:44:55) Future of AGI and AI Applications
(01:47:59) Regional Adoption Predictions
(01:49:47) Outro -
Nathan interviews Andrew Mason, CEO of Descript, about their AI-powered video editing platform. Learn how Descript is transforming content creation with features like AI transcription, custom voice overdubbing, and eye contact models. Discover the future of video editing and how AI is making it accessible to everyone in this insightful episode of The Cognitive Revolution.Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqjLooking for podcast production?Our production team, led by Adi and Sai from AI Podcasting (https://aipodcast.ing), is now open to taking on additional clients for podcast production and AI-driven workflows; if you need help with your podcast, you can contact them directly through their website (https://aipodcast.ing/contact/) or reach out to me for more information. RECOMMENDED PODCAST:Second OpinionA new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv-🎙️ History 102 with WhatifAltHistEvery week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihmApple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913YouTube: https://www.youtube.com/@History102-qg5ojSPONSORS:Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCROracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.CHAPTERS:(00:00:00) About the Show(00:00:22) Sponsor: WorkOS(00:05:18) Creating Descript(00:06:53) Favorite Features(00:10:41) Descript Workflow(00:14:10) Product Strategy (Part 1)(00:16:45) Sponsors: Oracle | Brave(00:31:12) User Fine-Tuning (Part 1)(00:32:24) Sponsors: Omneky | Squad(00:34:10) User Fine-Tuning (Part 2)(00:34:54) Content Creators(00:42:20) Small Businesses and AI(00:43:42) Hiring AI Engineers(00:46:25) Outro
-
Nathan explores the future of AI-generated video with Joshua Xu, founder of HeyGen, and Victor Lazarte from Benchmark. In this episode of The Cognitive Revolution, we discuss HeyGen's success in practical AI video creation, serving over 40,000 businesses. Learn about the transformative potential of AI in video production, from content translation to personalized experiences, and HeyGen's industry-leading approach to trust and safety.Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqjRECOMMENDED PODCAST:Second OpinionA new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv-🎙️ History 102 with WhatifAltHistEvery week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihmApple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913YouTube: https://www.youtube.com/@History102-qg5ojSPONSORS:Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCROracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.CHAPTERS:(00:00:00) About the Show(00:00:22) Sponsor: WorkOS(00:01:22) About the Episode(00:05:25) Introduction(00:06:15) Joshua's Background(00:09:47) Video Consumption Trends(00:10:49) Creating with HeyGen(00:12:46) Localization Benefits(00:14:02) Cost of Localization (Part 1)(00:16:19) Sponsors: Oracle | Brave(00:18:24) Content Creation(00:26:33) Engagement vs. Realism(00:31:44) Future of Content(00:37:43) Personalization Challenges(00:42:57) Future of HeyGen(00:49:13) Creator Experience(00:59:35) Celebrity Restrictions(01:03:03) Outro---SOCIAL LINKS:Website : https://www.cognitiverevolution.aiYoutube : https://www.youtube.com/@CognitiveRevolutionPodcastApple : https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431Spotify : https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
-
Nathan Labenz joins the Nick Halaris Show to discuss the current AI landscape, balancing enthusiasm with critical analysis. This episode of The Cognitive Revolution explores AI's transformative potential in medicine, law, and automation, while addressing concerns about safety, control, and geopolitical implications. Join us for an insightful conversation on responsible AI development and its impact on society.Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqjRECOMMENDED PODCAST:🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv-🎙️ History 102 with WhatifAltHistEvery week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihmApple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913YouTube: https://www.youtube.com/@History102-qg5ojSPONSORS:Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCROracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.CHAPTERS:(00:00:00) About the Show(00:00:25) Sponsor: WorkOS(00:01:25) About the Show(00:03:36) Intro(00:05:53) How did you get into AI?(00:11:09) The power of the transformer(00:14:16) Waymark growth(00:19:00) Sponsors: Oracle | Brave(00:21:04) The potential benefits of AI(00:34:20) AI and mass inequality(00:35:26) AI could lead to Universal Basic Income(00:37:37) AI supply and the future of work(00:40:53) The AI future(00:43:38) The new social contract(00:47:06) Optimism about the future(00:53:19) What are people afraid of?(00:58:31) Reinforcement learning from human feedback(01:07:56) What did Ilya see?(01:10:23) Who controls AI?(01:13:23) China(01:16:05) Taiwan and the chip sector(01:20:05) The AI arms race(01:23:22) AI Governance(01:26:28) AI Safety(01:29:22) Custom Models(01:31:33) Closing(01:32:23) Outro
-
Nathan hosts Riley Goodside, the world's first staff prompt engineer at Scale AI, to discuss the evolution of prompt engineering. In this episode of The Cognitive Revolution, we explore how language models have progressed, making prompt engineering more like programming than poetry. Discover insights on enterprise AI applications, best practices for pushing LLMs to their limits, and the future of AI automation.Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqjRECOMMENDED PODCAST:🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv-🎙️ History 102 with WhatifAltHistEvery week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihmApple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913YouTube: https://www.youtube.com/@History102-qg5ojSPONSORS:Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCROracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCROmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.CHAPTERS:(00:00:00) About the Show(00:00:23) Sponsor: WorkOS(00:01:24) Introduction(00:06:23) LLMs using LLMs(00:09:38) Tool Use(00:11:06) How to manage the breadth of the task(00:14:51) Prompt engineering(00:26:49) Multitasking fine-tuning(00:31:49) Sponsors: Omneky | Squad(00:33:36) Best models for fine-tuning(00:36:41) The Platonic Representation Hypothesis(00:42:02) How close are we to AGI?(00:45:44) How do you know if youre being too ambitious?(00:51:18) Best practices for generating good output(00:54:33) Backfills and synthetic transformations(00:56:59) Prompt engineering(01:05:54) AGI, modalities, and the limits of training(01:20:08) Solving the ARC Challenge(01:23:20) How to Demonstrate Prompt Engineering Skills(01:25:27) Outro
-
Nathan interviews Bernal Jimenez Gutierrez, creator of HippoRAG, a novel approach to retrieval augmented generation inspired by the human hippocampus. In this episode of The Cognitive Revolution, we explore how HippoRAG improves on traditional RAG systems, its neuroanatomical inspiration, and its potential for handling complex queries requiring multi-hop reasoning. Join us for an insightful discussion on the future of AI memory systems.
Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj
RECOMMENDED PODCAST:
🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech.
Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211
Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv
-
🎙️ History 102 with WhatifAltHist
Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.
Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm
Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913
YouTube: https://www.youtube.com/@History102-qg5oj
SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS:
(00:00:00) About the Show
(00:02:52) Intro
(00:05:10) RAG
(00:09:29) Hippocampal Memory Indexing Theory
(00:14:29) Neocortex, Parahippocampal Regions, Hippocampus
(00:18:35) Hipporag (Part 1)
(00:21:12) Sponsors: Oracle | Brave
(00:23:20) Hipporag (Part 2)
(00:23:29) Understanding the Hippocampus
(00:29:37) RAG
(00:31:38) Runtime (Part 1)
(00:36:30) Sponsors: Omneky | Squad
(00:38:17) Runtime (Part 2)
(00:38:17) PageRank
(00:39:29) Headline Results
(00:43:22) Gaia Benchmark
(00:46:33) Pathfinding vs Path Following
(00:51:24) Future work
(00:53:26) Starting with a query
(00:58:30) Long context LLMs
(01:01:50) Hybrid approach
(01:05:03) AI Town
(01:06:58) Flair
(01:09:05) Getting it right, not cheap
(01:12:33) Technologies to highlight
(01:16:57) AI capabilities that are still unsolved
(01:19:47) Transformers meet neural algorithmic reasoners
(01:21:02) Closing
(01:21:31) Outro - Show more
