AI Portfolio Podcast
Technical details and strategies from top AI and Business Experts
If you are a practitioner or data leader, you will gain valuable insights from the show by discovering great companies to join and learning how experts navigate their careers.
The goal of the show is to expand your sense of what is possible with machine learning. Share the show and share your feedback.
Keep Studying!
AI Portfolio Podcast
Tomás Hernando Kofman: Not Diamond, Gen AI Startups, AI systems and Routing - AI Portfolio Podcast
Tomás Hernando Kofman of Not Diamond, discussing about gen ai model routing.
Follow/Connect:
Tomas LinkedIn:https://www.linkedin.com/in/tomashk/
Mark Linkedin: https://www.linkedin.com/in/markmoyou/
Chapters:
00:00 Intro
01:56 Not Diamond
08:36 Router Problem
13:33 Time to Build v1
15:49 Human Categories
19:01 System Prompt
27:33 Prompt Drift
30:14 Guardrails
35:48 Model Spectrum
42:23 Caching
45:50 Training Router
54:44 Cost and Latency
01:01:22 Routing Across Agents
01:03:38 Prompt Pasting
01:09:17 Routing for Multimodal Models
01:12:08 Startup
01:21:20 Building Companies in the Gen AI Era
01:27:00 Career Optimization Function
01:29:33 Career Advice
01:32:00 Rapid Round