AI Portfolio Podcast

Technical details and strategies from top AI and Business Experts

If you are a practitioner or data leader, you will gain valuable insights from the show by discovering great companies to join and learning how experts navigate their careers.

The goal of the show is to expand your sense of what is possible with machine learning. Share the show and share your feedback.

Keep Studying!

All Episodes

AI Portfolio Podcast

Raza Habib: Humanloop, LLM and Prompting, Gen AI Performace - AI Portfolio Podcast

January 11, 2025 • Mark Moyou, PhD • Season 1 • Episode 19

Dr. Raza Habib, CEO of HumanLoop, discussing the complexities of large language model (LLM) deployment, monitoring, and evaluation.

Follow/Connect:
Raza Linkedin: https://www.linkedin.com/in/humanloop-raza/
Mark LinkedIn: https://www.linkedin.com/in/markmoyou/

Chapters:
00:00 Intro
02:19 Humanloop
06:08 Prompt Management
13:26 LLM System
17:57 AI Guardrails
22:32 Workflow
27:14 User Generated Hyperparameters
31:30 LLM Routing
34:20 Prompt Engineering
38:22 Data Poisoning
45:17 Latency in LLMs
50:25 Monitoring LLMs
57:57 LLM Eval Benchmarks
01:03:27 Startup
01:17:51 Career Optimization Function
01:19:44 Books
01:24:27 Career Advice
01:27:51 Rapid Round