Hi Friends—
Alex O'Connor is a researcher and machine learning manager.
I had the chance to pick his brain on the latest trends of generative AI — transformers, language and image models, fine-tuning, prompt engineering, tokenization, the latent space, adversarial attacks, and more.
Thanks to everyone who chatted with us during the YouTube premiere.
★ I'm excited to celebrate Live 100 with Special Guests tomorrow, April 27, at 1:30 PM ET with a conversation on creative machine intelligence with Adam Menges, Joel Simon, José Luis García del Castillo, and Kyle Steinfeld.
I'd love for you to join us live at nono.ma/live/100.
Warmly,
Nono
Recorded at The Palazzo, Las Vegas on December 2022.
Chapters
00:00 · Introduction
00:40 · Machine learning
02:36 · Spam and scams
15:57 · Adversarial attacks
20:50 · Deep learning revolution
23:06 · Transformers
31:23 · Language models
37:09 · Zero-shot learning
42:16 · Prompt engineering
43:45 · Training costs and hardware
47:56 · Open contributions
51:26 · BERT and Stable Diffusion
54:42 · Tokenization
59:36 · Latent space
01:05:33 · Ethics
01:10:39 · Fine-tuning and pretrained models
01:18:43 · Textual inversion
01:22:46 · Dimensionality reduction
01:25:21 · Mission
01:27:34 · Advice for beginners
01:30:15 · Books and papers
01:34:17 · The lab notebook
01:44:57 · Thanks