LMSS @ Cornell Tech: David Hall (UC Berkeley)
bis
Cornell Tech, Bloomberg 401, New York
Learning Machines Seminar Series What: LMSS: David Hall (UC Berkeley) When: Friday, October 30, 10:30 a.m. - 11:30 a.m. Where: Bloomberg 401 The series is organized by Associate Professor Yoav Artzi and sponsored by Bloomberg. Coffee and pastries will be served at 10:00 a.m. "Building Frontier Models in the Open" Marin is an open lab for building frontier language models. We share experiments, code, data, and technical discussions throughout development, making the decisions behind our models available for others to examine and build on. I’ll discuss what this approach enables for reproducibility and collaborative research, then walk through the data, architecture, optimization, and scaling decisions behind our large-scale mixture-of-experts models. Along the way, I’ll share lessons from developing these models in public and the open questions we’re working on next. BIO David Hall leads Marin at Open Athena and co-created Marin at Stanford CRFM. He is the creator of the Levanter large-scale training framework and previously co-founded Semantic Machines, acquired by Microsoft. He received his PhD from UC Berkeley.