
The author discusses the limitations of AI in generating high-quality, long-form non-fiction writing, particularly in organizing and presenting complex scientific concepts. While AI improves in specific tasks like coding and mathematics, it struggles with synthesizing established scientific knowledge, which is crucial for solving open-ended scientific problems. The author emphasizes that human oversight is necessary to ensure accuracy and meaning in AI-generated content, highlighting that AI remains insufficient for producing the insightful and coherent writing required for scientific challenges.
After a few long years of finding time to document my lessons from training open models, my post-training book is done!

Musings on model alignment, what determines safety, and where we go from here.

Scaling our curation and measurement of the open ecosystem.
