The Download: the next big thing in LLMs and how AI academic research is shifting
The article explores the limitations of transformers in large language models, such as increased computational costs and inefficiencies, and introduces four innovations to address these challenges. It also discusses the evolving AI landscape, including the role of academic research, institutional investment, and the ethical implications of AI development. Finally, the piece reflects on the broader societal and political impacts of AI, emphasizing the need for responsible innovation.
More from Technologyreview
How kids feel about AI, in their own words
When we set out to talk to kids about artificial intelligence, we thought we knew what we’d hear. We expected some to tell us they were using it to cheat a little, the way Millennials and Gen Xers opened up CliffsNotes or programmed formulas into their TI-82s, and others to share inspiring ways they were…
technologyreview.com··Mads Kristian Nylund·AI EducationAI ToolsAI Ethics
Scaling AI agents with trustworthy data
Business and technology leaders need no convincing that the time of agentic AI is here. Organizations are rapidly adopting agents, and few executives doubt the technology’s potential to transform work. But many organizations find that realizing the desired return on investment (ROI) from AI hinges on having the right foundation, with inadequate infrastructure and data…
technologyreview.com··Mads Kristian Nylund·Data InfrastructureAI GovernanceAI-agents
These startups are chasing the next big thing in LLMs
MIT Technology Review’s What’s Next series looks across industries, trends, and technologies to give you a first look at the future. You can read the rest of them here. Way back in the summer of 2017, AI researchers at Google put out a paper called “Attention Is All You Need,” in which they described a new…
technologyreview.com··Mads Kristian Nylund·AI DevelopmentAI ToolsAI Infrastructure