Large Language Models’ Emergent Abilities Are a Mirage

Large Language Models’ Emergent Abilities Are a Mirage

The original version of this story appeared in Quanta Magazine. Two years ago, in a project called the Beyond the Imitation Game benchmark, or BIG-bench, 450 researchers compiled a list of 204 tasks designed to test the capabilities of large language models, which power chatbots like ChatGPT. On most tasks, performance improved predictably and smoothly…

The NSA Warns That US Adversaries Free to Mine Private Data May Have an AI Edge

The NSA Warns That US Adversaries Free to Mine Private Data May Have an AI Edge

Electrical engineer Gilbert Herrera was appointed research director of the US National Security Agency in late 2021, just as an AI revolution was brewing inside the US tech industry. The NSA, sometimes jokingly said to stand for No Such Agency, has long hired top math and computer science talent. Its technical leaders have been early…

Perplexity’s Founder Was Inspired by Sundar Pichai. Now They’re Competing to Reinvent Search

Perplexity’s Founder Was Inspired by Sundar Pichai. Now They’re Competing to Reinvent Search

Aravind Srinivas credits Google CEO Sundar Pichai for giving him the freedom to eat eggs. Srinivas remembers the moment seven years ago when an interview with Pichai popped up in his YouTube feed. His vegetarian upbringing in India had excluded eggs, as it had for many in the country, but now, in his early twenties,…

8 Google Employees Invented Modern AI. Here’s the Inside Story

8 Google Employees Invented Modern AI. Here’s the Inside Story

The last two weeks before the deadline were frantic. Though officially some of the team still had desks in Building 1945, they mostly worked in 1965 because it had a better espresso machine in the micro-kitchen. “People weren’t sleeping,” says Gomez, who, as the intern, lived in a constant debugging frenzy and also produced the…

Kids’ Cartoons Get a Free Pass From YouTube’s Deepfake Disclosure Rules

Kids’ Cartoons Get a Free Pass From YouTube’s Deepfake Disclosure Rules

YouTube has updated its rulebook for the era of deepfakes. Starting today, anyone uploading video to the platform must disclose certain uses of synthetic media, including generative AI, so viewers know what they’re seeing isn’t real. YouTube says it applies to “realistic” altered media such as “making it appear as if a real building caught…

Reddit’s Sale of User Data for AI Training Draws FTC Inquiry

Reddit’s Sale of User Data for AI Training Draws FTC Inquiry

Reddit said ahead of its IPO next week that licensing user posts to Google and others for AI projects could bring in $203 million of revenue over the next few years. The community-driven platform was forced to disclose Friday that US regulators already have questions about that new line of business. In a regulatory filing,…

The FCC Now Says Broadband Speed Should Be at Least 100 Mbps

The FCC Now Says Broadband Speed Should Be at Least 100 Mbps

The Federal Communications Commission this week voted to raise its internet speed benchmark for the first time since January 2015, concluding that modern broadband service should provide at least 100 Mbps download speeds and 20 Mbps upload speeds. An FCC press release after Thursday’s 3-2 vote said the 100 Mbps/20 Mbps benchmark “is based on…