Llama 4 结果数据造假,Yann LeCun 接受 FT 采访爆料
FT 原文 https://drive.google.com/file/d/1wFy87TP7MJQDF1g0KA8IgZRtOx0jJUGE/view?usp=drivesdk
Yann LeCun, Meta's outgoing chief AI scientist and one of the pioneers credited with laying the groundwork for modern AI, has acknowledged that the company's Llama 4 language model had its benchmark results manipulated before its April 2025 release. In an interview with the Financial Times, LeCun said the "results were fudged a little bit" and that the team "used different models for different benchmarks to give better results."
Llama 4 was widely criticized as a flop at launch, and the company faced accusations of gaming benchmarks to make the model appear more capable than it was. LeCun said CEO Mark Zuckerberg was "really upset and basically lost confidence in everyone who was involved" in the release.
Zuckerberg subsequently "sidelined the entire GenAI organisation," according to LeCun. "A lot of people have left, a lot of people who haven't yet left will leave." LeCun himself is departing Meta after more than a decade to start a new AI research venture called Advanced Machine Intelligence Labs. He described the new hires brought in for Meta's superintelligence efforts as "completely LLM-pilled" -- a technology LeCun has repeatedly called "a dead end when it comes to superintelligence."
Meta即将离任的首席AI科学家、被誉为现代AI奠基人之一的Yann LeCun承认,公司在2025年4月发布Llama 4语言模型前操纵了基准测试结果。这位图灵奖得主向英国《金融时报》透露,团队"对结果进行了小幅润色",且"针对不同基准测试使用了不同模型以呈现更好数据"。
Llama 4发布时因表现欠佳广受批评,Meta被指控通过操纵基准测试夸大模型能力。LeCun表示CEO马克·扎克伯格对此"极为震怒,基本上对参与该项目的所有人失去了信任"。据其透露,扎克伯格随后"边缘化了整个生成式AI部门",并预言"许多人已经离职,更多人员将陆续离开"。
在Meta任职十余年的LeCun即将创办名为"高级机器智能实验室"的新AI研究机构。他批评Meta为超级智能项目招募的新员工"完全沉迷于LLM技术"——这种被LeCun多次称为"通往超级智能的死胡同"的技术。