Meta's most recent large language model (LLM) release, Galactica, was supposed to help scientists navigate tons of published scientific information. Its developers presented it as being able to find citations, summarize academic literature, solve math problems, and perform other tasks that help scientists in research and writing papers.
However, three days after the release, Meta had to shut down the online demo following a deluge of criticism by scientists and tech media about the model's incorrect and biased output. While Galactica was obviously not a success, its short history provides us with some useful lessons about LLMs and the future of AI research.
View Full Article