On Friday, CEO Mark Zuckerberg announced that Meta has trained and will soon launch a new large language model named LLaMA. The purpose of this model is to assist scientists and engineers in exploring AI applications, including answering questions and summarizing documents.
The release of LLaMA by Meta’s Fundamental AI Research (FAIR) team is occurring as tech giants and well-funded startups race to showcase advancements in AI techniques and integrate them into commercial products. Large language models are the foundation of applications such as Microsoft’s Bing AI, OpenAI’s ChatGPT, and Google’s unreleased Bard.
According to Zuckerberg’s announcement, LLM technology has the potential to solve mathematical problems and conduct scientific research. “LLMs have exhibited great potential in generating text, holding conversations, summarizing written material, and performing more complex tasks, such as solving math theorems or predicting protein structures,” he wrote.
Here is LLamA’s announcement paper abstract, “We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. We train our models on trillions of tokens and show that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets. In particular, LLaMA-13B outperforms GPT-3 (175B) on most benchmarks, and LLaMA-65B is competitive with the best models, Chinchilla70B and PaLM-540B. We release all our models to the research community.”
