Meta AI releases OPT-175B large language model for research

Meta AI has released the Open Pretrained Transformer (OPT-175B), a large language model featuring 175 billion parameters. This release aims to democratize access to high-scale natural language processing (NLP) technology, which has previously been largely restricted to a few well-resourced laboratories through paid APIs.

To support open science, Meta is providing both the pretrained models and the training code. The model is released under a noncommercial license to prioritize research use cases. Access is intended for academic researchers, government and civil society affiliates, and industry research laboratories globally. The initiative seeks to enable the broader AI community to conduct reproducible research and address critical issues such as model bias, toxicity, and robustness.