Sign In

Communications of the ACM

ACM Opinion

Can Large Language Models Be Democratized?

View as: Print Mobile App Share:
Voxel-based robot head stares into a digital world.

The costs of training, configuring, and running large language models remain prohibitive and are likely to grow in the future.

Credit: Getty Images

Meta's Open Pretrained Transformer (OPT-175B) is the latest entrant in the large language model (LLM) arms race triggered by OpenAI's GPT-3. What makes OPT-175B unique is Meta's apparent commitment to "openness." In a post published on the Meta AI blog, the company described its release as, "Democratizing access to large-scale language models."

While Meta's move toward transparency is commendable, the competition over LLMs has reached a point where it can no longer be democratized.

From TechTalks
View Full Article



No entries found