Sign In

Communications of the ACM

ACM News

Meta Has Built a Massive New Language AI—And It's Giving It Away for Free

View as: Print Mobile App Share:

Large language models have become one of the hottest trends in artificial intelligence in the last couple of years, but they have deep flaws, parroting misinformation, prejudice, and toxic language.

Credit: Ms Tech/Unsplash

Meta's AI lab has created a massive new language model that shares both the remarkable abilities and the harmful flaws of OpenAI's pioneering neural network GPT-3. And in an unprecedented move for Big Tech, it is giving it away to researchers—together with details about how it was built and trained.

"We strongly believe that the ability for others to scrutinize your work is an important part of research. We really invite that collaboration," says Joelle Pineau, a longtime advocate for transparency in the development of technology, who is now managing director at Meta AI.

Meta's move is the first time that a fully trained large language model will be made available to any researcher who wants to study it. The news has been welcomed by many concerned about the way this powerful technology is being built by small teams behind closed doors.

From MIT Technology Review
View Full Article



No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account