Meta Releases ‘Galactica’ AI System Which Can Produce Academic Papers Based on Simple Prompts!

Yeah, this totally won’t be used for ill-purpose, and should absolutely be made available to the world.

 This week, Meta has launched a demo version of its new Galactic  Language, which is able to summarize academic literature, solve math problems, generate Wiki articles, and more, all based on simple text prompts.

Galactica

  

 “Galactic  model are trained on a large corpus comprising more than 360 millions in-context citations and over 50 million unique references normalized across a diverse set of sources. This enables Galactic  suggest citations and help discover related papers.

 As you can see in the above screenshot, at the Galactic  demo site, you can enter any subject, and it will produce articles and explainers based on that prompt.

Galactica

 Tap on the ‘Generate More’ prompt at the bottom of the screen, and the system will keep adding to your document, providing more and more text on the topic.

Galactica

 As a writing example, it’s not great. If you read through the text, it’s not well-written - though it is designed for more scientific papers than topical pieces like this

 

 Essentially, it’s like an AI image generator, but for scientific papers. Which is absolutely going to be used by students to cheat the system, and improve their grades with less, maybe even no effort in some cases.

 Which Meta, too, is well aware of, which is why it’s also added a range of warnings like this:

 “Some of Galactic a generated text may appear very authentic and highly-confident, but might be subtly wrong in important ways. This is particularly the case for highly technical content.

 Meta’s Chief AI Scientist Yann LeCunn has also explained that:

 “This tool is to paper writing as driving assistance is  driving. It won’t write papers automatically for you, but it will greatly reduce your cognitive load while you write them.

 So it’ll do most of the things, but not all of them, while as you can see in this example, the language is still pretty disjointed, at least based on this example, that teachers will likely be able to tell if you’re using such a system.

 Though maybe not. There are already various reports of students generating assignment in school items, with some particularly entrepreneurial kids also selling AI generated homework to their classmates to get them out of homework.

 Tools like Galactic a  likely to worsen this trend – but then again, the papers that it generates are only based on old ideas, so you’re not going to get any new innovations from machine-learned processes.

 I guess, then, it depends on the purpose of the paper you’re creating. Are you looking to advance in your field, or just get the homework done?

 In any event, it’s interesting to see how AI is advancing, and how systems are moving into more creative, cognitive processes over time.

 Large language models (LLMs), such as OpenAI's GPT-3, learn to write text by studying millions of examples and understanding the statistical relationships between words. As a result, they can author convincing-sounding documents, but those works can also be riddled with falsehood and potentially harmful stereotypes. Some critics call LLMs "stochastic parrots" for their ability to convincingly spit out text without understanding its meaning.

  Enter Galactic, an LLM aimed at writing scientific literature. Its authors trained Galactic on "a large and curated corpus of humanity’s scientific knowledge," including over 48 million papers, textbooks and lecture notes, scientific websites, and encyclopedias. According to Galactic a paper, Meta AI researchers believed this purported high-quality data would lead to high-quality output.

Enjoyed this article? Stay informed by joining our newsletter!

Comments

You must be logged in to post a comment.

About Author