Elon Musk's xAI Releases Open Source Code for Grok AI Chatbot

Elon Musk's artificial intelligence company xAI has made good on his promise to open source its Grok chatbot, releasing the base model weights and architecture for the large language model on GitHub under the permissive Apache 2.0 license.

The release, called Grok-1, provides access to a 314 billion parameter "mixture-of-experts" model that xAI says was trained from scratch on a large amount of text data without being fine-tuned for any particular task like dialogue.

By open sourcing, Grok's core model, xAI, allows researchers, developers, and others to inspect, modify and build upon the AI's underlying architecture. It could enable external parties to improve Grok's capabilities as Musk's company competes with AI tech giants like OpenAI, Google and Meta in the generative AI race.

"We are releasing the weights and the architecture under the Apache 2.0 license," xAI said in a blog post announcing the open release. "To get started with using the model, follow the instructions at github.com/xai-org/grok-1."

The move follows through on Musk's March 11th tweet stating that xAI would "open source" Grok. In announcing the release, Musk also criticized OpenAI, the AI research company he co-founded but has since turned against, asking, "Tell us more about the 'Open' part of OpenAI."

Musk has been a vocal advocate for open-sourcing AI systems to increase transparency. He recently sued OpenAI, alleging it breached its founding mission to be an open-source company by pursuing profit with partner Microsoft.

While some smaller AI models like Mistral and Falcon are fully open source, the release of Grok-1 under Apache 2.0 terms is more permissive than the limited access offered by leading models like Meta's Llama 2.

However, the Grok-1 release only covers the base model architecture and weights. It does not include the data used to train the model, any task-specific fine-tuning, or real-time connections that power xAI's latest live version of Grok.

When Grok first launched in November 2023, xAI billed it as an "irreverent" AI assistant, but early tests found it lacked the coherence and capability of more advanced models like GPT-4 and PaLM. The open release allows external researchers to study and potentially improve Grok's core underpinnings.