Ola Reveals AI Company Krutrim For Made In India LLMs & Semiconductors

Krutrim, a subsidiary of the Ola group, has unveiled its latest AI cloud, a new AI chip, and an array of models that go beyond the traditional scope of Large Language Models (LLMs). This initiative marks a significant stride in the AI capabilities within the Ola group.

The company introduced its first models, Krutrim and Krutrim Pro. Krutrim, the base LLM, is trained with 2 trillion tokens, while Krutrim Pro, a larger multimodal model, is expected to be released next quarter. Ola.krutrim.com, a new chat application, has also been launched as part of this initiative.

Bhavish Agarwal, founder and CEO of Ola, showcased Krutrim's capabilities during a live demonstration. He highlighted the AI's proficiency in languages, with demonstrations of Tamil and Bengali poetry composition, and code generation. Agarwal revealed that Ola and its subsidiaries have been utilising Krutrim for various purposes, including handling customer support queries.

Krutrim claims to have superior performance in several Indic languages, including Marathi, Bengali, Malayalam, Kannada, and Tamil, compared to GPT-4. In the domain of Indic English, while it outperforms Llma 2, it faces competition from GPT-4 and Gemini on Bard.

During the event, Ola executives demonstrated Krutrim’s comparative efficiency against Llma 2 in both English and Indic languages. Krutrim is being developed as a foundational AI model for India, incorporating specialised domain training and tuning.

The team at Ola has also been working on a novel chiplet architecture for system-in-package solutions, aimed at catering to the needs of Indian companies, particularly in edge and automotive products. The ambition extends to building India's first supercomputer, with the team showcasing the early stages of a custom silicon layout and design for fabrication.

Sambit Sahu, who leads the project, brings extensive experience in chip design from his previous roles at Intel and Qualcomm. He was in fact leading engineering for Qualcomm in India and at intel was the engineering lead for the IoT business. The team has also developed server racks designed for liquid immersion, emphasising in-house innovation.

Agarwal discussed plans for a highly efficient data center with a PUV of 1.1, aiming to reduce energy consumption. Initially, Krutrim will be rolled out to users in batches, with plans to scale up and make Krutrim Pro publicly available by next year.

The project, poised for tape out next year and expecting production samples by the end of 2025, signifies a major advancement in the AI field for the Ola group and India's tech industry at large.