News
AI Summary
21 Sept 202610 Rabiʻ II 1448 AH
TokenAI open-sources Horus Taleeq Arabic language model

TokenAI open-sources Horus Taleeq Arabic language model

TokenAI has launched the Horus Taleeq 0.2B model, an open-source small language model exclusively in Arabic, along with its training code and data sources under an MIT License. The model was trained from scratch on 6 billion Arabic tokens over 30 hours on a single NVIDIA RTX PRO 6000 Blackwell server. However, the model is only at the pre-training stage, lacking instruction tuning or safety alignment.

Follow these topics

Sign in to follow the topics that matter to you

Sign in to follow

This summary is generated with AI and receives periodic editorial review. Refer to the original source for full details.

0
0 reading now

Insight Score

Rate to unlock

Sign in to react, rate, and save. Sign In