Alibaba open sources Thousand Questions 3 quantification model, fully compatible with Apple's MLX framework.

On June 17th, Alibaba's Tongyi team released a brand new Quantitative Model Qianwen 3, which completed the deep adaptation of the entire series model based on the MLX framework of Apple hardware. The MLX framework is a machine learning framework optimized for Apple chips, which has received widespread attention in the AI open source community. This time, Qianwen 3 launched 32 official MLX quantization models at once, including different precisions such as 4bit, 6bit, 8bit, and BF16, which can meet the needs of developers to deploy large models on different Apple hardware such as Mac Studio, Macbook, iPhone, etc.