Connect with us

Hi, what are you looking for?

HEADLINES

Alibaba Cloud open-sources more LLMs with diverse sizes and multimodal features

Alibaba Cloud makes available more multimodal LLMs including Qwen-Audio and Qwen-Audio-Chat, a pre-trained audio understanding model and its conversationally fine tuned version for research and commercial purposes.

Alibaba Cloud, the digital technology and intelligence backbone of Alibaba Group, announced that it has open-sourced two large language models (LLM), Qwen-72B and Qwen-1.8B, the 72-billion-parameter and 1.8-billion-parameter versions of its proprietary foundation model Tongyi Qianwen, on its AI model community ModelScope, and the collaborative AI platform Hugging Face.

In addition, Alibaba Cloud makes available more multimodal LLMs including Qwen-Audio and Qwen-Audio-Chat, a pre-trained audio understanding model and its conversationally fine tuned version for research and commercial purposes.

As of today, the cloud computing pioneer has contributed various sizes of LLMs with parameters ranging from 1.8B, 7B, 14B to 72B, as well as multimodal LLMs with audio and visual understanding features.

“Building up an open-source ecosystem is critical to promoting the development of LLM and AI applications building. We aspire to become the most open cloud and make generative AI capabilities accessible to everyone,” said Jingren Zhou, CTO of Alibaba Cloud. “To achieve that goal, we’ll continue to share our cutting-edge technology and facilitate the development of the open-source community together with our partners.”

Advertisement. Scroll to continue reading.

Pre-trained on over 3 trillion tokens, the 72-billion-parameter model outperforms other major open-source models in ten benchmarks, including Massive Multi-task Language Understanding (MMLU) benchmark that measures the model’s multitask accuracy, HumanEval that tests code generation capabilities and GSM8K, a benchmark for arithmetic problems, to name a few.

The model also exhibits proficiency in tackling a variety of intricate tasks, including role-playing and language style transfer, referring to the ability of the LLM to assume a specific role or persona and generate more contextually relevant responses consistent with the persona. Such features can be useful in AI applications such as personalized chatbots. 

Companies and research institutions can access the Qwen-72B model’s code, model weights, and documentation and use them for free for research purposes. For commercial uses, the models will be free to use for companies with fewer than 100 million monthly active users. 

Alibaba Cloud also announced that it has open-sourced the 1.8-billion-parameter of its LLM that can run on the edge. The lightweight LLM enables inference on edge devices with constrained computational resource, making it possible to be deployed on end devices such as cellphones.

The smaller-sized version, with less computing resource requirement, can be useful for individuals looking for a more cost-effective, easy-to-deploy option in using LLMs. The 1.8B model is currently only available for research purposes.

Advertisement. Scroll to continue reading.

To offer LLMs that can process a greater variety of input formats, Alibaba Cloud also announced that it has open-sourced Qwen-Audio and Qwen-Audio-Chat, the models with enhanced audio understanding capabilities for research and commercial purposes.

Qwen-Audio can understand text and audio input in diverse formats, including human speech, natural sound and music and produce text as output. It is capable of performing over 30 audio processing tasks, such as multi-language transcription, speech editing, audio caption analysis etc. Its conversationally fine tuned version, Qwen-Audio-Chat, can support multiple rounds of question-and-answering based on the audio and perform diverse audio-oriented tasks, such as detection of emotions and tones in human speeches.

The initiative marks another attempt from Alibaba Cloud to offer multi-modal large language models that can understand datatypes beyond text to the open-source community. Earlier this year, it announced the launch of open-source Large Vision Language Model Qwen-VL and its chat version Qwen-VL-Chat that can understand visual information and perform visual tasks.

The open-sourced LLM models, including Qwen-7B, Qwen-14B and Qwen-VL and their conversationally fine tuned versions, have gained a combined downloads of over 1.5 million times on Alibaba Cloud’s open-source AI model community ModelScope and Hugging Face since August. ModelScope has become the largest AI model community in China, boasting over 2.8 million active developers, with over 100 million model downloads to date.

Advertisement. Scroll to continue reading.
Advertisement
Advertisement
Advertisement

Like Us On Facebook

You May Also Like

HEADLINES

Recently, Globe held its first disability sensitivity training to give participants a better understanding about disability, how to tackle communications about disability, and ways...

HEADLINES

The recently launched HONOR Magic6 Pro, Top AI Camera phone is now accessible to Bacolodnons for only Php 59,999 available in Epi Green and...

HEADLINES

GFiber Prepaid distinguishes itself from existing fiber plans by eliminating monthly bills and lock-up periods.

COMPUTERS

Customers who pre-register on Samsung’s website by June 2 will receive vouchers of up to Php 5,000 redeemable for select monitors on Samsung.com from...

HEADLINES

Multiple Lenovo initiatives honored through 2024 SEAL Business Sustainability Awards.

HEADLINES

These features combine the power of Apple hardware and software, harnessing Apple silicon, artificial intelligence, and machine learning to further Apple’s decades-long commitment to...

HEADLINES

All Smart Prepaid and Smart Postpaid subscribers may enjoy the long weekend or escape to entertaining streaming breaks with affordable premium streaming subscriptions as...

ELECTRONICS

Cherry Philippines is now offering a range of IoT products that can transform a regular home into a smart home such as smart locks,...

Advertisement