Skip to content

Qwen-72B

30 November 2023

Qwen-72B from Alibaba, language model published 2023-11-30. Notable for: sota improvement.

Abstract

Qwen-72B is the 72B-parameter version of the large language model series, Qwen (abbr. Tongyi Qianwen), proposed by Alibaba Cloud. Qwen-72B is a Transformer-based large language model, which is pretrained on a large volume of data, including web texts, books, codes, etc. Additionally, based on the pretrained Qwen-72B, we release Qwen-72B-Chat, a large-model-based AI assistant, which is trained with alignment techniques.

Sources: Epoch AI. This entry was generated from a dataset and has not been edited by hand.