AI language model

Qwen1.5 is a series of decoder language models based on the Transformer architecture, including models of different sizes. Features include SwiGLU activation, attention QKV bias, group query attention, and more. Supports multiple natural languages ​​and codes. Follow-up training such as SFT, RLHF, etc. is recommended. Pricing is free.