EXAONE-3.5-32B-Instruct-GGUF

EXAONE-3.5-32B-Instruct-GGUF is a series of instruction-tuned bilingual (English and Korean) generative models developed by LG AI Research, containing different versions of parameters from 2.4B to 32B. These models support long context processing up to 32K tokens, demonstrating state-of-the-art performance in real-world use cases and long context understanding, while remaining competitive in the general domain compared to recently released models of similar scale. The model family is detailed via technical reports, blogs, and GitHub, and contains instruction-tuned 32B language models in multiple precisions with the following characteristics: 30.95B parameter count (excluding embeddings), 64 layers, GQA attention heads, and Containing 40 Q headers and 8 KV headers, the vocabulary is 102,400, the context length is 32,768 tokens, and the quantization includes Q8_0, Q6_0, Q5_K_M, Q4_K_M, IQ4_XS and other GGUF formats (also including BF16 weights).

The target audience is researchers, developers and enterprises who require high-performance language models, especially in scenarios where large amounts of data and long context information need to be processed. EXAONE-3.5-32B-Instruct-GGUF is suitable for natural language processing, text generation, machine translation and other tasks due to its powerful performance and multi-language support, helping users improve work efficiency and the ability to handle complex problems.