AI role play generation

Higgs-Llama-3-70B is a post-training model based on Meta-Llama-3-70B, specifically optimized for role-playing while remaining competitive in general domain instruction execution and reasoning. Through supervised fine-tuning, the model combines human annotators and private large-scale language models to build preference pairs, and performs iterative preference optimization to align model behavior and make it closer to system messages. The Higgs model follows its roles more closely than other imperative models.