microsoft/Phi-3.5-MoE-instruct Model SummaryPhi-3.5-MoE i... | microsoft/Phi-3.5-MoE-instruct Model SummaryPhi-3.5-MoE i...
microsoft/Phi-3.5-MoE-instruct
Model Summary
Phi-3.5-MoE is a lightweight, state-of-the-art open model built upon datasets used for Phi-3 - synthetic data and filtered publicly available documents - with a focus on very high-quality, reasoning dense data. The model supports multilingual and comes with 128K context length (in tokens). The model underwent a rigorous enhancement process, incorporating supervised fine-tuning, proximal policy optimization, and direct preference optimization to ensure precise instruction adherence and robust safety measures.
๐Ÿก Phi-3 Portal ๐Ÿ“ฐ Phi-3 Microsoft Blog ๐Ÿ“– Phi-3 Technical Report ๐Ÿ‘ฉโ€๐Ÿณ Phi-3 Cookbook ๐Ÿ–ฅ๏ธ Try It