Microsoft has been actively promoting Small Language Models (SLMs), expanding its Phi series with the introduction of the Phi-3.5 line. This new series includes the Phi-3.5-mini, Phi-3.5-MoE, and Phi-3.5-vision models, with parameters typically ranging from billions to tens of billions.