#1 AntAngelMed: 103B-Parameter Open-Source Medical LLM Released Using MoE Architecture
A research team from China has launched AntAngelMed, an open-source medical language model with 103 billion parameters. It utilizes a Mixture-of-Experts (MoE) architecture with a 1/32 activation ratio, activating only 6.1 billion parameters per query for up to 7x efficiency gains. AntAngelMed ranks highly on medical benchmarks like HealthBench and MedAIBench, supporting a 128K context length.