Qwen 1.5 MoE
huggingface.co
Highly efficient mixture-of-expert (MoE) model from Alibaba
Qwen1.5-MoE-A2.7B is a small mixture-of-expert (MoE) model with only 2.7 billion activated parameters yet matches the performance of state-of-the-art 7B models like Mistral 7B and Qwen1.5-7B.
Specs
| Type | Model |
| Section | LLMs |
| Pricing | open source |
| Systems | Web |
| Site language | en |
| Rating | 5.00 (2 reviews) |
| Launched | 2024-04-02 |