AI开发平台MODELARTS-DeepSeek蒸馏版模型基于ModelArts Lite Server适配vLLM的推理部署指导:支持的模型列表和权重文件

时间:2025-03-12 09:40:18

支持的模型列表和权重文件

支持的DeepSeek蒸馏版模型列表和权重文件获取路径如下,详细的模型介绍请参见DeepSeek-R1

表2 DeepSeek蒸馏版模型列表

Model

Base Model

Download

DeepSeek-R1-Distill-Qwen-1.5B

Qwen2.5-Math-1.5B

HuggingFace

DeepSeek-R1-Distill-Qwen-7B

Qwen2.5-Math-7B

HuggingFace

DeepSeek-R1-Distill-Llama-8B

Llama-3.1-8B

HuggingFace

DeepSeek-R1-Distill-Qwen-14B

Qwen2.5-14B

HuggingFace

DeepSeek-R1-Distill-Qwen-32B

Qwen2.5-32B

HuggingFace

DeepSeek-R1-Distill-Llama-70B

Llama-3.3-70B-Instruct

HuggingFace

support.huaweicloud.com/bestpractice-modelarts/modelarts_ds_infer_5901001.html