AI开发平台MODELARTS-InternVL2基于DevServer适配PyTorch NPU训练微调指导(6.3.908):Step8 开始训练

时间:2024-11-12 16:42:36

Step8 开始训练

LoRA微调训练或者全参微调训练命令如下。

cd ${container_work_dir}/InternVL/internvl_chat
# 8B全参微调
GPUS=8 PER_DEVICE_BATCH_SIZE=2 sh shell/internvl2.0/2nd_finetune/internvl2_8b_internlm2_7b_dynamic_res_2nd_finetune_full.sh 
# 8Blora微调
GPUS=8 PER_DEVICE_BATCH_SIZE=2 sh shell/internvl2.0/2nd_finetune/internvl2_8b_internlm2_7b_dynamic_res_2nd_finetune_lora.sh 
# 26Blora微调
GPUS=8 PER_DEVICE_BATCH_SIZE=2 sh shell/internvl2.0/2nd_finetune/internvl2_26b_internlm2_20b_dynamic_res_2nd_finetune_lora.sh # 
40Blora微调
GPUS=8 PER_DEVICE_BATCH_SIZE=2 sh shell/internvl2.0/2nd_finetune/internvl2_40b_hermes2_yi_34b_dynamic_res_2nd_finetune_lora.sh

训练成功如下图所示。

support.huaweicloud.com/bestpractice-modelarts/modelarts_aigc_9087.html