[BUG]When fine-tuning an LLM, the following error occurs after training for some time: self.optimizer.param_groups[param_group_id]['params'] = [] IndexError: list index out of range

[tdtgi]

File "/share/home/xxx/miniconda3/envs/qwen2_vl_FT/lib/python3.10/site-packages/deepspeed/runtime/zero/stage3.py", line 2095, in step
[rank2]: self._optimizer_step(sub_group_id)
[rank2]: File "/share/home/xxx/miniconda3/envs/qwen2_vl_FT/lib/python3.10/site-packages/deepspeed/runtime/zero/stage3.py", line 980, in _optimizer_step
[rank2]: self.optimizer.param_groups[param_group_id]['params'] = []
[rank2]: IndexError: list index out of range

[jomayeri]

Can you provide reproduction code?

[tdtgi]

Can you provide reproduction code?

I am fine-tuning the LLM using LLaMA Factory.