runtime error

Exit code: 1. Reason: ^ File "/usr/local/lib/python3.11/site-packages/transformers/trainer.py", line 1509, in _inner_training_loop self._run_epoch( File "/usr/local/lib/python3.11/site-packages/transformers/trainer.py", line 1737, in _run_epoch tr_loss_step = self.training_step(model, inputs, num_items_in_batch) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/trl/trainer/grpo_trainer.py", line 1113, in training_step output = super().training_step(model, inputs, num_items_in_batch) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/transformers/trainer.py", line 1903, in training_step inputs = self._prepare_inputs(inputs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/trl/extras/profiling.py", line 202, in wrapper return func(self, *args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/trl/trainer/grpo_trainer.py", line 1142, in _prepare_inputs generation_batch = self._generate_and_score_completions(generation_batch) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/trl/trainer/grpo_trainer.py", line 1862, in _generate_and_score_completions ) = self._generate(prompts) ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/trl/trainer/grpo_trainer.py", line 1774, in _generate is_truncated = torch.tensor([ids[-1] not in eos_and_pad for ids in completion_ids], device=device) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/trl/trainer/grpo_trainer.py", line 1774, in <listcomp> is_truncated = torch.tensor([ids[-1] not in eos_and_pad for ids in completion_ids], device=device) ~~~^^^^ IndexError: list index out of range 0%| | 0/3 [00:00<?, ?it/s]

Container logs: