About the prompt

[frkmac3]

Driving-with-LLMs/utils/training_utils.py

Line 211 in ae36cc3

{data_point["output"]}"""

Hi, codes here already integrated output label into prompt, so the model already know the real label before prediction? So what about the testing stage when the model don't know the real label?

[melights]

Hi @frkmac3, during testing stage, the generation function use user_input_ids to prompt the model, which doesn't contains the label.

Driving-with-LLMs/models/vector_lm.py

Line 270 in ae36cc3

kwargs["input_ids"] = kwargs.pop("user_input_ids")

Hope that helps. If you have any further questions or need additional information, please feel free to ask.

[MLgeek7325]

您好，您的邮件我已收到！