Preprocessor is broken

#5
by reewuiq - opened

The latest commit 489efed (preprocessor updates) seems to break the model. Following the tutorial on the model card, the output from processor.tokenizer.apply_chat_template looks like

<|im_start|>user
# Template:
{"names": ["string"]}
# Context:
message['content'] | trim -}}<|im_end|>
<|im_start|>assistant

Notice the garbled "Context" section. The previous commit fe5b2f0b works as intended.

@SorenDreano , does the new version actually work for you? Could you please verify and revert this if necessary?

NuMind org

Hi, thanks for pointing this out!

There was a typo in the chat_template -- it should be fixed now :)

Sign up or log in to comment