Preprocessor is broken
#5
by
reewuiq
- opened
The latest commit 489efed (preprocessor updates) seems to break the model. Following the tutorial on the model card, the output from processor.tokenizer.apply_chat_template looks like
<|im_start|>user
# Template:
{"names": ["string"]}
# Context:
message['content'] | trim -}}<|im_end|>
<|im_start|>assistant
Notice the garbled "Context" section. The previous commit fe5b2f0b works as intended.
@SorenDreano , does the new version actually work for you? Could you please verify and revert this if necessary?
Hi, thanks for pointing this out!
There was a typo in the chat_template -- it should be fixed now :)