QRWKV6-7B-Base / tokenization_rwkv6qwen2_fast.py

Upload tokenization_rwkv6qwen2_fast.py with huggingface_hub

4d3052d verified 7 months ago

144 Bytes

	from transformers.models.qwen2.tokenization_qwen2_fast import Qwen2TokenizerFast

	class RWKV6Qwen2TokenizerFast(Qwen2TokenizerFast):
	pass