p1atdev
/

multi-tokenizers-processor-sample

multi-tokenizers-processor-sample / processor_config.json

Upload tokenizer

b5e658d verified about 1 year ago

173 Bytes

	{
	"auto_map": {
	"AutoProcessor": [
	"processor_multitokenizers.MultiTokenizersProcessor",
	null
	]
	},
	"processor_class": "MultiTokenizersProcessor"
	}