Text Generation
Transformers
Safetensors
PyTorch
nvidia
conversational

Add Streaming Tool Calling support

#26

Added a partial implementation for streaming tool calling, this is in no way guaranteed to be a complete algorithm, and is not very efficient. However, running this against an ai-sdk client works well enough.

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment