Models take too long to generate a response

#566
by deleted - opened
deleted

I've noticed that the models often take an unusually long time to respond, sometimes minutes, which is extremely cumbersome. Please consider improving the speed performance of the models. Maybe server infrastructure optimization would improve.

deleted changed discussion title from Models Take too Long to Generate a Response to Models take too long to generate a response

What's happening?

Sign up or log in to comment