The ShuttleAI API provides the ability to stream responses back to a client in order to allow partial results for certain requests. To achieve this, we follow the Server-sent events standard.

Our official Python Library handles Server-sent events for you. In Python, a streaming request looks like:

Continue to Get Models to get started!

All additional optional kwargs will be listed in Endpoints category, be sure to check it out!