Amazon API Gateway Adds Support for Response Streaming in REST APIs

Amazon API Gateway has some exciting news for users! They now offer response streaming for REST APIs, which means response payloads are sent to clients as they become available. This is a game-changer for improving the responsiveness of REST APIs, as it eliminates the need to buffer complete responses before sending them out. This feature is compatible with backends that support streaming, such as Lambda functions, HTTP proxy integrations, and private integrations.

The benefits of response streaming are threefold. First, it improves time-to-first-byte (TTFB) performance, making responses appear incrementally in real-time for generative AI applications. Second, it extends integration timeouts up to 15 minutes, which is great for more complex models that take longer to process. Lastly, it supports payloads larger than 10 MB, making it easier to directly stream media files and large datasets without the need for workarounds like pre-signed Amazon S3 URLs.

If you’re curious about pricing for this feature, check out the Amazon API Gateway pricing page. And the best part? Amazon API Gateway response streaming is available in all AWS Regions, including the AWS GovCloud (US) Regions, and works with regional, private, and edge-optimized endpoints. Ready to get started? Head over to the Amazon API Gateway documentation, AWS blog, and customer success blog posts for more information. Happy streaming!