File: hugging-face-stream.md | Updated: 11/15/2025
Menu
v5 (Latest)
AI SDK 5.x
Model Context Protocol (MCP) Tools
AWSBedrockAnthropicMessagesStream
Copy markdown
==============================================================================================================
HuggingFaceStream has been removed in AI SDK 4.0.
HuggingFaceStream is part of the legacy Hugging Face integration. It is not compatible with the AI SDK 3.1 functions.
Converts the output from language models hosted on Hugging Face into a ReadableStream.
While HuggingFaceStream is compatible with most Hugging Face language models, the rapidly evolving landscape of models may result in certain new or niche models not being supported. If you encounter a model that isn't supported, we encourage you to open an issue.
To ensure that AI responses are comprised purely of text without any delimiters that could pose issues when rendering in chat or completion modes, we standardize and remove special end-of-response tokens. If your use case requires a different handling of responses, you can fork and modify this stream to meet your specific needs.
Currently, </s> and <|endoftext|> are recognized as end-of-stream tokens.
import { HuggingFaceStream } from "ai"
AsyncGenerator<any>
This parameter should be the generator function returned by the hf.textGenerationStream method in the Hugging Face Inference SDK.
AIStreamCallbacksAndOptions
An object containing callback functions to handle the start, each token, and completion of the AI response. In the absence of this parameter, default behavior is implemented.
AIStreamCallbacksAndOptions
() => Promise<void>
An optional function that is called at the start of the stream processing.
(completion: string) => Promise<void>
An optional function that is called for every completion. It's passed the completion as a string.
(completion: string) => Promise<void>
An optional function that is called once when the stream is closed with the final completion message.
(token: string) => Promise<void>
An optional function that is called for each token in the stream. It's passed the token as a string.
A ReadableStream.
On this page
Deploy and Scale AI Apps with Vercel.
Vercel delivers the infrastructure and developer experience you need to ship reliable AI-powered applications at scale.
Trusted by industry leaders: