📄 ai-sdk/docs/reference/stream-helpers/llamaindex-adapter

The @ai-sdk/llamaindex package provides helper functions to transform LlamaIndex output streams into data streams and data stream responses. See the LlamaIndex Adapter documentation for more information.

It supports:

LlamaIndex ChatEngine streams
LlamaIndex QueryEngine streams

Import

import { toDataResponse } from "@ai-sdk/llamaindex"

API Signature

Methods

toDataStream:

(stream: AsyncIterable<EngineResponse>, AIStreamCallbacksAndOptions) => AIStream

Converts LlamaIndex output streams to data stream.

toDataStreamResponse:

(stream: AsyncIterable<EngineResponse>, options?: {init?: ResponseInit, data?: StreamData, callbacks?: AIStreamCallbacksAndOptions}) => Response

Converts LlamaIndex output streams to data stream response.

mergeIntoDataStream:

(stream: AsyncIterable<EngineResponse>, options: { dataStream: DataStreamWriter; callbacks?: StreamCallbacks }) => void

Merges LlamaIndex output streams into an existing data stream.

Examples

Convert LlamaIndex ChatEngine Stream

app/api/completion/route.ts

import { OpenAI, SimpleChatEngine } from 'llamaindex';import { toDataStreamResponse } from '@ai-sdk/llamaindex';
export async function POST(req: Request) {  const { prompt } = await req.json();
  const llm = new OpenAI({ model: 'gpt-4o' });  const chatEngine = new SimpleChatEngine({ llm });
  const stream = await chatEngine.chat({    message: prompt,    stream: true,  });
  return toDataStreamResponse(stream);}

On this page

Convert LlamaIndex ChatEngine Stream

Deploy and Scale AI Apps with Vercel.

Vercel delivers the infrastructure and developer experience you need to ship reliable AI-powered applications at scale.

Trusted by industry leaders:

OpenAI
Photoroom

Talk to an expert