📄 ai-sdk/cookbook/api-servers/node-http-server

import { openai } from '@ai-sdk/openai';import { streamText } from 'ai';import { createServer } from 'http';
createServer(async (req, res) => {  const result = streamText({    model: openai('gpt-4o'),    prompt: 'Invent a new holiday and describe its traditions.',  });
  result.pipeUIMessageStreamToResponse(res);}).listen(8080);

Sending Custom Data

createUIMessageStream and pipeUIMessageStreamToResponse can be used to send custom data to the client.

index.ts

import { openai } from '@ai-sdk/openai';import {  createUIMessageStream,  pipeUIMessageStreamToResponse,  streamText,} from 'ai';import { createServer } from 'http';
createServer(async (req, res) => {  switch (req.url) {    case '/stream-data': {      const stream = createUIMessageStream({        execute: ({ writer }) => {          // write some custom data          writer.write({ type: 'start' });
          writer.write({            type: 'data-custom',            data: {              custom: 'Hello, world!',            },          });
          const result = streamText({            model: openai('gpt-4o'),            prompt: 'Invent a new holiday and describe its traditions.',          });
          writer.merge(            result.toUIMessageStream({              sendStart: false,              onError: error => {                // Error messages are masked by default for security reasons.                // If you want to expose the error message to the client, you can do so here:                return error instanceof Error ? error.message : String(error);              },            }),          );        },      });
      pipeUIMessageStreamToResponse({ stream, response: res });
      break;    }  }}).listen(8080);

Text Stream

You can send a text stream to the client using pipeTextStreamToResponse.

index.ts

import { openai } from '@ai-sdk/openai';import { streamText } from 'ai';import { createServer } from 'http';
createServer(async (req, res) => {  const result = streamText({    model: openai('gpt-4o'),    prompt: 'Invent a new holiday and describe its traditions.',  });
  result.pipeTextStreamToResponse(res);}).listen(8080);

Troubleshooting

Streaming not working when proxied

On this page

Deploy and Scale AI Apps with Vercel.

Vercel delivers the infrastructure and developer experience you need to ship reliable AI-powered applications at scale.

Trusted by industry leaders:

OpenAI
Photoroom

Talk to an expert