|
| 1 | +--- |
| 2 | +title: LangDB |
| 3 | +description: Learn how to use LangDB with the AI SDK |
| 4 | +--- |
| 5 | + |
| 6 | +# LangDB |
| 7 | + |
| 8 | +[LangDB](https://langdb.ai) is a high-performance enterprise AI gateway built in Rust, designed to govern, secure, and optimize AI traffic. |
| 9 | + |
| 10 | +LangDB provides OpenAI-compatible APIs, enabling developers to connect with multiple LLMs by changing just two lines of code. With LangDB, you can: |
| 11 | + |
| 12 | +- Provide access to all major LLMs |
| 13 | +- Enable plug-and-play functionality using any framework like Langchain, Vercel AI SDK, CrewAI, etc., for easy adoption. |
| 14 | +- Simplify implementation of tracing and cost optimization features, ensuring streamlined operations. |
| 15 | +- Dynamically route requests to the most suitable LLM based on predefined parameters. |
| 16 | + |
| 17 | +## Setup |
| 18 | + |
| 19 | +The LangDB provider is available via the `@langdb/vercel-provider` module. You can install it with: |
| 20 | + |
| 21 | +<Tabs items={['pnpm', 'npm', 'yarn']}> |
| 22 | + <Tab> |
| 23 | + <Snippet text="pnpm add @langdb/vercel-provider" dark /> |
| 24 | + </Tab> |
| 25 | + <Tab> |
| 26 | + <Snippet text="npm install @langdb/vercel-provider" dark /> |
| 27 | + </Tab> |
| 28 | + <Tab> |
| 29 | + <Snippet text="yarn add @langdb/vercel-provider" dark /> |
| 30 | + </Tab> |
| 31 | +</Tabs> |
| 32 | + |
| 33 | +## Provider Instance |
| 34 | + |
| 35 | +To create a LangDB provider instance, use the `createLangDB` function: |
| 36 | + |
| 37 | +```tsx |
| 38 | +import { createLangDB } from '@langdb/vercel-provider'; |
| 39 | + |
| 40 | +const langdb = createLangDB({ |
| 41 | + apiKey: process.env.LANGDB_API_KEY, // Required |
| 42 | + projectId: 'your-project-id', // Required |
| 43 | + threadId: uuidv4(), // Optional |
| 44 | + runId: uuidv4(), // Optional |
| 45 | + label: 'code-agent', // Optional |
| 46 | + headers: { 'Custom-Header': 'value' }, // Optional |
| 47 | +}); |
| 48 | +``` |
| 49 | + |
| 50 | +You can find your LangDB API key in the [LangDB dashboard](https://app.langdb.ai). |
| 51 | + |
| 52 | +## Examples |
| 53 | + |
| 54 | +You can use LangDB with the `generateText` or `streamText` function: |
| 55 | + |
| 56 | +### `generateText` |
| 57 | + |
| 58 | +```tsx |
| 59 | +import { createLangDB } from '@langdb/vercel-provider'; |
| 60 | +import { generateText } from 'ai'; |
| 61 | + |
| 62 | +const langdb = createLangDB({ |
| 63 | + apiKey: process.env.LANGDB_API_KEY, |
| 64 | + projectId: 'your-project-id', |
| 65 | +}); |
| 66 | + |
| 67 | +export async function generateTextExample() { |
| 68 | + const { text } = await generateText({ |
| 69 | + model: langdb('openai/gpt-4o-mini'), |
| 70 | + prompt: 'Write a Python function that sorts a list:', |
| 71 | + }); |
| 72 | + |
| 73 | + console.log(text); |
| 74 | +} |
| 75 | +``` |
| 76 | + |
| 77 | +### generateImage |
| 78 | + |
| 79 | +```tsx |
| 80 | +import { createLangDB } from '@langdb/vercel-provider'; |
| 81 | +import { experimental_generateImage as generateImage } from 'ai'; |
| 82 | +import fs from 'fs'; |
| 83 | +import path from 'path'; |
| 84 | + |
| 85 | +const langdb = createLangDB({ |
| 86 | + apiKey: process.env.LANGDB_API_KEY, |
| 87 | + projectId: 'your-project-id', |
| 88 | +}); |
| 89 | + |
| 90 | +export async function generateImageExample() { |
| 91 | + const { images } = await generateImage({ |
| 92 | + model: langdb.image('openai/dall-e-3'), |
| 93 | + prompt: 'A delighted resplendent quetzal mid-flight amidst raindrops', |
| 94 | + }); |
| 95 | + |
| 96 | + const imagePath = path.join(__dirname, 'generated-image.png'); |
| 97 | + fs.writeFileSync(imagePath, images[0].uint8Array); |
| 98 | + console.log(`Image saved to: ${imagePath}`); |
| 99 | +} |
| 100 | +``` |
| 101 | + |
| 102 | +### embed |
| 103 | + |
| 104 | +```tsx |
| 105 | +import { createLangDB } from '@langdb/vercel-provider'; |
| 106 | +import { embed } from 'ai'; |
| 107 | + |
| 108 | +const langdb = createLangDB({ |
| 109 | + apiKey: process.env.LANGDB_API_KEY, |
| 110 | + projectId: 'your-project-id', |
| 111 | +}); |
| 112 | + |
| 113 | +export async function generateEmbeddings() { |
| 114 | + const { embedding } = await embed({ |
| 115 | + model: langdb.textEmbeddingModel('text-embedding-3-small'), |
| 116 | + value: 'sunny day at the beach', |
| 117 | + }); |
| 118 | + |
| 119 | + console.log('Embedding:', embedding); |
| 120 | +} |
| 121 | +``` |
| 122 | + |
| 123 | + |
| 124 | +## Supported Models |
| 125 | + |
| 126 | +LangDB supports over 250+ models, enabling seamless interaction with a wide range of AI capabilities. |
| 127 | + |
| 128 | +Checkout the [model list](https://app.langdb.ai/models) for more information. |
| 129 | + |
| 130 | +For more information, visit the [LangDB documentation](https://docs.langdb.ai/). |
0 commit comments