Skip to content

Commit c3ceb35

Browse files
authored
feat (docs): LangDB AI Gateway community provider (#5002)
1 parent c3d33dd commit c3ceb35

File tree

4 files changed

+133
-0
lines changed

4 files changed

+133
-0
lines changed

content/docs/02-foundations/02-providers-and-models.mdx

+1
Original file line numberDiff line numberDiff line change
@@ -62,6 +62,7 @@ The open-source community has created the following providers:
6262
- [Mem0 Provider](/providers/community-providers/mem0)(`@mem0/vercel-ai-provider`)
6363
- [Spark Provider](/providers/community-providers/spark) (`spark-ai-provider`)
6464
- [AnthropicVertex Provider](/providers/community-providers/anthropic-vertex-ai) (`anthropic-vertex-ai`)
65+
- [LangDB Provider](/providers/community-providers/langdb) (`@langdb/vercel-provider`)
6566

6667
## Self-Hosted Models
6768

content/docs/02-guides/04-r1.mdx

+1
Original file line numberDiff line numberDiff line change
@@ -121,6 +121,7 @@ You can use DeepSeek R1 with the AI SDK through various providers. Here's a comp
121121
| [Azure](/providers/ai-sdk-providers/azure) | [`DeepSeek-R1`](https://ai.azure.com/explore/models/DeepSeek-R1/version/1/registry/azureml-deepseek#code-samples) | Requires Middleware |
122122
| [Together AI](/providers/ai-sdk-providers/togetherai) | [`deepseek-ai/DeepSeek-R1`](https://www.together.ai/models/deepseek-r1) | Requires Middleware |
123123
| [FriendliAI](/providers/community-providers/friendliai) | [`deepseek-r1`](https://huggingface.co/deepseek-ai/DeepSeek-R1) | Requires Middleware |
124+
| [LangDB](/providers/ai-sdk-providers/langdb) | [`deepseek/deepseek-reasoner`](https://docs.langdb.ai/guides/deepseek) | Requires Middleware |
124125

125126
### Building Interactive Interfaces
126127

Original file line numberDiff line numberDiff line change
@@ -0,0 +1,130 @@
1+
---
2+
title: LangDB
3+
description: Learn how to use LangDB with the AI SDK
4+
---
5+
6+
# LangDB
7+
8+
[LangDB](https://langdb.ai) is a high-performance enterprise AI gateway built in Rust, designed to govern, secure, and optimize AI traffic.
9+
10+
LangDB provides OpenAI-compatible APIs, enabling developers to connect with multiple LLMs by changing just two lines of code. With LangDB, you can:
11+
12+
- Provide access to all major LLMs
13+
- Enable plug-and-play functionality using any framework like Langchain, Vercel AI SDK, CrewAI, etc., for easy adoption.
14+
- Simplify implementation of tracing and cost optimization features, ensuring streamlined operations.
15+
- Dynamically route requests to the most suitable LLM based on predefined parameters.
16+
17+
## Setup
18+
19+
The LangDB provider is available via the `@langdb/vercel-provider` module. You can install it with:
20+
21+
<Tabs items={['pnpm', 'npm', 'yarn']}>
22+
<Tab>
23+
<Snippet text="pnpm add @langdb/vercel-provider" dark />
24+
</Tab>
25+
<Tab>
26+
<Snippet text="npm install @langdb/vercel-provider" dark />
27+
</Tab>
28+
<Tab>
29+
<Snippet text="yarn add @langdb/vercel-provider" dark />
30+
</Tab>
31+
</Tabs>
32+
33+
## Provider Instance
34+
35+
To create a LangDB provider instance, use the `createLangDB` function:
36+
37+
```tsx
38+
import { createLangDB } from '@langdb/vercel-provider';
39+
40+
const langdb = createLangDB({
41+
apiKey: process.env.LANGDB_API_KEY, // Required
42+
projectId: 'your-project-id', // Required
43+
threadId: uuidv4(), // Optional
44+
runId: uuidv4(), // Optional
45+
label: 'code-agent', // Optional
46+
headers: { 'Custom-Header': 'value' }, // Optional
47+
});
48+
```
49+
50+
You can find your LangDB API key in the [LangDB dashboard](https://app.langdb.ai).
51+
52+
## Examples
53+
54+
You can use LangDB with the `generateText` or `streamText` function:
55+
56+
### `generateText`
57+
58+
```tsx
59+
import { createLangDB } from '@langdb/vercel-provider';
60+
import { generateText } from 'ai';
61+
62+
const langdb = createLangDB({
63+
apiKey: process.env.LANGDB_API_KEY,
64+
projectId: 'your-project-id',
65+
});
66+
67+
export async function generateTextExample() {
68+
const { text } = await generateText({
69+
model: langdb('openai/gpt-4o-mini'),
70+
prompt: 'Write a Python function that sorts a list:',
71+
});
72+
73+
console.log(text);
74+
}
75+
```
76+
77+
### generateImage
78+
79+
```tsx
80+
import { createLangDB } from '@langdb/vercel-provider';
81+
import { experimental_generateImage as generateImage } from 'ai';
82+
import fs from 'fs';
83+
import path from 'path';
84+
85+
const langdb = createLangDB({
86+
apiKey: process.env.LANGDB_API_KEY,
87+
projectId: 'your-project-id',
88+
});
89+
90+
export async function generateImageExample() {
91+
const { images } = await generateImage({
92+
model: langdb.image('openai/dall-e-3'),
93+
prompt: 'A delighted resplendent quetzal mid-flight amidst raindrops',
94+
});
95+
96+
const imagePath = path.join(__dirname, 'generated-image.png');
97+
fs.writeFileSync(imagePath, images[0].uint8Array);
98+
console.log(`Image saved to: ${imagePath}`);
99+
}
100+
```
101+
102+
### embed
103+
104+
```tsx
105+
import { createLangDB } from '@langdb/vercel-provider';
106+
import { embed } from 'ai';
107+
108+
const langdb = createLangDB({
109+
apiKey: process.env.LANGDB_API_KEY,
110+
projectId: 'your-project-id',
111+
});
112+
113+
export async function generateEmbeddings() {
114+
const { embedding } = await embed({
115+
model: langdb.textEmbeddingModel('text-embedding-3-small'),
116+
value: 'sunny day at the beach',
117+
});
118+
119+
console.log('Embedding:', embedding);
120+
}
121+
```
122+
123+
124+
## Supported Models
125+
126+
LangDB supports over 250+ models, enabling seamless interaction with a wide range of AI capabilities.
127+
128+
Checkout the [model list](https://app.langdb.ai/models) for more information.
129+
130+
For more information, visit the [LangDB documentation](https://docs.langdb.ai/).

tools/analyze-downloads/src/analyze-providers.ts

+1
Original file line numberDiff line numberDiff line change
@@ -69,6 +69,7 @@ async function main() {
6969
'@ai-sdk/mistral',
7070
'@ai-sdk/xai',
7171
'@ai-sdk/togetherai',
72+
'@langdb/vercel-provider',
7273
'@ai-sdk/cohere',
7374
'@ai-sdk/fireworks',
7475
'@ai-sdk/deepinfra',

0 commit comments

Comments
 (0)