Skip to content

Commit

Permalink
Merge pull request #7542 from microsoft/isidorn/modest-quail
Browse files Browse the repository at this point in the history
token limit is now 16k
  • Loading branch information
isidorn authored Sep 4, 2024
2 parents 22d953c + d6b21fc commit 37f9f48
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion api/extension-guides/language-model.md
Original file line number Diff line number Diff line change
Expand Up @@ -194,7 +194,7 @@ Extension authors can choose which model is the most appropriate for their exten
```typescript
const allModels = await vscode.lm.selectChatModels(MODEL_SELECTOR);
```
> **Note**: The recommended GPT-4o model has a limit of `6K` tokens. The returned model object from the `selectChatModels` call has a `maxInputTokens` attribute that shows the token limit. These limits will be expanded as we learn more about how extensions are using the language models.
> **Note**: The recommended GPT-4o model has a limit of `16K` tokens. The returned model object from the `selectChatModels` call has a `maxInputTokens` attribute that shows the token limit. These limits will be expanded as we learn more about how extensions are using the language models.
### Rate limiting

Expand Down

0 comments on commit 37f9f48

Please sign in to comment.