---
title: Supported Models
generated: 2025-06-27T14:10:15.033946
---

# Supported Models

## Overview

Letta routinely runs automated scans against available providers and models. These are the results of the latest scan.

Ran 2512 tests against 157 models across 7 providers on June 27th, 2025


## anthropic

| Model                                               | Basic | Token Streaming | Multimodal | Context Window | Last Scanned |
|---------------------------------------------------|:---:|:-------------:|:--------:|:-------:|:----------:|
| `claude-3-5-haiku-20241022`                         |   ✅   |        ✅        |     ✅      |  200,000  |  2025-06-27  |
| `claude-3-5-sonnet-20240620`                        |   ✅   |        ✅        |     ✅      |  200,000  |  2025-06-27  |
| `claude-3-5-sonnet-20241022`                        |   ✅   |        ✅        |     ✅      |  200,000  |  2025-06-27  |
| `claude-3-7-sonnet-20250219`                        |   ✅   |        ✅        |     ✅      |  200,000  |  2025-06-27  |
| `claude-opus-4-20250514`                            |   ✅   |        ✅        |     ✅      |  200,000  |  2025-06-27  |
| `claude-sonnet-4-20250514`                          |   ✅   |        ✅        |     ✅      |  200,000  |  2025-06-27  |
| `claude-3-opus-20240229`                            |   ❌   |        ✅        |     ✅      |  200,000  |  2025-06-27  |
| `claude-3-haiku-20240307`                           |   ❌   |        ❌        |     ✅      |  200,000  |  2025-06-27  |
| `claude-3-sonnet-20240229`                          |   ❌   |        ❌        |     ❌      |  200,000  |  2025-06-27  |

---

## openai

| Model                                               | Basic | Token Streaming | Multimodal | Context Window | Last Scanned |
|---------------------------------------------------|:---:|:-------------:|:--------:|:-------:|:----------:|
| `gpt-4-turbo`                                       |   ✅   |        ✅        |     ✅      |  128,000  |  2025-06-27  |
| `gpt-4-turbo-2024-04-09`                            |   ✅   |        ✅        |     ✅      |  128,000  |  2025-06-27  |
| `gpt-4.1`                                           |   ✅   |        ✅        |     ✅      | 1,047,576 |  2025-06-27  |
| `gpt-4.1-2025-04-14`                                |   ✅   |        ✅        |     ✅      | 1,047,576 |  2025-06-27  |
| `gpt-4.1-mini`                                      |   ✅   |        ✅        |     ✅      | 1,047,576 |  2025-06-27  |
| `gpt-4.1-mini-2025-04-14`                           |   ✅   |        ✅        |     ✅      | 1,047,576 |  2025-06-27  |
| `gpt-4.1-nano`                                      |   ✅   |        ✅        |     ✅      | 1,047,576 |  2025-06-27  |
| `gpt-4.1-nano-2025-04-14`                           |   ✅   |        ✅        |     ✅      | 1,047,576 |  2025-06-27  |
| `gpt-4o`                                            |   ✅   |        ✅        |     ✅      |  128,000  |  2025-06-27  |
| `gpt-4o-2024-05-13`                                 |   ✅   |        ✅        |     ✅      |  128,000  |  2025-06-27  |
| `gpt-4o-2024-08-06`                                 |   ✅   |        ✅        |     ✅      |  128,000  |  2025-06-27  |
| `gpt-4o-2024-11-20`                                 |   ✅   |        ✅        |     ✅      |  128,000  |  2025-06-27  |
| `gpt-4o-mini`                                       |   ✅   |        ✅        |     ✅      |  128,000  |  2025-06-27  |
| `gpt-4o-mini-2024-07-18`                            |   ✅   |        ✅        |     ✅      |  128,000  |  2025-06-27  |
| `gpt-4-0613`                                        |   ✅   |        ✅        |     ❌      |   8,192   |  2025-06-27  |
| `gpt-4-1106-preview`                                |   ✅   |        ✅        |     ❌      |  128,000  |  2025-06-27  |
| `gpt-4-turbo-preview`                               |   ✅   |        ✅        |     ❌      |  128,000  |  2025-06-27  |
| `gpt-4-0125-preview`                                |   ❌   |        ✅        |     ❌      |  128,000  |  2025-06-27  |
| `o1`                                                |   ❌   |        ❌        |     ✅      |  200,000  |  2025-06-27  |
| `o1-2024-12-17`                                     |   ❌   |        ❌        |     ✅      |  200,000  |  2025-06-27  |
| `o3`                                                |   ❌   |        ❌        |     ✅      |  200,000  |  2025-06-27  |
| `o3-2025-04-16`                                     |   ❌   |        ❌        |     ✅      |  200,000  |  2025-06-27  |
| `o4-mini`                                           |   ❌   |        ❌        |     ✅      |   30,000  |  2025-06-27  |
| `o4-mini-2025-04-16`                                |   ❌   |        ❌        |     ✅      |   30,000  |  2025-06-27  |
| `gpt-4`                                             |   ❌   |        ❌        |     ❌      |   8,192   |  2025-06-27  |
| `o3-mini`                                           |   ❌   |        ❌        |     ❌      |  200,000  |  2025-06-27  |
| `o3-mini-2025-01-31`                                |   ❌   |        ❌        |     ❌      |  200,000  |  2025-06-27  |
| `o3-pro`                                            |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `o3-pro-2025-06-10`                                 |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |

---

## google_ai

| Model                                               | Basic | Token Streaming | Multimodal | Context Window | Last Scanned |
|---------------------------------------------------|:---:|:-------------:|:--------:|:-------:|:----------:|
| `gemini-1.5-pro`                                    |   ✅   |        ✅        |     ✅      | 2,000,000 |  2025-06-27  |
| `gemini-1.5-pro-002`                                |   ✅   |        ✅        |     ✅      | 2,000,000 |  2025-06-27  |
| `gemini-1.5-pro-latest`                             |   ✅   |        ✅        |     ✅      | 2,000,000 |  2025-06-27  |
| `gemini-2.0-flash-thinking-exp`                     |   ✅   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-flash-preview-04-17`                    |   ✅   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-pro`                                    |   ✅   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-pro-preview-03-25`                      |   ✅   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-pro-preview-05-06`                      |   ✅   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-flash`                                  |   ✅   |        ❌        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-thinking-exp-1219`                |   ❌   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-flash-preview-04-17-thinking`           |   ❌   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-flash-preview-05-20`                    |   ❌   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-pro-preview-06-05`                      |   ❌   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-thinking-exp-01-21`               |   ❌   |        ❌        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-flash-lite-preview-06-17`               |   ❌   |        ❌        |     ✅      | 1,048,576 |  2025-06-27  |
| `gemini-1.0-pro-vision-latest`                      |   ❌   |        ❌        |     ❌      |   12,288  |  2025-06-27  |
| `gemini-1.5-flash`                                  |   ❌   |        ❌        |     ❌      | 1,000,000 |  2025-06-27  |
| `gemini-1.5-flash-002`                              |   ❌   |        ❌        |     ❌      | 1,000,000 |  2025-06-27  |
| `gemini-1.5-flash-8b`                               |   ❌   |        ❌        |     ❌      | 1,000,000 |  2025-06-27  |
| `gemini-1.5-flash-8b-001`                           |   ❌   |        ❌        |     ❌      | 1,000,000 |  2025-06-27  |
| `gemini-1.5-flash-8b-latest`                        |   ❌   |        ❌        |     ❌      | 1,000,000 |  2025-06-27  |
| `gemini-1.5-flash-latest`                           |   ❌   |        ❌        |     ❌      | 1,000,000 |  2025-06-27  |
| `gemini-2.0-flash`                                  |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-001`                              |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-exp`                              |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-exp-image-generation`             |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-lite`                             |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-lite-001`                         |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-lite-preview`                     |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-lite-preview-02-05`               |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-flash-preview-image-generation`         |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `gemini-2.0-pro-exp`                                |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.0-pro-exp-02-05`                          |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-2.5-flash-preview-tts`                      |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `gemini-2.5-pro-preview-tts`                        |   ❌   |        ❌        |     ❌      |   65,536  |  2025-06-27  |
| `gemini-exp-1206`                                   |   ❌   |        ❌        |     ❌      | 1,048,576 |  2025-06-27  |
| `gemini-pro-vision`                                 |   ❌   |        ❌        |     ❌      |   12,288  |  2025-06-27  |

---

## together

| Model                                               | Basic | Token Streaming | Multimodal | Context Window | Last Scanned |
|---------------------------------------------------|:---:|:-------------:|:--------:|:-------:|:----------:|
| `arcee-ai/coder-large`                              |   ✅   |        ✅        |     ✅      |   32,768  |  2025-06-27  |
| `meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8` |   ✅   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `Qwen/Qwen2.5-Coder-32B-Instruct`                   |   ✅   |        ✅        |     ❌      |   32,768  |  2025-06-27  |
| `meta-llama/Llama-3.3-70B-Instruct-Turbo`           |   ✅   |        ✅        |     ❌      |  131,072  |  2025-06-27  |
| `meta-llama/Llama-3.3-70B-Instruct-Turbo-Free`      |   ✅   |        ✅        |     ❌      |  131,072  |  2025-06-27  |
| `meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo`     |   ✅   |        ✅        |     ❌      |  130,815  |  2025-06-27  |
| `meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo`       |   ✅   |        ✅        |     ❌      |  131,072  |  2025-06-27  |
| `deepseek-ai/DeepSeek-V3`                           |   ✅   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo`      |   ✅   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `Qwen/Qwen2.5-72B-Instruct-Turbo`                   |   ❌   |        ✅        |     ✅      |  131,072  |  2025-06-27  |
| `arcee-ai/virtuoso-large`                           |   ❌   |        ✅        |     ✅      |  131,072  |  2025-06-27  |
| `arcee-ai/virtuoso-medium-v2`                       |   ❌   |        ✅        |     ✅      |  131,072  |  2025-06-27  |
| `meta-llama/Llama-4-Scout-17B-16E-Instruct`         |   ❌   |        ✅        |     ✅      | 1,048,576 |  2025-06-27  |
| `Qwen/Qwen3-235B-A22B-fp8-tput`                     |   ❌   |        ✅        |     ❌      |   40,960  |  2025-06-27  |
| `nvidia/Llama-3.1-Nemotron-70B-Instruct-HF`         |   ❌   |        ✅        |     ❌      |   32,768  |  2025-06-27  |
| `scb10x/scb10x-llama3-1-typhoon2-70b-instruct`      |   ❌   |        ✅        |     ❌      |   8,192   |  2025-06-27  |
| `NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO`       |   ❌   |        ❌        |     ✅      |   32,768  |  2025-06-27  |
| `Qwen/QwQ-32B`                                      |   ❌   |        ❌        |     ✅      |  131,072  |  2025-06-27  |
| `google/gemma-3n-E4B-it`                            |   ❌   |        ❌        |     ✅      |   32,768  |  2025-06-27  |
| `mistralai/Mistral-7B-Instruct-v0.2`                |   ❌   |        ❌        |     ✅      |   32,768  |  2025-06-27  |
| `perplexity-ai/r1-1776`                             |   ❌   |        ❌        |     ✅      |  163,840  |  2025-06-27  |
| `Qwen/Qwen2-72B-Instruct`                           |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `Qwen/Qwen2-VL-72B-Instruct`                        |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `Qwen/Qwen2.5-7B-Instruct-Turbo`                    |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `Qwen/Qwen2.5-VL-72B-Instruct`                      |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `arcee-ai/AFM-4.5B-Preview`                         |   ❌   |        ❌        |     ❌      |   65,536  |  2025-06-27  |
| `arcee-ai/arcee-blitz`                              |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `arcee-ai/caller`                                   |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `arcee-ai/maestro-reasoning`                        |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `arcee_ai/arcee-spotlight`                          |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `deepseek-ai/DeepSeek-R1`                           |   ❌   |        ❌        |     ❌      |  163,840  |  2025-06-27  |
| `deepseek-ai/DeepSeek-R1-0528-tput`                 |   ❌   |        ❌        |     ❌      |  163,840  |  2025-06-27  |
| `deepseek-ai/DeepSeek-R1-Distill-Llama-70B`         |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `deepseek-ai/DeepSeek-R1-Distill-Llama-70B-free`    |   ❌   |        ❌        |     ❌      |   8,192   |  2025-06-27  |
| `deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B`         |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `deepseek-ai/DeepSeek-R1-Distill-Qwen-14B`          |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `deepseek-ai/DeepSeek-V3-p-dp`                      |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `google/gemma-2-27b-it`                             |   ❌   |        ❌        |     ❌      |   8,192   |  2025-06-27  |
| `lgai/exaone-3-5-32b-instruct`                      |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `lgai/exaone-deep-32b`                              |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `meta-llama/Llama-3-70b-chat-hf`                    |   ❌   |        ❌        |     ❌      |   8,192   |  2025-06-27  |
| `meta-llama/Llama-3-8b-chat-hf`                     |   ❌   |        ❌        |     ❌      |   8,192   |  2025-06-27  |
| `meta-llama/Llama-3.2-11B-Vision-Instruct-Turbo`    |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `meta-llama/Llama-3.2-3B-Instruct-Turbo`            |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `meta-llama/Llama-3.2-90B-Vision-Instruct-Turbo`    |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `meta-llama/Llama-Vision-Free`                      |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `meta-llama/Meta-Llama-3-70B-Instruct-Turbo`        |   ❌   |        ❌        |     ❌      |   8,192   |  2025-06-27  |
| `meta-llama/Meta-Llama-3-8B-Instruct-Lite`          |   ❌   |        ❌        |     ❌      |   8,192   |  2025-06-27  |
| `mistralai/Mistral-7B-Instruct-v0.1`                |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `mistralai/Mistral-7B-Instruct-v0.3`                |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `mistralai/Mistral-Small-24B-Instruct-2501`         |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `mistralai/Mixtral-8x7B-Instruct-v0.1`              |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `scb10x/scb10x-typhoon-2-1-gemma3-12b`              |   ❌   |        ❌        |     ❌      |  131,072  |  2025-06-27  |
| `togethercomputer/MoA-1`                            |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `togethercomputer/MoA-1-Turbo`                      |   ❌   |        ❌        |     ❌      |   32,768  |  2025-06-27  |
| `togethercomputer/Refuel-Llm-V2`                    |   ❌   |        ❌        |     ❌      |   16,384  |  2025-06-27  |
| `togethercomputer/Refuel-Llm-V2-Small`              |   ❌   |        ❌        |     ❌      |   8,192   |  2025-06-27  |

---

## deepseek

| Model                                               | Basic | Token Streaming | Multimodal | Context Window | Last Scanned |
|---------------------------------------------------|:---:|:-------------:|:--------:|:-------:|:----------:|
| `deepseek-chat`                                     |   ❌   |        ❌        |     ❌      |   64,000  |  2025-06-27  |
| `deepseek-reasoner`                                 |   ❌   |        ❌        |     ❌      |   64,000  |  2025-06-27  |

---

## groq

| Model                                               | Basic | Token Streaming | Multimodal | Context Window | Last Scanned |
|---------------------------------------------------|:---:|:-------------:|:--------:|:-------:|:----------:|
| `allam-2-7b`                                        |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `compound-beta`                                     |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `compound-beta-mini`                                |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `deepseek-r1-distill-llama-70b`                     |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `distil-whisper-large-v3-en`                        |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `gemma2-9b-it`                                      |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `llama-3.1-8b-instant`                              |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `llama-3.3-70b-versatile`                           |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `llama3-70b-8192`                                   |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `llama3-8b-8192`                                    |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `meta-llama/llama-4-maverick-17b-128e-instruct`     |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `meta-llama/llama-4-scout-17b-16e-instruct`         |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `meta-llama/llama-guard-4-12b`                      |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `meta-llama/llama-prompt-guard-2-22m`               |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `meta-llama/llama-prompt-guard-2-86m`               |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `mistral-saba-24b`                                  |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `playai-tts`                                        |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `playai-tts-arabic`                                 |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `qwen-qwq-32b`                                      |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `qwen/qwen3-32b`                                    |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `whisper-large-v3`                                  |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |
| `whisper-large-v3-turbo`                            |   ❌   |        ❌        |     ❌      |   30,000  |  2025-06-27  |

---

## letta

| Model                                               | Basic | Token Streaming | Multimodal | Context Window | Last Scanned |
|---------------------------------------------------|:---:|:-------------:|:--------:|:-------:|:----------:|
| `letta-free`                                        |   ❌   |        ❌        |     ❌      |   8,192   |  2025-06-27  |

---
