Kian Jones d48932bdb6 fix(core): sanitize Unicode surrogates in all LLM client requests (#9323) ...

Multiple OpenAI-compatible LLM clients (Azure, Deepseek, Groq, Together, XAI, ZAI)
and Anthropic-compatible clients (Anthropic, MiniMax, Google Vertex) were overriding
request_async/stream_async without calling sanitize_unicode_surrogates, causing
UnicodeEncodeError when message content contained lone UTF-16 surrogates.

Root cause: Child classes override parent methods but omit the sanitization step that
the base OpenAIClient includes. This allows corrupted Unicode (unpaired surrogates
from malformed emoji) to reach the httpx layer, which rejects it during UTF-8 encoding.

Fix: Import and call sanitize_unicode_surrogates in all overridden request methods.
Also removed duplicate sanitize_unicode_surrogates definition from openai_client.py
that shadowed the canonical implementation in letta.helpers.json_helpers.

🐾 Generated with [Letta Code](https://letta.com)

Co-Authored-By: Letta <noreply@letta.com>

Issue-ID: 10c0f2e4-f87b-11f0-b91c-da7ad0900000

2026-02-24 10:52:06 -08:00

..

sample_response_jsons

merge this (#4759)

2025-09-17 15:47:40 -07:00

__init__.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

anthropic_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

anthropic_constants.py

feat: Add structured outputs for Anthropic (#7495)

2026-01-12 10:57:19 -08:00

azure_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

bedrock_client.py

feat: enable bedrock for anthropic models (#8847)

2026-01-19 15:54:44 -08:00

chatgpt_oauth_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

deepseek_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

error_utils.py

fix: handle new openai overflow error format (#7110)

2025-12-17 17:31:02 -08:00

google_ai_client.py

fix: add explicit timeouts to httpx clients to prevent ReadTimeout errors (#8538)

2026-01-19 15:54:38 -08:00

google_constants.py

fix: max output tokens for gemini 3 models (#7322)

2025-12-17 17:31:03 -08:00

google_vertex_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

groq_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

helpers.py

fix: remove unused sync code (#8613)

2026-01-19 15:54:37 -08:00

llm_api_tools.py

fix: add LLMCallType enum and ensure call_type is set on all provider traces (#9258)

2026-02-24 10:52:06 -08:00

llm_client_base.py

fix: remove duplicate provider trace logging and dead code (#9278)

2026-02-24 10:52:06 -08:00

llm_client.py

feat: openrouter byok (#9148)

2026-01-29 12:44:04 -08:00

minimax_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

mistral.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

openai_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

openai.py

fix: anthropic tool sanitation (#9310)

2026-02-24 10:52:06 -08:00

together_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

xai_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00

zai_client.py

fix(core): sanitize Unicode surrogates in all LLM client requests (#9323)

2026-02-24 10:52:06 -08:00