* feat: add metadata-only provider trace storage option Add support for writing provider traces to a lightweight metadata-only table (~1.5GB) instead of the full table (~725GB) since request/response JSON is now stored in GCS. - Add `LETTA_TELEMETRY_PROVIDER_TRACE_PG_METADATA_ONLY` setting - Create `provider_trace_metadata` table via alembic migration - Conditionally write to new table when flag is enabled - Include backfill script for migrating existing data 🐾 Generated with [Letta Code](https://letta.com) Co-Authored-By: Letta <noreply@letta.com> * chore: regenerate API spec and SDK * fix: use composite PK (created_at, id) for provider_trace_metadata Aligns with GCS partitioning structure (raw/date=YYYY-MM-DD/{id}.json.gz) and enables efficient date-range queries via the B-tree index. 🐾 Generated with [Letta Code](https://letta.com) Co-Authored-By: Letta <noreply@letta.com> * ammendments * fix: add bulk data copy to migration Copy existing provider_traces metadata in-migration instead of separate backfill script. Creates indexes after bulk insert for better performance. 🐾 Generated with [Letta Code](https://letta.com) Co-Authored-By: Letta <noreply@letta.com> * fix: remove data copy from migration, create empty table only Old data stays in provider_traces, new writes go to provider_trace_metadata when flag is enabled. Full traces are in GCS anyway. 🐾 Generated with [Letta Code](https://letta.com) Co-Authored-By: Letta <noreply@letta.com> * fix: address PR comments - Remove GCS mention from ProviderTraceMetadata docstring - Move metadata object creation outside session context 🐾 Generated with [Letta Code](https://letta.com) Co-Authored-By: Letta <noreply@letta.com> * fix: reads always use full provider_traces table The metadata_only flag should only control writes. Reads always go to the full table to avoid returning ProviderTraceMetadata where ProviderTrace is expected. 🐾 Generated with [Letta Code](https://letta.com) Co-Authored-By: Letta <noreply@letta.com> * feat: enable metadata-only provider trace writes in prod Add LETTA_TELEMETRY_PROVIDER_TRACE_PG_METADATA_ONLY=true to all Helm values (memgpt-server and lettuce-py, prod and dev). 🐾 Generated with [Letta Code](https://letta.com) Co-Authored-By: Letta <noreply@letta.com> --------- Co-authored-by: Letta <noreply@letta.com>
45 lines
2.0 KiB
Python
45 lines
2.0 KiB
Python
from letta.orm.agent import Agent
|
|
from letta.orm.agents_tags import AgentsTags
|
|
from letta.orm.archive import Archive
|
|
from letta.orm.archives_agents import ArchivesAgents
|
|
from letta.orm.base import Base
|
|
from letta.orm.block import Block
|
|
from letta.orm.block_history import BlockHistory
|
|
from letta.orm.blocks_agents import BlocksAgents
|
|
from letta.orm.blocks_conversations import BlocksConversations
|
|
from letta.orm.blocks_tags import BlocksTags
|
|
from letta.orm.conversation import Conversation
|
|
from letta.orm.conversation_messages import ConversationMessage
|
|
from letta.orm.file import FileMetadata
|
|
from letta.orm.files_agents import FileAgent
|
|
from letta.orm.group import Group
|
|
from letta.orm.groups_agents import GroupsAgents
|
|
from letta.orm.groups_blocks import GroupsBlocks
|
|
from letta.orm.identities_agents import IdentitiesAgents
|
|
from letta.orm.identities_blocks import IdentitiesBlocks
|
|
from letta.orm.identity import Identity
|
|
from letta.orm.job import Job
|
|
from letta.orm.llm_batch_items import LLMBatchItem
|
|
from letta.orm.llm_batch_job import LLMBatchJob
|
|
from letta.orm.mcp_oauth import MCPOAuth
|
|
from letta.orm.mcp_server import MCPServer
|
|
from letta.orm.message import Message
|
|
from letta.orm.organization import Organization
|
|
from letta.orm.passage import ArchivalPassage, BasePassage, SourcePassage
|
|
from letta.orm.passage_tag import PassageTag
|
|
from letta.orm.prompt import Prompt
|
|
from letta.orm.provider import Provider
|
|
from letta.orm.provider_model import ProviderModel
|
|
from letta.orm.provider_trace import ProviderTrace
|
|
from letta.orm.provider_trace_metadata import ProviderTraceMetadata
|
|
from letta.orm.run import Run
|
|
from letta.orm.run_metrics import RunMetrics
|
|
from letta.orm.sandbox_config import AgentEnvironmentVariable, SandboxConfig, SandboxEnvironmentVariable
|
|
from letta.orm.source import Source
|
|
from letta.orm.sources_agents import SourcesAgents
|
|
from letta.orm.step import Step
|
|
from letta.orm.step_metrics import StepMetrics
|
|
from letta.orm.tool import Tool
|
|
from letta.orm.tools_agents import ToolsAgents
|
|
from letta.orm.user import User
|