DATE:
AUTHOR:
The LangChain Team
LangSmith Self-Hosted

LangSmith Self-Hosted v0.11

DATE:
AUTHOR: The LangChain Team

This release brings customizable LangGraph Platform deployments, streamlined evaluation via Align Evals, running evals directly from Studio, and operational upgrades like scheduled exports and API key expirations. It also adds built-in playground tools, deeper cost tracking (including token caching), and expanded multimodal support across the playground, annotation queues, and datasets.

Follow the upgrade instructions here to get access to the latest release.

Breaking Changes

  • As of v11, all containers will use an entrypoint.sh script. If you are overriding your image entrypoints you may need to update these to use the new entrypoint.sh scripts

  • As of v11, your self-hosted LangSmith instance will send telemetry to beacon.langchain.com by default when using an online key. This is optional but highly encouraged as it helps our team better support your self-hosted deployment. You can learn more here.

  • Default trace tier settings have changed: workspace scoped settings will now have higher precedence than organization-scoped settings.

Big New Features since v0.10.0

Here are some of key features:

Align Evals: Streamlining LLM Application Evaluation

Scheduled Exports: Keep external systems in sync with automated data exports

API Key Expiration: Set expiration dates on LangSmith API keys for better security

Custom Evaluation Views: Create tailored views when analyzing evaluation results

Agent Evals in LangGraph: Run agent evaluations directly in LangGraph Studio

Built-in Playground Tools: Use integrated tools within LangSmith's playground

Cost Tracking: Track expenses across multi-modal inputs and token caching

Enhanced Multimodal Support: Use images, PDFs, and audio files across the playground, annotation queues, and datasets

And many more. View the full changelog.

Infrastructure Changes

  • There are two feedback migration jobs that must run successfully. Please reach out to your LangChain rep if you see any issues.

  • Support for Deletes in Azure Blob Storage

  • A cron job has been added which deletes expired data from ClickHouse. By default, it runs on weekends. For more info on customizing the job, view the documentation.

Admin Changes

  • Workspace-scoped trace retention settings will take precedence over the organization default: Previously, org wide retention settings would override workspace-scoped retention settings. Check if you have configured custom trace retention settings at the workspace level that differ from your organization’s setting in the admin dashboard under Settings → Trace Retention. More information here.

Powered by LaunchNotes