This release includes improvements to evaluations: online multi-turn evaluations, composite feedback scores and JavaScript code evals. It also includes product naming changes: LangGraph Platform to LangSmith Deployment and more granular configuration options for deployments.

Infrastructure updates include migrating feedback to Postgres, native Gateway/Virtual Service support, and simplified configuration by consolidating deployment settings and removing the separate license key requirement.

Follow the upgrade instructions here to get access to everything: https://docs.smith.langchain.com/self_hosting/upgrades

Breaking Changes

• As of v12, we have moved all config.langgraphPlatform to config.deployment. There is also no need for a second license key and that parameter has been removed.

• As of v12, ingress.hostname parameter has been moved to config.hostname. Similarly ingress.subdomain has been to moved to config and renamed as config.basePath.

• We now serve Feedback out of Postgres. The migrations for feedback in v11 must have run successfully. If they did not you may see some feedback missing. The backfills will not be enabled by default in v12.

Big New Features since v0.11

Here are some of key features:

Evaluate end-to-end agent interactions with Multi-turn Evals

Create org-scoped API keys with granular permissions

Dataset creation improvements

JavaScript Code Evals

Combine multiple evaluator scores into a composite score

Support for more granular deployment configuration in the LangSmith Deployment Control Plane

Infrastructure Changes

• We now serve Feedback out of Postgres. The migrations for feedback in v11 must have run successfully. If they did not you may see some feedback missing. The backfills will not be enabled by default in v12.

• Support for Gateway/ Virtual Service natively in chart for main LangSmith and LangSmith Deployments routes

• config.langgraphPlatform moved to config.deployment

• No more need to specify an explicit langgraphPlatform license key.

• Consolidation of hostname parameter

• Rename of subdomain parameter → basePath

• Support for ArgoRollouts natively within Helm chart