📊 Custom dashboards to monitor LLM app performance
Create custom dashboards in LangSmith to track key metrics for your LLM app's performance such as cost, latency, and quality - including feedback from users...
🏷️ Resource tags to organize your Workspace in LangSmith
You can now organize your Workspace in LangSmith with resource tags. Resource tags help you efficiently manage, group, search, and filter through resources...
💥 Dynamic few-shot example selection in open beta
Dynamic few-shot example selection is now available in open beta for LangSmith users (currently for Cloud only). With this feature, you can perform...
🪄 Generate synthetic examples to enhance a LangSmith dataset
You can now generate synthetic examples for your datasets in LangSmith. Using the dataset schema you've defined, we generate new examples based on existing...
🚀 Few-shot examples with LangSmith datasets
LangSmith now supports fast, easy-to-use APIs to find few shot examples from your datasets, which you can use to improve your LLM applications without...
🚀 LangGraph Studio: The first agent IDE
LangGraph Studio offers a new way to develop LLM applications by providing a specialized agent IDE that enables visualization, interaction, and debugging of...
🏃 Trace comparison view & saving custom trace filters
In the runs table in LangSmith, you can now select traces to compare side-by-side. This lets you make direct comparisons to see discrepancies in output...
📊 Define, validate, and update dataset schemas in LangSmith
When building a dataset iteratively for an LLM app, having a defined schema for testing across examples lets you avoid broken code and keep your data clean...
✍️ Multiple annotators can review a run in LangSmith
LangSmith's annotation queue now supports allowing multiple people to review an individual run. This makes it easier to coordinate data review across...
🔎 Filtering runs within the trace view
You can now filter for runs within the trace view in LangSmith. This is especially helpful for long-running agents, which can produce traces with hundreds,...