LangSmith is now GA

LangSmith is now generally available - no more waitlist! Sign up for free here.

• Video resources: LangSmith in 10 minutes & In Depth Platform Overview

• Our release blog covers all of the latest features in LangSmith

• We’ve shipped TypeScript improvements. It’s now easier to use LangSmith independent of LangChain (docs here). We also updated and improved evaluation flows (docs here)

New in LangSmith

• Better Monitoring. We’re excited to launch grouped monitoring charts in LangSmith by metadata and by tag. It’s now easier than ever to see how different segments are performing or to view a specific customer’s experience in your product. Read how to set up tags and metadata, and learn about the kinds of visibility this feature unlocks on the blog.

• Cost visibility. Cost tracking is here!! We’ve tracked total tokens for awhile, and now users can see how much they’ve spent on LLM calls in their traces and in the monitoring tab. This is huge for understanding tradeoffs and ROI of your application. We’re planning to let users add custom rates too, so if you have special pricing, LangSmith can still give you an accurate view of spend.

• Regression Testing. Charts are now available in the testing view, so you can now see how performance changes visually on different iterations of your application. Spot regressions or improvements faster.

• Annotation Queues Feedback Rubric. We’ve added a structured feedback rubric to help make annotations easier. This feature enables users to create custom feedback keys with predefined categories. The rubric will show up across your LangSmith organization in annotation queues, and feedback will then be validated on submission.

• Trace Sampling. We’ve made some LangSmith SDK changes too with auto-batching for better performance and trace sampling. Go ahead and upgrade to the python SDK version >= 0.0.84 and JS SDK version >= 0.0.64 to check it out.

• Support for HuggingFace models in the Playground.