LangSmith ๐ Workspaces in LangSmith for improved collaboration & organization LangSmith now offers Workspaces to separate resources for different teams or different environments. Admins can add users to Workspaces, granting them... June 13, 2024
LangSmith ๐บ๏ธ Variable mapping for online evaluator prompts In LangSmith, you can now use any structured prompt from the LangChain Hub with customizable variables. You can personalize your inputs based on recent runs... June 10, 2024
LangSmith ๐ Enter the playground from scratch instead of from a trace or a prompt The Playground is now its own tab in the sidebar of LangSmith. To create a new prompt , simply craft a prompt in the empty playground and click "Save As" to... June 10, 2024
LangSmith ๐ฌ Manage private prompts without a handle Weโve improved our SDK and LangSmith Prompts UI to make navigating prompts simpler. Now, only public prompts require a handle on creation. New accounts wonโt... May 27, 2024
LangSmith ๐ง Off-the-shelf online evaluator prompts to catch bad retrieval and hallucinations for RAG LangSmithโs online evaluator (LLM-as-judge) automatically runs on production traces with a customizable prompt and automation rules. Our new off-the-shelf... May 27, 2024
LangSmith ๐ Repetitions to build confidence in your experiment results You can now run multiple repetitions of your experiment in LangSmith. This helps smooth out noise from variability introduced by your application or from... May 27, 2024
LangSmith โ๏ธ Dataset splits for evaluation and filtering/editing dataset examples With dataset splits, it's easier to run evaluations on a subset of your data in LangSmith. You can tag examples with different split names , edit and add to... May 27, 2024
LangSmith ๐ Pairwise Evaluations in LangSmith For LLM use cases like text generation or chat (where there may not be a single "correct" answer), picking a preferred response with pairwise evaluation can... May 15, 2024
LangSmith ๐ ๏ธ Personal prompts are now separate from LangChain Hub Your organization's prompts are now separate from the LangChain Hub. This lets you organize and pull existing prompts by their commit versions โ so you can... May 13, 2024
LangSmith ๐ LangSmith is now GDPR compliant LangSmith โ our unified developer platform for building, testing, and monitoring LLM applications โ is now GDPR compliant. Security and compliance are... May 13, 2024
