LangChain Changelog

Sign up for our newsletter to stay up to date

Powered by LaunchNotes

Loading...

May 2024

🔧 Off-the-shelf online evaluator prompts to catch bad retrieval and hallucinations for RAG

LangSmith’s online evaluator (LLM-as-judge) automatically runs on production traces with a customizable prompt and automation rules. Our new off-the-shelf...

🔁 Repetitions to build confidence in your experiment results

You can now run multiple repetitions of your experiment in LangSmith. This helps smooth out noise from variability introduced by your application or from...

✂️ Dataset splits for evaluation and filtering/editing dataset examples

With dataset splits, it's easier to run evaluations on a subset of your data in LangSmith. You can tag examples with different split names , edit and add to...

🍐 Pairwise Evaluations in LangSmith

For LLM use cases like text generation or chat (where there may not be a single "correct" answer), picking a preferred response with pairwise evaluation can...

🛠️ Personal prompts are now separate from LangChain Hub

Your organization's prompts are now separate from the LangChain Hub. This lets you organize and pull existing prompts by their commit versions — so you can...

🌍 LangSmith is now GDPR compliant

LangSmith — our unified developer platform for building, testing, and monitoring LLM applications — is now GDPR compliant. Security and compliance are...

🔒Role Based Access Control (RBAC) for enterprise customers

Admins can now assign roles to users in their organization with RBAC in LangSmith . Create/edit custom roles with granular permissions to determine who can...

🛠 Regression testing in LangSmith

Regression testing, hotkeys, and more in LangSmith Check out our video walkthrough and blog to learn more! We also have a few new additional updates in...

March 2024

📊 Version-controlled prompts & running prompts over datasets in LangSmith

Version-controlled prompts, running prompts over datasets, and more in LangSmith It’s been a little over 1 month since we GA’d LangSmith, and we’re so...

February 2024

🚀 LangSmith is GA! Plus, better monitoring in LangSmith

LangSmith is now GA LangSmith is now generally available - no more waitlist! Sign up for free here . New in LangSmith

February 5, 2024

Powered by LaunchNotes