We've launched a new dedicated Go service called 'ingest-backend' to handle all run and feedback ingestion in LangSmith. This architectural improvement delivers significant performance enhancements:

• 5x faster average request processing (p95)

• 10x faster response times for high-traffic scenarios (p95)

• Reduced frontend load times and API latency

By moving all trace ingestion to this specialized service, our main backend can now focus exclusively on serving frontend requests, leading to better overall system performance.

This architectural improvement significantly enhances LangSmith's performance and scalability. The dedicated ingest service means faster processing times for your traces and feedback, while the reduced load on the main backend ensures more responsive frontend interactions. This is especially impactful for users with high-traffic scenarios, where the performance improvements are most pronounced.