LangSmith CLI & Skills
We’re releasing a CLI along with our first set of skills to give AI coding agents expertise in the LangSmith ecosystem.
Academic or research source. Check the methodology, sample size, and whether it's been replicated.
Key Takeaways
- Major industry investment.
- We’re releasing a CLI along with our first set of skills to give AI coding agents expertise in the LangSmith ecosystem.
- This includes adding tracing to agents, understanding their execution, building test sets, and evaluating performance.
What It Means
Context
We’re releasing a CLI along with our first set of skills to give AI coding agents expertise in the LangSmith ecosystem. This includes adding tracing to agents, understanding their execution, building test sets, and evaluating performance. On our eval set, this bumps Claude Code’s performance on these tasks from 17% to 92%. The LangSmith CLI At the core is our new LangSmith CLI . The LangSmith CLI is designed to be agent-native: it gives coding agents (and developers) the building blocks needed to do anything within LangSmith . This includes fetching traces, curating datasets, and running experiments. When combined with the guidance in skills, coding agents gain the ability to fluently navigate LangSmith completely through the terminal. We believe that enabling this is critical to the future of agent development, as we expect agent improvement loops to increasingly be driven by other agents that are terminal-first. You can install the CLI with the following installation script: curl -sSL https://raw.githubusercontent.com/langchain-ai/langsmith-cli/main/scripts/install.sh | sh What are Skills? Skills are curated instructions, scripts, and resources that improve coding agent…
For builders
This includes adding tracing to agents, understanding their execution, building test sets, and evaluating performance.
For Builders
This includes adding tracing to agents, understanding their execution, building test sets, and evaluating performance.