Loading…
April 2-3, 2026
New York, NY
View More Details & Registration

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for MCP Dev Summit North America to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration..

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.


Thursday April 2, 2026 10:20am - 10:35am EDT
At Duolingo, we built an AI Slackbot using Claude's AI Agent SDK and the Model Context Protocol, connecting 180+ tools across 15+ MCP servers—GitHub, Jenkins, Sentry, Grafana, PagerDuty, Honeycomb, and more.

This talk covers:
1. Building and Standardizing MCP Servers: Patterns for stdio and HTTP transports with consistent configuration schemas.
2. Authentication and Role-Based Access Control: YAML-based tool allowlists gating sensitive tools by user role.
3. Evaluation Framework: A Python script runs parallel evaluation tests validating MCP tool usage, anti-hallucination checks, and response quality.
4. Real-World Challenges:
* Testing in production without synthetic environments
* Preventing customer PII from reaching AI models
* Performance optimization: Tradeoff between fast answer vs good answer
* AI hallucinating answers instead of calling MCP tools
* Wrong MCP parameters causing slow queries and failures
5. Live Examples: PagerDuty triage, Jenkins debugging, and incident investigation—all from Slack.
Speakers
avatar for Aaron Wang

Aaron Wang

Software Engineer, Duolingo Inc
Aaron Wang is a Software Engineer on Duolingo's DevXAI team, building AI-powered developer tools. He led the development of Duolingo's AI Slackbot with 180+ MCP tools—helping employees find answers in help channels, triage alerts, debug incidents, and navigate internal systems... Read More →
Thursday April 2, 2026 10:20am - 10:35am EDT
Broadway Ballroom (6th Floor)

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Share Modal

Share this link via

Or copy link