AI Engineering Buildcamp: From RAG to Agents

Source: https://maven.com/alexey-grigorev/from-rag-to-agents

What You Will Create in the Course

AI Assistant with RAG

Learn to use Large Language Models and Retrieval-Augmented Generation. Build an assistant that answers questions based on GitHub repositories, YouTube transcripts, documentation, and other data sources.

Agentic AI Systems

Add agent behavior: function calling, tool usage, MCP, and multi-step reasoning. Master PydanticAI and OpenAI Agents SDK to create systems capable of acting rather than just generating text.

Professional Testing and Evaluation

Learn how to conduct unit testing, offline evaluation, use ranking metrics, and the LLM-as-a-Judge approach. Compare prompts, models, and chunking strategies with real data.

Monitoring and Guardrails

• Set up observability and security with Grafana, OpenTelemetry, Pydantic Logfire, Evidently, and LangWatch
• Track tokens, costs, and performance
• Implement guardrails to prevent errors and misuse

It’s not my rip

Password: cms.ddpanda.org