Evals as the New PRD: Transforming Product Development with AI [2025]

In a bold move towards revolutionizing product development, Xavi Amatriain, Expedia Group’s first chief AI and data officer, declared at VB Transform 2026 that "evals are the new PRD." This statement is not just a catchy headline; it's a paradigm shift in how products are conceived, designed, and executed. Let's dive deep into this intriguing concept, exploring its implications, applications, and the future of product management.

TL; DR

• Evals are becoming essential: They are replacing traditional Product Requirement Documents (PRDs) by encoding desired outcomes.
• AI-driven development: AI-assisted and generated code is central to modern product strategies.
• Security and compliance: Evals incorporate security requirements from the start.
• Real-world examples: Companies like Runable are already leveraging evals for AI-powered automation.
• Future trends: Expect increased adoption of eval-driven development across industries.

Estimated data: Security protocols are often prioritized in evals, followed by equal focus on red teaming and performance benchmarks.

The Evolution of Product Development

The traditional Product Requirement Document (PRD) has been a staple in software development for years. It serves as a blueprint for what a product should do, detailing features, specifications, and user stories. However, as technologies evolve, so do the methodologies we use to create them.

Enter Evals, short for evaluations. These are not mere assessments but dynamic, evolving documents that encode the very essence of what a product aims to achieve. With the rise of AI, these evals have become integral to product development, effectively replacing PRDs in some modern tech companies.

Integration and user feedback are rated as the most critical aspects in AI-assisted development, emphasizing the need for seamless workflows and continuous improvement. Estimated data.

What Are Evals?

Evals are comprehensive documents that detail the expected outcomes and performance metrics of a product. They extend beyond traditional requirements to include

• Red teaming evals: Testing against potential threats and vulnerabilities.
• Security protocols: Embedding compliance and security requirements from the outset.
• Performance benchmarks: Defining success metrics for product performance.

In essence, evals provide a more holistic view of a product's desired capabilities and constraints. They are continually updated to reflect new findings, user feedback, and technological advances.

AI-Assisted Development: The Core of Modern Evals

AI is not just a tool; it's a partner in the development process. With AI-assisted code generation, evals become living documents that inform and guide AI models on how to improve and expand product capabilities.

Practical Implementation

1. Initial Setup: Begin by defining high-level objectives and potential challenges.
2. Integration: Utilize AI tools such as Runable to automate documentation, integrate security protocols, and streamline workflows.
3. Continuous Evaluation: Regularly update evals based on ongoing data analysis and user feedback.

Common Pitfalls and Solutions

• Overcomplexity: Avoid making evals too detailed. Focus on core objectives and flexible metrics.
• Neglecting User Feedback: Constantly incorporate user insights to refine evals.
• Ignoring Security: Embed security measures into evals from the beginning to prevent costly vulnerabilities.

Evals enhance agility, security compliance, and user alignment significantly, with security compliance scoring the highest. Estimated data based on industry insights.

Real-World Use Cases

Several companies are already leveraging this approach to redefine their product development strategies.

Runable: Streamlining AI Automation

Runable uses evals to guide the development of its AI-powered platform for creating presentations, documents, reports, images, videos, and slides. By embedding security and compliance requirements into their evals, they ensure that all generated content meets the highest standards of quality and safety.

Expedia's Transformation

Under Amatriain's leadership, Expedia has integrated evals into their core development processes, allowing for more agile and responsive product iterations. This shift has led to faster development cycles and more innovative travel solutions.

The Future of Evals in Product Development

As the industry continues to adopt AI-driven methodologies, evals will become an indispensable part of product management.

Trends to Watch

• AI and Machine Learning: Further integration of AI will automate more aspects of eval creation and management.
• Regulatory Compliance: As regulations tighten, evals will play a crucial role in ensuring compliance.
• Cross-departmental Collaboration: Expect evals to facilitate better communication between development, security, and business teams.

Recommendations for Adoption

1. Start Small: Introduce evals in pilot projects to test their effectiveness and iteratively improve them.
2. Invest in Training: Ensure teams are equipped with the skills to create and manage evals effectively.
3. Leverage AI Tools: Use platforms like Runable to enhance productivity and ensure alignment with business goals.

Conclusion

The shift from PRDs to evals represents a major evolution in how we approach product development. By embracing this change, companies can enhance their agility, improve product quality, and respond more effectively to market demands. As AI continues to advance, evals will undoubtedly play a central role in shaping the future of innovation.

FAQ

What are evals in product development?

Evals are dynamic documents that outline the expected outcomes and performance metrics of a product, integrating security and compliance from the start.

How do evals differ from traditional PRDs?

Unlike PRDs, evals are continuously updated and include comprehensive security and performance benchmarks, making them more adaptable to change.

Why is AI important in eval-driven development?

AI assists in automating code generation and continuously updating evals, ensuring products meet evolving requirements efficiently.

What are the benefits of using evals?

Benefits include enhanced agility, improved security compliance, and better alignment with user needs, as supported by Venture Beat.

How can companies start using evals?

Begin by implementing evals in small projects, invest in training, and use AI tools like Runable to streamline the process.

Are there any downsides to using evals?

Potential downsides include initial complexity and the need for ongoing updates, but these can be managed with proper planning and tools.

Key Takeaways

• Evals are replacing traditional PRDs in modern product development.
• AI-driven evals enhance product agility and security compliance.
• Companies like Runable leverage evals for AI-powered automation.
• Evals integrate user feedback and continuous improvement strategies.
• Future trends include AI integration and regulatory compliance facilitation.

Related Articles

• Samsung's Bold Move into Robotics: Establishing a New Division [2025]
• Working Late Could Boost Your Promotion Prospects [2025]
• When IT Works Best: The Invisible Backbone of Modern Workplaces [2025]
• Anthropic’s $1.5B Copyright Settlement: Implications and Future Trends [2025]
• Lorde's Critique Sparks Debate on Spotify's AI 'About the Song' Feature [2025]
• Why AI is Re-designing Data Center Architecture [2025]