How Facebook Uses Sapienz AI to Automate Android App Testing and Reduce Crashes

By: GoBeyond Team
July 3, 2025
3 min read
Facebook Sapienz AI testing dashboard showing test case generation and crash detection

Quick Overview

Facebook deployed Sapienz, an AI-powered automated testing tool, to autonomously generate, execute, and report tens of thousands of test cases daily for its Android app. Sapienz explores app behaviors using search-based software engineering, identifies bugs including edge cases missed by manual testing, and integrates with continuous deployment pipelines for rapid bug detection and fixes.

Facebook (Meta)
Facebook (Meta)
Company Size
Large multinational social media company
Revenue Range
$130B+ annual revenue
Primary Challenge
Ensuring app stability and performance at massive scale with efficient and comprehensive testing
Key Metrics
\- 80% reduction in Android app crashes\- Tens of thousands of test cases generated and run daily\- 75% of Sapienz reports actionable and result in fixes\- Near real-time bug detection and reporting\- Extremely low false-positive rate

The Problem

Manual test design was time-consuming, limited in coverage, and unable to keep pace with rapid development cycles

The Solution

Sapienz uses multi-objective search-based software engineering (SBSE) to automatically design system-level test cases, run them on hundreds to thousands of emulators, and report results directly to developers via continuous integration tools

Results

\- Dramatically faster bug detection and resolution\- Improved test coverage including hard-to-find edge cases\- Reduced crash rates and improved app stability\- Friction-free integration into developer workflows\- Scalable testing infrastructure running 24/7 on thousands of emulators

“Sapienz has transformed our testing process, enabling engineers to fix issues within minutes of code submission and significantly reducing app crashes.”

Facebook Engineering Team

Details

Industry
Technology & SaaS
Departments
Product Development & Innovation
IT & Security
Use Cases
Product Testing
Tags
GenAI
NLP
Scalability
Team Efficiency
Time-Saving
AI Tools Used
No items found.
Sources
https://engineering.fb.com/2018/05/02/developer-tools/sapienz-intelligent-automated-software-testing-at-scale/https://www.linkedin.com/pulse/ai-software-testing-real-success-stories-mihir-ranjan-panda-ton5c/https://siliconangle.com/2018/05/02/facebook-brings-automated-testing-developers-scale-sapeinz/https://blog.bytebytego.com/p/automated-bug-fixing-at-facebookhttps://discovery.ucl.ac.uk/id/eprint/10060107/1/Harman_Deploying%20Search%20Based%20Software%20Engineering%20with%20Sapienz%20at%20Facebook_VoR.pdfhttps://dev.to/ronika_kashyap/ai-in-software-testing-enhancing-quality-and-efficiency-k3lhttps://www.weforum.org/stories/2018/10/facebook-sapfix-app-ai-fixes-itself/https://engineering.fb.com/2021/10/20/developer-tools/autonomous-testing/

More Case Studies

See All
How Snowdrop Uses Google Cloud AI and Geospatial Data to Improve Financial Transaction Data Accuracy and Matching
Finance & Banking
How Khan Academy’s Khanmigo AI Tutor Enhances Personalized Learning with GPT-4
Education & EdTech
How a Global Software Development Project Used an AI-Powered Chatbot to Enhance Communication and Delivery
Technology & SaaS
How Netflix Uses AI to Personalize Content Recommendations and Optimize Originals
Media & Entertainment
How SEB Wealth Management Uses Google Cloud AI to Enhance Client Interactions and Efficiency
Finance & Banking
How RE/MAX Uses AI to Personalize Property Recommendations and Improve Buyer Satisfaction
Real Estate

🤖 Chat with AI

Type...