Fast Feedback from Long-Running Tests

As software systems grow, so does the number of their tests. As a result, we increasingly often encounter test suites that run hours or days, which is painfully slow. To get fast feedback about new bugs despite slow tests, we can run a subset of all tests more frequently. If this subset is chosen well, these tests identify most bugs very quickly.

This approach heavily depends on the selection of frequently-executed tests. We developed two different approaches for selection:

• Test-Impact Analysis
• Pareto Optimization

In this workshop, we first present the key ideas and research studies for both, and then demo them live in our analysis tool Teamscale.

Attendees' voices

»A very good presentation and live demo!«

»Already knew Pareto-Optimization by CQSE, the live demo was great for deeper understanding!«

Speakers

• Dr. Elmar Jürgens - Co-Founder of CQSE and deals with quality analyses of software his whole professional life.
• Raphael Nömmer - Uses Test-Impact Analysis and Pareto Optimization every day with our customers.
• Fabian Streitel - Leads the Pilot Team at CQSE and has successfully set up Test-Impact Analysis and Pareto Optimization with many customers.

The Workshop took place on October 26, 2022 (10:30-12:00 CEST) in German with the same content.