Abstract: Performance testing occupies an advantageous status in software testing since software performance is closely related to software quality and user experience. Performance defects, however, are often more latent with complex action mechanisms, making performance testing challenging. In this work, we invite chaos engineering and propose an automated performance testing system to discover performance defects and ensure software quality. The main idea of our system is to inject faults artificially to simulate real scenarios to see whether the system can still perform well even under bad conditions. In total, there are two main roles in our system: scenario designer and fault manager, in which the former is to design possible application scenarios of the system, while the latter is to inject faults according to the scenarios. Testing is conducted under real conditions so that defects can be figured out more easily. Experiments have demonstrated its rationality and validity.

Key words: software performance testing, chaos engineering, application scenarios, performance defect