Int J Performability Eng ›› 2019, Vol. 15 ›› Issue (7): 2008-2018.doi: 10.23940/ijpe.19.07.p28.20082018

Previous Articles    

Equivalent Version Sets Testing Method for Android Applications based on Code Analysis

Song Huang, Sen Yang*, Yongming Yao, and Lele Chen   

  1. Command and Control Engineering College, Army Engineering University of PLA, Nanjing, 210007, China
  • Submitted on ;
  • Contact: * E-mail address:
  • Supported by:
    This work is supported by the National Key R&D Program of China (No. 2018YFB1403400).

Abstract: The Android system is an open source mobile operating system that has been released in numerous versions. Android fragmentation is becoming more and more serious. This paper shows how different Android runtime environments affect test coverage results. To address this limitation, we run apps on all Android versions to collect coverage rate and also present an algorithm to generate equivalent test runtime-environment-set to exercise mobile apps. Our approach is to systematically test the targeted code of Android apps based on code analysis. It analyzes the decompiled code that identifies the code related to the Android SDK version and then generates the corresponding test cases. An empirical study of the practical usefulness of the technique is presented for six widely-used industrial apps. The test result shows that our equivalence test runtime-environment-set only requires less than half of all versions, which dramatically reduces the test resources. Moreover, the method coverage of these applications increased by an average of 49.3% on all versions and 46.8% on equivalent test runtime-environment-set, respectively.

Key words: mobile testing, code analysis, android version, runtime environment, set generation