Int J Performability Eng ›› 2019, Vol. 15 ›› Issue (11): 2944-2951.

### Crowdsourced Testing Ability for Mobile Apps: A Study on Mooctest

Peng Yanga, Jin Xub,c, Hongyu Shengd,*, Yong Huangb, and Jianfeng Xub

1. aSchool of Information Engineering, Guangzhou Panyu Polytechnic, Guangzhou, 511483, China;
bMooctest Inc., Nanjing, 210000, China;
cSoftware Testing Engineering Laboratory of Jiangsu Province, Nanjing, 210000, China;
dBeijing Key Lab of Information Service Engineering, Beijing Union University, Beijing, 100101, China
• Submitted on  ;  Revised on  ; Accepted on
• Contact: * E-mail address: jzw@buu.edu.cn

Abstract: As an emerging trend of software testing, crowdsourced testing is increasingly attracting attention from various fields, such as education and industry. In this paper, we studied the ability of crowdsourced testing for teaching. We mainly aimed to find the relationship between students' crowdsourcing ability and their performance in software testing courses, so as to help schools devise a better teaching model and further improve teaching quality. Our study included two parts. First, we published crowdsourced tasks of a mobile application to students on a well-known crowdsourced testing platform. Then, we conducted a follow-up survey to collect more information about the students. We surprisingly found that the superiority of a student's grades can be reflected with higher crowdsourced testing skills to an extent, but not as an absolute measure. More importantly, practical crowdsourced testing is naturally complementary to purely theoretical teaching.