Preparing Software Quality Assurance Professionals: Metamorphic Exploration for Machine Learning

Sen Yang, Dave Towey, Zhi Quan Zhou, T. Y. Chen

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

Computer science (CS) subjects have been rapidly growing in popularity, and demand for CS education and training has put increasing pressure on teaching resources in higher education (HE) and elsewhere. HE in the People's Republic of China (PRC) has also been developing, with one product of this evolution being Sino-foreign HE institutions (SfHEIs). Much of the popularity growth for CS can be linked to the growth of CS-based technology and innovation, especially in the form of Artificial Intelligence (AI) and Machine Learning (ML). AI/ML-based innovation has been forecast to offer increases in quality of life for consumers. However, AI/ML systems face a challenge for software quality assurance (SQA): They are so-called 'untestable systems' - identifying the correctness of AI/ML system outputs or behaviour may not be feasible. Preparing SQA professionals to be able to ensure AI/ML SQA will require innovative and creative education and training. An SQA approach called metamorphic testing (MT) has a proven track record of alleviating the oracle problem, and has great potential as a testing methodology for AI/ML systems. Metamorphic exploration (ME) is a new addition to the MT literature, and involves developing the user's understanding of the system under study. This paper reports on experiences at an SfHEI of using ME and MT to test an AI/ML system.

Original languageEnglish
Title of host publicationTALE 2019 - 2019 IEEE International Conference on Engineering, Technology and Education
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728126654
DOIs
Publication statusPublished - Dec 2019
Event2019 IEEE International Conference on Engineering, Technology and Education, TALE 2019 - Yogyakarta, Indonesia
Duration: 8 Apr 201911 Apr 2019

Publication series

NameTALE 2019 - 2019 IEEE International Conference on Engineering, Technology and Education

Conference

Conference2019 IEEE International Conference on Engineering, Technology and Education, TALE 2019
Country/TerritoryIndonesia
CityYogyakarta
Period8/04/1911/04/19

Keywords

  • Sino-foreign higher education
  • artificial antelligence (AI)
  • computer science
  • machine learning (ML)
  • metamorphic exploration (ME)
  • metamorphic testing (MT)
  • oracle problem
  • software quality assurance (SQA)

ASJC Scopus subject areas

  • Communication
  • Computer Networks and Communications
  • Software
  • Engineering (miscellaneous)
  • Media Technology
  • Education

Fingerprint

Dive into the research topics of 'Preparing Software Quality Assurance Professionals: Metamorphic Exploration for Machine Learning'. Together they form a unique fingerprint.

Cite this