Test2Vec: An Execution Trace Embedding for Behaviour Coverage Analysis of Test Cases

Simple item page
dc.contributor.advisorHemmati, Hadi
dc.contributor.authorZangeneh, Soheila
dc.contributor.committeememberFar, Behrouz Homayoun
dc.contributor.committeememberUddin, Gias
dc.date2021-02
dc.date.accessioned2021-01-27T15:59:16Z
dc.date.available2021-01-27T15:59:16Z
dc.date.issued2021-01-22
dc.description.abstractIn software testing, test adequacy metrics are mostly based on the source code and ignore the dynamic behavior of the program. In this thesis, we demonstrate that code coverage metrics are not able to distinguish between a Failed and Passed behavior in most cases. Neural program embeddings have shown much promise recently for a variety of program analysis tasks. We propose a new embedding approach called Test2Vec with an attention layer for test representation in order to capture behavioral patterns of test cases. We used test execution traces including the input values as the training dataset and evaluated our approach on 93 real faulty versions of 4 open source Java projects. Our results show that Test2Vec can rank the failing test in the top 5, 10, and 20 tests, on average, 20.43%, 32.26%, and 44.09% of the times, while branch coverage and statement coverage can only distinguish the failing tests in 13% and 16% of cases, respectively.en_US
dc.identifier.citationZangeneh, S. (2021). Test2Vec: An Execution Trace Embedding for Behaviour Coverage Analysis of Test Cases (Master's thesis, University of Calgary, Calgary, Canada). Retrieved from https://prism.ucalgary.ca.en_US
dc.identifier.doihttp://dx.doi.org/10.11575/PRISM/38591
dc.identifier.urihttp://hdl.handle.net/1880/113023
dc.language.isoengen_US
dc.publisher.facultySchulich School of Engineeringen_US
dc.publisher.institutionUniversity of Calgaryen
dc.rightsUniversity of Calgary graduate students retain copyright ownership and moral rights for their thesis. You may use this material in any way that is permitted by the Copyright Act or through licensing that has been assigned to the document. For uses that are not allowable under copyright legislation or licensing, you are required to seek permission.en_US
dc.subjectSoftware Engineeringen_US
dc.subjectSoftware Testingen_US
dc.subjectMachine Learningen_US
dc.subjectBehaviour Analysisen_US
dc.subjectTest Adequacyen_US
dc.subjectSoftware Analysisen_US
dc.subject.classificationEducation--Technologyen_US
dc.subject.classificationEducation--Tests and Measurementsen_US
dc.subject.classificationChemistry--Analyticalen_US
dc.subject.classificationEngineeringen_US
dc.titleTest2Vec: An Execution Trace Embedding for Behaviour Coverage Analysis of Test Casesen_US
dc.typemaster thesisen_US
thesis.degree.disciplineEngineering – Electrical & Computeren_US
thesis.degree.grantorUniversity of Calgaryen_US
thesis.degree.nameMaster of Science (MSc)en_US
ucalgary.item.requestcopytrueen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
ucalgary_2021_zangeneh_soheila.pdf
Size:
7.89 MB
Format:
Adobe Portable Document Format
Description:
Main Thesis
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
2.62 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Open Theses and Dissertations