Difference between revisions of "Comparative study of an automated testing coverage for a TCP/IP stack implementation"

From CERES
Jump to: navigation, search
(Created page with "{{StudentProjectTemplate |Summary=The topic of the project is the comparative study of the coverage of the tests generated by the QuickCheck tool against real coverage require...")
 
 
Line 12: Line 12:
 
|Status=Open
 
|Status=Open
 
}}
 
}}
The topic of the project is the comparative study of the coverage of the tests generated by the QuickCheck tool against real coverage requirements. The QuickCheck tool generates tests automatically based on a model - a high-level formal description of the system. The generated tests, even though easily provided in arbitrary quantity, may or may not reflect a typical real use of the component under test in terms of invoked operations and their inputs. For the case study we choose an available Erlang TCP/IP stack implementation and its QuickCheck model used for test generation. The real use of the stack can be easily analysed using a network analysis tool like Wireshark. The first challenge is to compare this to the the coverage of QuickCheck tests, the second challenge is to propose a way to guide QuickCheck test generation to improve this coverage (if necessary) towards more realistic one.
+
The topic of the project is a comparative study of the coverage of the tests generated by the QuickCheck tool against real coverage requirements. The QuickCheck tool generates tests automatically based on a model - a high-level formal description of the system. The generated tests, even though easily provided in arbitrary quantity, may or may not reflect a typical real use of the component under test in terms of invoked operations and their inputs. For the case study we choose an available Erlang TCP/IP stack implementation and its QuickCheck model used for test generation. The real use of the stack can be easily analysed using a network analysis tool like Wireshark. The first challenge is to compare this to the the coverage of QuickCheck tests, the second challenge is to propose a way to guide QuickCheck test generation to improve this coverage (if necessary) towards more realistic one.

Latest revision as of 08:57, 25 September 2018

Title Comparative study of an automated testing coverage for a TCP/IP stack implementation
Summary The topic of the project is the comparative study of the coverage of the tests generated by the QuickCheck tool against real coverage requirements
Keywords model-based testing, coverage, TCP/IP
TimeFrame 6 months
References Wojciech Mostowski, Thomas Arts, and John Hughes. Modelling of Autosar Libraries for Large Scale Testing. Proceedings, 2nd Workshop on Models for Formal Analysis of Real Systems (MARS 2017), Uppsala, Sweden, April 2017, Volume 244 of EPTCS. http://ceres.hh.se/mediawiki/images/b/bb/Mostowski_mars2017.pdf

Thomas Arts and John Hughes (2016): How Well are Your Requirements Tested? In: 2016 IEEE International Conference on Software Testing, Verification and Validation, pp. 244–254, doi:10.1109/ICST.2016.23."Wojciech Mostowski, Thomas Arts, and John Hughes. Modelling of Autosar Libraries for Large Scale Testing. Proceedings, 2nd Workshop on Models for Formal Analysis of Real Systems (MARS 2017), Uppsala, Sweden, April 2017, Volume 244 of EPTCS. http://ceres.hh.se/mediawiki/images/b/bb/Mostowski_mars2017.pdf

Thomas Arts and John Hughes (2016): How Well are Your Requirements Tested? In: 2016 IEEE International Conference on Software Testing, Verification and Validation, pp. 244–254, doi:10.1109/ICST.2016.23." cannot be used as a page name in this wiki.

Prerequisites
Author
Supervisor Wojciech Mostowski
Level Master
Status Open

Generate PDF template

The topic of the project is a comparative study of the coverage of the tests generated by the QuickCheck tool against real coverage requirements. The QuickCheck tool generates tests automatically based on a model - a high-level formal description of the system. The generated tests, even though easily provided in arbitrary quantity, may or may not reflect a typical real use of the component under test in terms of invoked operations and their inputs. For the case study we choose an available Erlang TCP/IP stack implementation and its QuickCheck model used for test generation. The real use of the stack can be easily analysed using a network analysis tool like Wireshark. The first challenge is to compare this to the the coverage of QuickCheck tests, the second challenge is to propose a way to guide QuickCheck test generation to improve this coverage (if necessary) towards more realistic one.