Test Process Improvement & Test/Build Tool Evaluation




Download 0.54 Mb.
NameTest Process Improvement & Test/Build Tool Evaluation
page1/13
A typeTest
manual-guide.com > manual > Test
  1   2   3   4   5   6   7   8   9   ...   13






Test Process Improvement & Test/Build Tool Evaluation

Master thesis 30hp, Advanced level
Students:

Jesper Söderlund

jsd04002@student.mdh.se

Thomas Sörensen

tsn03001@student.mdh.se
Supervisor:

Markus Lindgren

markus.lindgren@mdh.se
Examiner:

Daniel Sundmark

daniel.sundmark@mdh.se




















School of Innovation, Design and Engineering

P.O. Box 883, SE-721 23 Västerås.
Tel: +46 21 10 31 60.

E-mail: idtexp@mdh.se

Web: www.mdh.se/idt


Sammanfattning
De produkter som företaget tillverkar används i huvudsak inom ett område av branschen där fel som leder till stopp i produktionen kan vara ganska dyrt. Detta gör testning av produkterna viktiga och tester kan också ge indikationer om kvaliteten på produkterna.

Företaget är i en fas där man utvecklar en ny produktlinje som ska stödja alla befintliga och framtida produkter. I denna fas har man beslutat att alla produkterna ska använda ett gemensant ramverk för enhetstestning och även använda ett gemensamt byggsystem för samtliga produkter. En del av examensarbetet var att undersöka och utvärdera olika ramverk för enhets testning och verktyg för byggsystem. De ramverk som utvärderades var CppUnit, cfix, NUnit, Boost test library, unitTest++ och CxxTest. Utvärderingen ledde fram till att CppUnit rekommenderades till företaget. Verktyg som utvärderades för byggsystem var MSBuild, NAnt, Automated Build Studio och Cruise Control .Net. För byggsystem rekommenderas MSBuild i kombination med Cruise Control .Net ifall företaget är intresserade av den extra funktionalitet som Cruise Control .Net har att erbjuda.

Företaget har även ett intresse av att utvärdera den nuvarande testprocessen och identifiera förbättringar som ett led i att befintliga produkter skall följa en gemensam testprocess. För att kunna identifiera dessa förbättringar utfördes en litteraturstudie över fyra stycken test process förbättrings ramverk (Test Process Improvent, Test Maturity Model integrated, Minimal Test Practice Framework och Test Improvement Model). Utav dessa fyra ramverk så valdes Test Process Improvement (TPI) ut som en hjälp för att identifiera förbättringar. Med hjälp av TPI utfördes en begränsad bedömning av företagets mogenhetsgrad på tre produkter, där två av produkterna har en låg mogenhetsgrad. Resultat av förbättringsåtgärderna kan sammanfattas med att man bör harmonisera dokument, standardisera och dokumentera olika processer.

Som en sista del i examensarbetet så utvärderades möjligheten att automatisera testning på två av produkternas grafiska användargränssnitt med programmet TestComplete. För en av produkterna blev resultatet att det fungerade tillfredställande och för den andra produkten så fungerade det inte alls. Resultatet blev rekommendationer för hur företaget borde gå vidare med automatisering av testnig på det grafiska användargränssnittet.




Abstract
The products The Company manufactures are used in an area of the industry where errors leading to a stop in production can be quite expensive. Therefore are testing of the products important and the tests can also give indications about the quality of the products.

The Company is in a phase where they are developing a new product line to support all existing and future products. In this phase, it was decided that all products will use a common framework for unit testing and a common build system for all products. One part of the thesis was to investigate and evaluate different frameworks for unit testing and tools for a build system. The unit test framework that were evaluated are Cppunit, cfix, NUnit, Boost test library, Unit Testing++ and CxxTest. The result of the evaluation was that CppUnit were recommended. For the build system MSBuild, NAnt, Automated Build Studio and Cruise Control .NET were evaluated. The recommended tools for a build system is MSBuild in combination with Cruise Control .Net if The Company is interested in the functionality Cruise Control .Net has to offer.

The Company also has an interest in evaluating the current test processes and identify improvements as a part of The Company’ s objective were all products should follow a common test process. In order to identify these improvements a literature study of four test process improvement frameworks (Test Process Improvement, Test Maturity Model Integrated, Minimal Test Practice Framework and Test Improvement Model) were carried out. Out of these four frameworks Test Process Improvement (TPI) were chosen to assist when identifying improvements. With the help of TPI a limited assessment took place to give indications about the test maturity for three of The Company’s products where two of the products had low maturity. Results of the improvement measures can be summed up with the need to harmonize the documents, standardize and document the various processes.

As a last part of the thesis the possibility to automate testing of two of the products graphical user interfaces with the program Test Complete were investigated. For one of the products the result was that it worked satisfactorily and for the other product it did not work at all. This resulted in recommendations for how The Company should proceed with automated testing of the graphical user interface.




1 Definitions and acronyms 6

2 Introduction 7

3 Testing 8

Testing Methods 8

Testing levels 8

Code Coverage 9

4 Unit testing 10

Introduction 10

Literature survey 10

Interviews 11

Evaluation of unit test Frameworks 11

CxxTest 13

Boost test library 13

Cfix 13

CppUnit 13

Unittest++ 13

NUnit 14

Summary of Evaluation of Unit Test Frameworks 14

Results 14

15

5 Build systems 16

Introduction 16

Literature survey 16

Evaluation of Build Tools 17

MSBuild 18

NAnt 18

Automated Build Studio 19

Cruise Control .Net 19

Result 19

6 Test improvement 20

Introduction 20

Literature survey 20

TPI (Test Process Improvement) 20

TMMI (Test Maturity Model Integrated) 21

MTPF (Minimal Test Practice Framework) 22

TIM (Test Improvement Model) 22

Choice of Framework 22

TPI Assessment 22

TPI Assessment summary 30

Improvement suggestions 30

Results 31

7 Test automation 32

Introduction 32

Literature survey 32

TestComplete Overview 33

Experiences in using TestComplete 33

Recommendations for further work 34

Result 34

8 References 36


  1   2   3   4   5   6   7   8   9   ...   13

Share in:

Related:

Test Process Improvement & Test/Build Tool Evaluation iconAbstract While it might seem that the most important consideration...

Test Process Improvement & Test/Build Tool Evaluation iconTest lab managers, it professionals, and developers who manage the...

Test Process Improvement & Test/Build Tool Evaluation iconTest parts for design improvement

Test Process Improvement & Test/Build Tool Evaluation iconTest and Evaluation Master Plan

Test Process Improvement & Test/Build Tool Evaluation iconTest Requirements verified by the Microsoft Platform Ready Tool 5

Test Process Improvement & Test/Build Tool Evaluation iconTest Reports: Manufacturer’s Printed Test Report via a Tektronics...

Test Process Improvement & Test/Build Tool Evaluation iconTest Reports: Manufacturer’s Printed Test Report via a Tektronics...

Test Process Improvement & Test/Build Tool Evaluation iconRevised Graduate Record Examinations® General Test Practice Test Number 1

Test Process Improvement & Test/Build Tool Evaluation iconRevised Graduate Record Examinations® General Test Practice Test Number 1

Test Process Improvement & Test/Build Tool Evaluation iconRevised Graduate Record Examinations® General Test Practice Test Number 1

Test Process Improvement & Test/Build Tool Evaluation iconTest inputs to achieve mc/dc coverage of the code under test can now be generated automatically

Test Process Improvement & Test/Build Tool Evaluation iconTest Analysis and Test Management. Have frequently turned around...

Test Process Improvement & Test/Build Tool Evaluation iconBulletin new Test Procedures to be Discussed at Txapa test Procedure Committee

Test Process Improvement & Test/Build Tool Evaluation iconTest Driven Development, nunit and the Microsoft Test Framework

Test Process Improvement & Test/Build Tool Evaluation iconTest to adequately test for the kind of smoke given off by modern furniture, and

Test Process Improvement & Test/Build Tool Evaluation iconTest units shall not be smaller in either width or height than the...

Test Process Improvement & Test/Build Tool Evaluation iconAbstract: This paper examines the successful application of tolerances...

Test Process Improvement & Test/Build Tool Evaluation iconCold War Test do not write on this test

Test Process Improvement & Test/Build Tool Evaluation iconTest written instructions against the process they propose to explain....

Test Process Improvement & Test/Build Tool Evaluation iconTest Tools: Test Director 0, Selenium ide and rc, evalid, AutoIT,...




manual




When copying material provide a link © 2017
contacts
manual-guide.com
search