10-9-2015
Sogeti Testing University
TMap® HD. Test Engineer.
Working with the TMap Suite for Test Engineers Confidence through built-in Quality Vianen, 3 september 2015
Working with the TMap Suite | 2
Werken met de TMap Suite
1
10-9-2015
Agenda: Welkom en introductie TMap HD en de TMap Suite Workshop: Testen met testontwerptechnieken (maar niet met de hand!!) • Terugkoppeling en conclusie • Afsluiting • • •
Working with the TMap Suite | 3
Even kort kennis maken… Wie van jullie is: Test Analist / Test Engineer
Test Manager Overig (Wat dan?) Wie van jullie heeft: TMap Test Engineer certificaat TMap Test Manager certificaat Working with the TMap Suite | 4
Werken met de TMap Suite
2
10-9-2015
Even voorstellen: Rik Marselis Management Consultant Quality & Testing bij Zo’n 35 jaar IT ervaring, zo’n 17 jaar kwaliteit & testen
Adviseur, procesverbeteraar & coach bij vele organisaties Prince2 Practitioner, CMMI en CISA Docent voor diverse trainingen, bijv. Agile testen TMap, TPI en ISTQB geaccrediteerd
Research Auteur div. boeken en artikelen
Fellow van SogetiLabs, Spreker op div. conferenties En daarnaast:
Voorzitter
(vereniging voor & door testers, 1700 leden)
@rikmarselis
Working with the TMap Suite | 5
TMap’s evolution: TMap HD & the TMap Suite Confidence through built-in Quality
Working with the TMap Suite | 6
Werken met de TMap Suite
3
10-9-2015
TMap’s evolution
Application
Adaptive
variant
Pattern
TMap ‘blue’
TMap NEXT
TMap HD
Process driven
Business driven
Human driven
Working with the TMap Suite | 7
The TMap Suite TMap Suite
www.TMap.net
TMap NEXT certificates remain valid! Working with the TMap Suite | 8
Werken met de TMap Suite
4
10-9-2015
TMap HD: What’s new? Confidence through built-in Quality
Working with the TMap Suite | 9
TMap HD: What’s new?
10 |
Werken met de TMap Suite
5
10-9-2015
New: the Elements Mr. Mikkel introduces Neil to the elements…
11 |
New: the Elements Mr. Mikkel introduces Neil to the elements…
| 12
Werken met de TMap Suite
6
10-9-2015
TMap HD: The Elements
Integrate People
Simplify
Confidence
Industrialize Human driven
Quality driven Working with the TMap Suite | 13
How testing is often perceived
Two IT people are cycling up a hill on a tandem-bike. When they finally reach the summit the one in front, the developer, says: ‘It was hard but we made it!’ Then the one at the back, the tester, comments: ‘Yes and I hope you appreciate that I was using the brakes all the time because otherwise we would have rolled down the hill backwards’ Use TMap HD to make sure you are a tester that helps cycling up the hill !! Working with the TMap Suite | 14
Werken met de TMap Suite
7
10-9-2015
Element People: the T-shaped professional The difference between failure and success is in… the People involved Human Driven as opposed to Process Driven Skills, Knowledge and Experience of the individual are crucial Team responsibility vs. Personal responsibility Working with the TMap Suite | 15
The modern tester … must be:
… needs to possess:
Curious
People-skills
Creative
Testing-skills
Quality driven
Tooling-skills
Willing to learn
Observational skills
Multi-disciplinary
Domain knowledge
Working with the TMap Suite | 16
Werken met de TMap Suite
8
10-9-2015
Element: Integrate Collaboration across the entire Application LifeCycle • Reviews and clear handovers in traditional lifecycle • Integrated cross-functional teams in iterative lifecycles
Working with the TMap Suite | 17
Element: Simplify IT is rapidly becoming more complex and more difficult to manage. To reverse this trend we must simplify. By using standard components the process and product become simpler. As a tester we can use test design techniques to make sure we have just enough test cases. Don’t do unnecessary activities. Work in short cycles with clear goals. Working with the TMap Suite | 18
Werken met de TMap Suite
9
10-9-2015
Element: Industrialize Automate and Standardize The tester needs to develop an additional skill set Recognize opportunities, even if you can’t realize them yourself
Working with the TMap Suite | 19
Element: Industrialize Industrialize is about being efficient and effective Automated test design Automated test execution Automated test data management Automated test environment management But also: Checklists Comparators Tools to specify expected outcomes Etc. Working with the TMap Suite | 20
Werken met de TMap Suite
10
10-9-2015
Quality Driven
TMap HD
Quality-Driven Working with the TMap Suite | 21
The Final Element: Confidence The overarching result! Confidence in: The quality of the end product The team By the team members and By ‘the organization’!
One self
Working with the TMap Suite | 22
Werken met de TMap Suite
11
10-9-2015
The Elements & Continuous improvement continuous improvement Integrate
People
Simplify
Confidence
Industrialize Human driven
Quality driven Working with the TMap Suite | 23
Building Blocks
Confidence through built-in Quality
Working with the TMap Suite | 24
Werken met de TMap Suite
12
10-9-2015
TMap HD: Building Blocks
Working with the TMap Suite | 25
Building Block:
Test varieties Confidence through built-in Quality
Working with the TMap Suite | 28
Werken met de TMap Suite
13
10-9-2015
Testing needs different angles and views Today people are hesitant to use the word ‘Test Level’ since it seems to imply hierarchy. Testers often struggle to distinguish between Test Levels and Test Types. What should the focus of testing should be? What stakeholders should be involved in testing? Do they have different needs? Inexperienced Agile teams often do unit testing only, they forget the need to look from other perspectives
Working with the TMap Suite | 29
Test varieties
30 | TM ap da g
Werken met de TMap Suite
14
10-9-2015
Implementing test varieties Traditional lifecycles
Iterative lifecycles
Test levels Test types
Test approaches Blended model
Working with the TMap Suite | 31
Test approaches - Experience based - Coverage based Confidence through built-in Quality
Working with the TMap Suite | 41
Werken met de TMap Suite
15
10-9-2015
Test approaches
•
What do these terms mean?
•
What is the difference?
Working with the TMap Suite | 42
Test approaches with TMap HD Experience based
Coverage based
1.
Checklist Used for static & dynamic testing
1.
Process e.g. Proces Cycle Test
2.
Error guessing Based on previously encountered defects
2.
Conditions e.g. Elementary Comparison Test of Decision table
3.
Exploratory testing Learn, design and execute in parallel
3.
Data e.g. Data Combination Test
4.
Appearance e.g. Syntactic or using user profile Working with the TMap Suite | 43
Werken met de TMap Suite
16
10-9-2015
Coverage based testing
Confidence through built-in Quality
Working with the TMap Suite | 44
Welke testontwerptechnieken ken je?
45 |Exp lora tory Test
Werken met de TMap Suite
17
10-9-2015
Test design techniques & coverage types TMap NEXT
• Equivalence classes • Boundary value analysis • Decision points (CC, DC, CDC, MCDC, MCC) • Orthogonal arrays • Pairwise testing • Data cycle test (CRUD) • Statistical usage (op.prof. • Right paths / Fault paths • Checklist • Decision table • Data Combination Test • Elementary comparison tst • Process Cycle test • Real-life test • Semantic test • Syntactic test • Use case test • Error Guessing • Exploratory testing • Reviews • Walkthroughs • Inspections
ISTQB • • • • • • • • • • • • • • • • • • • • •
Equivalence partitioning Boundary value analysis Decision table testing Cause Effect graphing State transition testing Use case testing User story testing Structure based (SC, CC, DC, CDC, MCDC, MCC) Error Guessing Exploratory testing Orthogonal arrays Pairwise testing Domain analysis Defect based techniques Checklist Combinatorial / Class. tree Informal review Technical review Walkthrough Inspection Static analysis
Torbjorn Ryber
• Exploratory testing (this is an approach, not a technique) • Inspection • Walkthrough • Technical review • Informal review • Modelling • Equivalence partitions • Boundary values • Domain tests • Business process testing • Use case testing • State based testing • Decision tables & trees • Elementary comparison • Combinatorial testing • Data cycle testing • Syntax testing • Time cycle testing • Program Logic (SC, BC, PC) • Data flow testing
Boris Beizer • Control-flow testing • Loop testing • Data-flow testing • Transaction-flow testing • Domain testing • Syntax testing • Finite-state testing
And more…
| 46
Select from 4 groups of Coverage types Better know & use one technique of each group than all techniques of only one group Working with the TMap Suite | 47
Werken met de TMap Suite
18
10-9-2015
Zo werkt “testen met een testontwerptechniek” Ontwerp alle testgevallen met een bepaalde techniek
Voer alle testgevallen uit
Rapporteer over de resultaten Working with the TMap Suite | 48
Waaruit bestaat een testgeval?
Uitgangssituatie Actie & Input Verwacht resultaat Working with the TMap Suite | 49
Werken met de TMap Suite
19
10-9-2015
Coverage based testing + Industrialize = COVER Confidence through built-in Quality
Working with the TMap Suite | 50
COVER: de testontwerptool van Sogeti Ontwerpen van: • testsituaties, • testgevallen en • fysieke testgevallen Diverse technieken Working with the TMap Suite | 51
Werken met de TMap Suite
20
10-9-2015
COVER Demo
Working with the TMap Suite | 52
Workshop
Confidence through built-in Quality
Working with the TMap Suite | 53
Werken met de TMap Suite
21
10-9-2015
Workshop; De OV-korting-case
Working with the TMap Suite | 54
Voorbeeld COVER Condities Elementaire Vergelijkingen Test
Working with the TMap Suite | 55
Werken met de TMap Suite
22
10-9-2015
Uitleg workshop In teams van + 4 mensen: Ontwerp testgevallen, m.b.v. COVER met PCT en DCT Noteer de testgevallen op de logsheet Voer de testgevallen uit Rapporteer je resultaten Als je klaar bent: vraag om de exploratory testing charter Working with the TMap Suite | 56
Workshop; De OV-korting-case
Working with the TMap Suite | 57
Werken met de TMap Suite
23
10-9-2015
Toelichting PCT PCT: - Teken de procesflow met www.draw.io - Exporteer de flow als XML (plain) - Importeer de XML in COVER - Genereer de logische testgevallen - Maak op een logsheet de fysieke testgevallen - Voer de fysieke testgevallen uit
Working with the TMap Suite | 58
Toelichting DCT DCT: - Bepaal de verschillende gegevens - Bepaal per gegeven de equivalentieklassen - Ga naar “data” in COVER, en kies “genereer testgevallen” - Vul de gegevens in en de verschillende klassen - Genereer de testgevallen - Maak op een logsheet de fysieke testgevallen - Voer de fysieke testgevallen uit
Working with the TMap Suite | 59
Werken met de TMap Suite
24
10-9-2015
Terugkoppeling Hoeveel testgevallen heb je gemaakt? Wat zijn je testresultaten (passed/failed/observations) Heb je bevindingen? Met welk testgeval heb je de bevinding gevonden?
Working with the TMap Suite | 60
Terugkoppeling en conclusie Coverage based testen met tooling zodat je op een efficiënte manier een aantoonbare dekking hebt
Experience based testen om aanvullende dekking, en vooral vertrouwen te krijgen Combinatie van gegenereerde dekking en hersenkracht geeft optimaal testen.
Working with the TMap Suite | 61
Werken met de TMap Suite
25
10-9-2015
Omgaan met een complete gereedschapskist
Working with the TMap Suite | 62
Conclusie
Met de TMap Suite ga je van: Werken volgens TMap Naar:
Werken met TMap Working with the TMap Suite | 63
Werken met de TMap Suite
26
10-9-2015
The TMap Suite summarized TMap HD and TMap NEXT and tmap.net
Confidence through built-in Quality Not just for ‘true’ Lean or Agile environments, but also in traditional and hybrid environments.
Human Driven Quality Driven Elements
People Simplify Integrate Industrialize
Confidence
Building Blocks
Patterns
Tooling (bijv. COVER) Working with the TMap Suite | 64
Meer lezen? Download vanaf www.marselis.eu of neem een printje mee.
Working with the TMap Suite | 65
Werken met de TMap Suite
27
10-9-2015
The end.
Happy Testing!
Werken met de TMap Suite
28