Continuous testing in DevOps met Test Automation

Continuous Testing in DevOps met Test Automation

Continuous testing in DevOps met Test Automation Marco Jansen van Doorn Test Tool Consultant TMap dag 2015

|

1

DevOps… DevOps is a software development method that emphasizes communication, collaboration, integration, automation, and measurement of cooperation between software developers and other IT professionals. The method acknowledges the interdependence of software development, quality assurance, and IT operations, and aims to help an organization rapidly produce software products and services and to improve operations performance |

TMap dag 2015

2


Wat is DevOps?

"The traditional model is that you take your software to the wall that separates development and operations, and throw it over and forget about it. Not at Amazon. You build it, you run it. This brings developers into contact with the day-to-day operation of their software. It also brings them into day-to-day contact with the customer.“

Amazon CTO Werner Vogels

|

3

|

4

Wat is DevOps?

Dev

Ops

Lange verantwoordelijkheid

Dev Vroege betrokkenheid

Ops

TMap dag 2015


DevOps is Continuous

Kwaliteitsdenken vanaf requirements tot en met productie

Continuous Build Build &Integrate na elke wijziging

Continuous Test Test na elke wijziging

Continuous Monitoring

Valideer de opartionele kwaliteit

Continuous Quality

Continuous Deployment Deploy na elke wijziging

|

5

|

6

Quality & Testen in DevOps Functionaliteit

Dev

Test

Ops Non-functionals

Beheerbaarheid

Connectiviteit

Continuiteit

Portabiliteit

Infrastructuur

Beveiliging

Performance

Zuinigheid

TMap dag 2015


Automation in DevOps

Ops-tools

Code Repository

Dev

Dev-tools

IDE

Test

Ops

Build Automation

Incident Management Infrastructure Monitoring

Test-tools

CI Server

Configuration Management

Test Management tools

Test Execution Tools

Deployment Automation

Test Design Tools

Test Environment Tools

Performance Management|

Test tools Quality Dashboard Test Control

Quality Reporting Code Coverage

Test Design Automated Test Design

Testware Management

Static Code Analysis Secure Code Scan

Progress Reporting

Defect Management

Test Execution Automated Unit Test

Automated Functional Test

Task Management

Automated Security Test Performance Test

Test Environment Test Data Management

Test Environment Management

Service Virtualization

|

TMap dag 2015

8


Continuous Quality & Testing Continuous Quality

Design By Example BDD

ATD

ATDD Testware Management

Continuous Test

Automated Test Execution TA

Quality Dashboard

TDD

Model Based Thinking

Continuous Test Environment

PT

SV

TDM |

9

Test Automation in DevOps

Dev

Test

Ops

Enable Continuous Test

Test Nonfunctionals

Performance monitoring

Quality Dashboard

| 10

TMap dag 2015


Continuous Test Code Repository

CI Server

Automated Unit Test


Test Environment Test Automated Functional Test

Daily Run Performance Test

Quality Dashboard

Build Automation

| 11

Enable continuous test Inventory

Build Automation

Deployment package


Configurations

Deploy with endpoints to stubs

Deployment scenarios

Environment

Create test data in database Test Environment Test

TMap dag 2015

Quality Dashboard |


Non-functional: Performance Strategy

Performance Monitoring

Analysis

Operations

Performance Requirements

Performance Test | 13

Change

Continuous performance testen Daily Run (Scheduler)

Performance Test

Virtual Users

Environment

Response times

Datastore

Quality Dashboard | 14

TMap dag 2015


Performance monitoring Real Users

Scheduler (periodiek)

Virtual User

Production environment

Response times

Alert

Datastore

Quality Dashboard | 15

Waar beginnen? Begin bij de testomgeving… ► Expertise is aanwezig in het team ► Randvoorwaardelijk voor Continuous Test Dan de testomgeving test ► Stapsgewijs uitbreiden en verbeteren En performancetesten ► Het blijft een keuze: No Risk No Test Gevolgd door het Quality Dashboard | 16

TMap dag 2015


Wat is er nodig? Test tools: ► Technische mogelijkheid om de applicatie te testen ► Aan te sturen vanuit scheduler ► Rapportage naar Quality Dashboard Expertise: ► Test tool expertise ► Alle andere expertise is al in het team aanwezig ► DevOps geeft ruimte aan het verbeteren van de testomgevingen

| 17

Samenvattend Enable Continuous Test

► Maak voorwaarden voor Continuous Test onderdeel van Deployment Automation

Test Nonfunctionals

► Test de installatie als onderdeel van Deployment Automation ► Continuous Performance Test

Performance monitoring

► Meet performance in productie

Dev

Test

Ops

Quality Dashboard

► Centrale rapportage voor Continuous Monitoring | 18

TMap dag 2015


Vraag. Antwoord.

TMap dag 2015

Continuous testing in DevOps met Test Automation

Recommend Documents