The Speed to Cool

The
Speed to Cool:
Agile Testing
& Building
Quality In
Craig Smith
Adrian Smith
Welcome…
“Eyyy!”
Image: © Fuzzy Door Productions / 20th Century Fox Television
C A
Welcome…
Not
Related…
Image: © Universal Pictures http://cf1.imgobject.com/backdrops/8af/4bc92693017a3c57fe00f8af/twins-original.jpg
C
Not
Australian
for Beer!
Image:http://techfreep.com/images/fosters.jpg
C
The
speed
to
cool…
Image: Pineapples101 (Flickr) http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/
C
Thumbs
up…
Cool!
Image: http://brainsyndicate.files.wordpress.com/2011/05/tumblr_lkp6t8505s1qe4wjro1_400.jpg?w=300&h=355
C
Choke...
Image:http://blog.vidyagamez.com/wp-content/uploads/2010/06/tumbleweed.jpg
C
So, What is a
Tester?
Image: http://rnstechnologies.com/content_images/small_image_2.jpg/
A
Look
left…
Look
right…
A
Look
up…
Image: http://3.bp.blogspot.com/_RdF7S0TNAHY/TOqn8MLYajI/AAAAAAAAAJI/QDBFdixiq0E/s1600/2006-06-17%252520Falling-piano.gif
A
CSI:
Software
Image: © Jerry Bruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg
C
Agile &
Testing
Image: http://3.bp.blogspot.com/_ZdyzysU1QPo/TA0kjLMP43I/AAAAAAAABPk/5ckzpw6OVmk/s1600/Peas+and+Carrots.JPG
C
To Do
Analysis
Develop
Test
Done
We
reflect
work
like
this...
C
To Do
Analysis
Develop
Test
Done
Which is
really
working
like this...
C
Remind you
of
something?
Image: Craig Smith
C
Testers
in an
agile
team
Analyst /
Customer
Elaboration /
Specification
Acceptance
Criteria
Project
Manager
High
Performing
AGILE
Developer
Automation
Tester
C
Testers in
an agile
team
Analyst
Analysts need more
testing involvement
Tester
Testers need more
technical involvement
Developer
Developers need
more testing involvement
Technical
Customer
Collab.
Requirements
Exploratory
Test
Manual
Test
Automated
Functional /
Specialist
Tests
Code
Technical
Unit Test
Less
Design
More
C
Definition of
Quality…
(noun) the standard of something as measured
against other things of a similar kind; the degree
of excellence of something
oxforddictionaries.com
Image: http://www.naccho.org/topics/infrastructure/accreditation/images/Quality-Definition.jpg /
A
Quality
means
different
things
Image: http://upload.wikimedia.org/wikipedia/commons/b/b9/Steve_Jobs_Headshot_2010-CROP.jpg
A
Implicit /
Explicit
Quality
Image: http://s3.amazonaws.com/integral-life-home/iceberg.jpg
A
Testing
≠
Quality
A
Building
Quality
In
Image: http://www.cupojoy.com/images/image/Quality%20Inn%20Exterior.jpg
C
Quality is
everyone’s
responsibility
Image: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg
C
Everyone
likes to be
seen to
value
quality
Image: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg
C
Quality
from kickoff
Image: © United Feature Syndicate http://s458.photobucket.com/albums/qq310/mrbigjohnson/Murals/?action=view&current=NovemberPics115.jpg&newest=1
C
Success
sliders
Cost
Fixed
Flexible
1
2
3
4
X
Scope Quality Time
X
X
X
C
Your
Turn!
Cost
Fixed
Flexible
1
2
3
4
Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg
Scope Quality
Time
X
X
X
X
A
Quality
almost
always at
number 3
Fixed
Flexible
1
2
3
4
Cost
Scope Quality Time
X
X
X
X
A
Correctness
A
Reliability
+
Robustness
+
Availability
+
+
+
+
+
+
-
+
Interoperability
-
Efficiency
-
Testability
+
Maintainability
+
Reusability
-
+
Portability
Reusability
Maintainability
Testability
Efficiency
Interoperability
-
-
Usability
Portability
+
+
+
Integrity
Flexibility
Usability
Flexibility
Integrity
Availability
Robustness
Reliability
Quality
Tradeoffs
-
+
-
+
+
+
+
+
+
+
-
-
+
-
-
+
+
-
-
-
-
-
-
+
-
-
-
-
+
-
+
+
-
+
+
+
-
+
-
+
+
A
Defining
Quality
1
Quality
Advocates
What does quality mean
to the different roles in
the team?
2
Quality
Taxonomy
What are quality
attributes?
3
Quality
Prioritisation
How do we know what
quality attributes to
include?
4
Quality
Tradeoff Risks
What are risks with the
quality attributes we are
trading off?
5
Quality
Measurement
How do we test and
measure quality?
6
Success
Sliders
How does quality relate
to the sliders?
7
Quality
Definition
What does quality
mean?
8
Next Steps
How do we apply
quality to our work
C
Quality
Definition
C
Shared
understanding
of quality
Image: © 2008 Melissa McKenney http://www.kernel.org/pub/linux/kernel/people/paulmck/Confessions/Elephant_Team_03.jpg
C
Strategy
& Plan
Image: http://www.thechildmindingshop.co.uk/ekmps/shops/thecs/images/table-chalkboard-and-white-board-in-one-%5B2%5D-5540-p.jpg
A
Simple
test
strategy
& plans
A
Simple
test
strategy
A
Reporting
& Metrics
Image: © Sesame Workshop http://images.wikia.com/muppet/images/9/95/Sesame-english-do-you-like-it-apple_count.jpg
C
Understand
continuous
integration
Image: http://confluence.atlassian.com/download/attachments/229837908/bamboo-dashboard.png?version=2&modificationDate=1297756308930
C
Understand
code
metrics
Image: http://docs.codehaus.org/download/attachments/111706381/dashboard.png?version=2&modificationDate=1267794480088
C
Report
how
testing
is going
Image: http://1.bp.blogspot.com/-46_MdfmjelA/TVa-kb3lTJI/AAAAAAAAABU/JU38qkUXf2c/s1600/half-full-glass.jpg
C
Your
Turn!
Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg
#1
A
BVC
TESTING
PROJECT
9
5
5
3
4
3
2
2
1
1
0
2
3
4
5
6
7
6
15
5
4
10
3
2
5
1
0
0
1
HEALTH
20
7
Number of Tests
4
25
8
Number of Defects
6
New Risks & Issues Raised
Number of Risks & Issues
7
0
1
8
2
3
4
5
6
7
8
TEST
COVERAGE
Iteration
Iteration
OVERALL
USER
5700
1800
9
5600
1600
8
5500
1400
7
1000
5200
800
5100
600
5000
6
5
$15
4
3
4900
400
4800
200
1
0
0
$10
2
$5
4700
MAINTAINABILITY
$20
Business Value
1200
5300
Number of Features
5400
$30
$25
Lines of Test Code
Lines of Code
DEVELOPMENT
1
2
3
4
5
Iteration
6
7
8
$1
2
3
4
5
6
7
8
PERFORMANCE
Iteration
A
Agile Testing
Practices
Image: http://artegami.com/wp-content/uploads/2007/08/toysrus_karate_kid.jpg
C
Low Value vs
High Value
Image: © The Curiosity Company / 20th Century Fox Television http://images2.fanpop.com/images/photos/3200000/fry-bender-futurama-3295254-1024-768.jpg
C
Good:
Basic
Automation
Image: http://seleniumhq.org/projects/ide/
C
Better:
ATDD / BDD
Plain text test
Step definition
Production code
Image: http://cukes.info/
C
Best:
Specification
by example
Image: http://www.concordion.org/
C
Quality
Maturity
Image: © Gracie Films / 20th Century Fox Television http://www.widewallpapers.net/mod/cartoons/simpsons/simpsons-1920x1200-021.jpg
A
Agile
Quality
Practices
A
Team
SelfAssessment
A
Quality
Requirements
A
Quality
Development
A
Quality
Testing
A
Quality
Team
Image: http://concordion.org/image/example/online-shop/AcceptanceTest.png
A
Your
Turn!
Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg
C A
4
 Test artifacts are treated with the same importance as code and are
properly maintained and refactored
 The relevant ____ility and security tests form part of the test strategy
3
 Non-functional requirements are agreed and included in the test
strategy
 Test planning is based on risk (technical complexity and business
impact)
 Test strategy is agreed and understood by the team and includes
2
targets (coverage, defects, …)
 Test strategy is documented and visible as a BVC used by the team
 An agreed approach to testing that is aligned to a definition of quality
1
-1
 Tests are considered a valuable asset that can be reused as features
are progressively implemented
 No agreed approach to testing
 Tests are not considered a valuable asset
Test
Planning
C A
ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF
RCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE O
F LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH
Empowering
Testing
Image: © Orion Pictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg
C
Collaboration:
I work with analysts and SMEs to
ensure that testable acceptance
criteria are created for all stories
Automation:
I work with developers to
automate tests that provide
business value and identify
system risks
Estimating:
I am involved in developing
estimates for projects at a story
level, for tools and infrastructure
and also for deployment/release
activities
Reporting:
I provide metrics that give
insight into project health and
system quality
Strategy & Planning:
I am involved in the project at all
stages to ensure that testing
provides the greatest value and
quality objectives are achieved
Agile:
I understand Agile project delivery
and the differences between testing
in the different phases of an phase
Qualifications & Training:
I have recognised qualifications in
testing and continually update and
maintain my skills
Tools & Techniques:
I use both manual and
automated techniques using the
preferred testing tools based on
the situation
Community & Teams:
I am part of a community of
testers that are embedded
within teams but share
common values
Recruitment & Development:
I am attracted to the organisation
because testing is a cool career path
that offers heaps of opportunities and a
way of continually developing my skills
Development:
I take an interest in
development practices and
monitor code quality metrics
Architecture:
I have an understanding of the system
architecture and can create tests that
verify individual components and the
system as a whole
Future tester
C A
Testing
Skills
Image: http://houndbound.com/dogblog/wp-content/uploads/2009/09/pug_graduate1.jpg
A
Architecture
Skills
Image: http://www.invermodels.co.uk/portfolios/sheriff.jpg
C
Technical
Skills
Image: http://www.logicalnetworking.net/wp-content/uploads/2010/02/TuxInSchoolComputerLab.jpg
A
Share
with
community
Image: http://www.linkline.org.uk/poster/images/Banner.png
C
Tools &
Automation
Image: Martha (Picasa) http://lh3.ggpht.com/_9kYHVyqm3zs/S70g1BiNILI/AAAAAAAADho/A4vuRNMTs50/IMG_7956.JPG
A
Get
Involved
Early
Image: http://eventstrategysolutions.com/wp-content/uploads/2010/10/early-bird.jpg
C
Queue
To
Join
Image: http://blogs.jcvi.org/wp-content/uploads/2009/11/emperor-queue.jpg
C
Wrap
Up
Image: © Chuck Lorre Productions http://24.media.tumblr.com/tumblr_ksvfroko3J1qa88nco1_500.jpg
C
Do you have a
testing skillset
(or are you
just doing
testing)?
C
Image: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Phot
Does
everybody
understand
their role in
quality?
Image: http://www.swotti.com/tmp/swotti/cacheDMLSBGFNZSBWZW9WBGU=/imgVILLAGE%20PEOPLE1.jpg
A
Are you
building
quality in
from the
start?
Image: © HiT Entertainment / Hot Animation http://1.bp.blogspot.com/-iLEyvBHn-W0/TglUWW5Or0I/AAAAAAAAAds/HXtPDGPLghA/s1600/bob+the+builder.jpg
A
Are you
measuring
testing and
assessing
quality?
Image: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423
C
Are you
hunting
down best
practices?
Image: © King Features Syndicate / Lee Falk http://www.comicwallpapers.co.uk/images/main/Miscellaneous/Other/1600900/PhantomGen_1010.jpg
A
Are you
testers
empowered?
Image: © DC Comics http://collider.com/wp-content/uploads/superman_alex_ross2.jpg
A
Don’t forget
to use
(or improve)
our quality
templates
C
Testing
is cool…
Image: © Miller-Milkis Productions http://imagetime.co.gp/key/henry%20winkler%20ron%20howard#
C
...but I love it
when quality
comes
together
Image: © Universal Television http://30.media.tumblr.com/tumblr_l6g4d631K31qzp4mwo1_r1_500.jpg
C
Craig Smith
http://www.suncorp.com.au
http://www.agileacademy.com.au
http://www.craigsmith.id.au
Questions
???
craig.smith@suncorp.com.au
@smithcdau
Dr. Adrian Smith
http://www.ennova.com.au
http://www.agileengineeringdesign.com
adrian.smith@ennova.com.au
@adrianlsmith
Suncorp is one of Australia and New Zealand's largest diversified financial services
providers, supplying banking, insurance and wealth management products to around
9 million customers through well-established and recognised brands such as AAMI,
Australian Pensioners Insurance Agency, Shannons, Vero, Asteron and Tyndall, as
well as Suncorp and GIO. Today, Suncorp is Australia's fifth largest bank and second
largest domestic general insurance group, with over 16,000 staff. Suncorp has
representation in 450 offices, branches and agencies throughout Australia and New
Zealand. (http://www.suncorp.com.au)
Ennova is a software development company that specialises in helping businesses
optimise their use of technology. We are passionate about what we do and have
embedded Agile and Lean thinking into our approach to everything. This enables us
to rapidly deliver high quality software solutions that provide long term business
value. Our Agile and Lean consulting services draw on an diverse experience base
that spans the engineering, manufacturing, construction and financial services
industries. Additionally, Ennova is active in the development of software products
and therefore has first hand practical experience in the application of Agile and Lean
methods.
(http://www.ennova.com.au)
The Agile Academy is the next wave in Agile learning and collaboration. Designed for
IT professionals, the Agile Academy is a knowledge hub that promotes Agile related
learning, knowledge sharing and capability development across the IT industry. We
offer an integrated curriculum of leading edge courses across the entire solution
development life cycle, covering all roles at varying levels.
(http://www.agileacademy.com.au)