Agenda
Explore the agenda for Quality Sense Conf 2022
FRIDAY
All
Benedetti
Idea Vilariño
All
Benedetti
Idea Vilariño
URUGUAY TIME - GMT-3
Check-In
Growing test managers
Keynote
Benedetti
The skills necessary to be an effective test manager are not the same as those needed to be an effective tester. Supervising and coordinating testers and testing requires learning new testing skills, along with the significant growth necessary to be worthy of the responsibility to manage others.
How do you get ready to be a Test Manager? How do you identify and nurture a future Test Manager? What are the skills and traits you could look for? What red flags might you be watching for? How will you prepare them for management, and help them succeed when they get there? What should a line manager work on to prepare for the next level?
In this talk, I will pose some of these questions and offer some ideas, propose a body of skills needed for test managers in many contexts, and share experiences in mentoring current and future leaders. Hopefully, this will be useful for aspiring Test Managers, current Test Managers, and the leaders trying to grow them.
The value of testing
Panel
Benedetti
The Sound of Code, Instrumented with OpenTelemetry
Benedetti
We have experience over the last 12 years lot of changes on the way we are building and managing our software stack. We moved from Waterfall to Agile, and now DevOps. To Make sure we provide a reliable system to our users we also had to implement SRE methodology on the top of our DevOps initiatives. In reality DevOps and SRE rely on one fundamental concepts: Observability.
To be efficient in our Continuous testing, continuous deployment approach and on the way we handle production outage, we need to have the right level of observability to understand properly how: 1) Our users are interacting with our application, 2) Our system behaves with significant traffic, 3) Our infrastructure has been utilize by our application, …etc.
To help us in our journey, OpenTelemetry has provided a standard on the way we are able to produce and collect measurements in our environments. Like any other technology transformation, OpenTelemetry adoption typically starts with small “pet projects” where we usually try to utilize manual or automatic instrumentation. But Opentelemetry is not only about producing traces, it covers the ability to generate metrics and logs from our applications. But like any new emerging framework we tend to wait to get a stable implementation before utilizing it in our production environment. We all understand the value of having traces generated out of our application, but the journey could seem difficult and time consuming. How can we utilize properly the instruments of Opentelemtry to make our code sound beautiful?
During this presentation we will explain: 1) The various components of OpenTelemetry, 2) The various core Objects required to instrument your code, 3) Best practices related to instrumentation, 4) The latest news related to OpenTelemetry.
Testing the change of an era, without borders
Idea Vilariño
Living without borders leads us more and more to apply technology in all aspects of human transformation, now everything is different, more informed, more connected, faster... So many options! And testing?
Who is at the center of this change of strategy, according to our perspective:
the technology, the tester, the customer? Philosophical questions to tell the
truth, even where existential doubts such as: Where are we going? What are we
facing? Who has the truth? For as Sophie's World quotes: "Our very existence
helps to decide how we perceive things in space. If something is inessential to
me, I don't see it".
We are going on a journey through Sophia's World and software testing in a
digital age.
Coffee break
Quality Engineering, Reconciling faster development with user expectations
Benedetti
Change surrounds us. DevOps, agile and digital transformations are evolving software production — release frequency is accelerating, more is being automated, and customers have increasingly higher expectations. Meanwhile, software testing continues to be a challenge — 43% of software developers say it is their biggest pain point during development.
In this session, you'll learn about the shift from QA to Quality Engineering, how software teams are moving beyond functional testing, and how low-code solutions are accelerating the adoption of a wider perspective on quality through focusing on customer experience to improve business outcomes.
Performance testing
Panel
Idea Vilariño
Using test automation to enhance Observability
Benedetti
Observability and Testing have a long shared history, mostly with Observability guiding testing. But testing can also enhance Observability and drive a deeper understanding of the application. This talk will explore and demonstrate an approach to using test automation to enhance Observability.
Testing 3.0
Idea Vilariño
Testing strategies and the role of the tester have been changing over time, influenced, among other things, by technological and methodological advances. From "waterfall" processes and mainframe applications, through agile methods, desktop applications, to web and mobile applications and the rise of DevOps.
The challenges facing the software industry today have created significant challenges and opportunities for those working on testing and quality issues in general. In this talk we will see some of those opportunities and how to prepare ourselves to take advantage of them.
Announcements
Lunch break
Performance testing measure and metrics
Benedetti
This session will cover the expansive understanding of performance testing metrics and how they can be used to drive quality initiatives upstream and downstream in the application lifecycle.
Too often today we see that performance measurements (CPU, DISK, MEMORY, NETWORK) are left out of early testing automation and pass/fail criteria, when it would be absolutely more cost-effective if we could find and fix those bottlenecks earlier. Testers who are new to performance testing success criteria will learn new ways to correlate and analyze performance measurements and extrapolate the results in a reliable and repeatable way. Testers who are interested in taking their bug-finding skills to a whole new level will be delighted to expand into performance-related testing investigation, exploration and risk analysis.
The future of work
Panel
Idea Vilariño
JMeter Scripting:
The missing piece
Benedetti
I will share with you in this presentation a new way of scripting JMeter performance tests faster and easier to maintain and integrate with existing tools.
I will start with a brief review of JMeter main benefits and some of the
nuisances you may face with it that are solved by other tools. After that I will
do a live demo of JMeter DSL, a new alternative that significantly improves
JMeter's scripting and execution experience. The talk will end with a review of
main benefits of this approach and some time to exchange some Q&A.
Get on board and change the way you do performance testing with JMeter!
Leadership
Panel
Idea Vilariño
Harnessing the power of Chaos Engineering!
Benedetti
2020 was a bit chaotic, as we all know. For some retailers, it meant speeding up
digital transformation. We all knew it was going to be a bumpy road but were we
ready? Big spoiler: we were not ready for a lockdown scenario. We knew we were going
to fail but we needed to measure how fast we could recover. How did we do?
Monitoring system to detect anomalies.
Mix of web apps and Kubernetes with refactors ongoing
Continuous performance testing in a pre-production environment
Chaos Testing in production
What did we want to test? Scalability and resilience, load spikes like Black
Friday, Christmas Campaigns, Flash Offers, and more as well as system failures
such as pod failure and network problems. In this talk, we will explain how we
implemented Chaos Testing in our production environment in Azure with Chaos
Studio. We will be showing different examples like availability in different
regions, database access problems, or Kubernetes different chaos scenarios.
There will be a bit of a demo with minikube and chaos mesh so anyone in the
audience can get an idea on how to start chaos testing on a daily basis.
You don't need much testing, just change the way of working
Idea Vilariño
The first reaction of teams when a lot of defects start to emerge is to believe that more testing is needed. In this talk I will show you that for some situations you don't need to do much testing, just change the way you work, make decisions; and if you can't make changes to the process then you will need to do a lot of testing and a lot more rework than expected.
Coffee break
The twists of performance testing, details that are no longer done like before
Benedetti
Performance testing is a practice that throughout history has been underappreciated, misunderstood or simply ignored.
On top of that, some of the practices that were considered normal, are no longer the most recommended and may even be affecting your applications, development/QA teams, and even the organization in general.
In this talk, Leandro will share with us some elements that we thought were how quality in performance should be done, but that we should change immediately. Practices that we inherited from the past such as ways to automate, ways in which we measure performance, the concept of virtual users, types of tests we do, and much more!
Test automation
Panel
Idea Vilariño
Where are we heading?
Keynote
Benedetti
It’s not looking very good right now...but there is hope
The testing profession, and software development in general, appear to be moving
away from good testing. Replacing critical-thinking, creativity, reasoning, and
customer representation with fairly simplistic automated checks. This will likely
lead to some pretty major disasters. It is not too late to change the direction we
are heading, but it will likely only happen after some catastrophic failures.
In this talk, Paul will talk about some of the directions and trends he has seen
in his 27 year career; where the industry is now and where it appears to be
heading.The good news is that there appears to be a multi-year cycle of good
testing being demanded by companies. The bad news is that we appear to be
approaching the farthest distance he has seen from good testing.
There have been many trends in the past, some good, most bad. The bad ones
appear to have been primarily caused by companies selling testing tools and
services. The good ones typically by companies that are looking to make positive
changes. Paul will cover some of the historical trends that he has been involved
with and how the current trends compare to old trends.
Automation is good and can be great. It is needed for CI/CD and the ability to
move quickly with software releases but it can go too far. Deceitful marketing
from testing industry vendors have been fooling naive decision makers for
decades. It’s time that we had more voices standing up for better
testing.
Paul will talk discuss some fairly simple changes to the current drive to CI/CD
and the unrelenting push to “automate everything” would allow testing to become
much more effective and impactful without going back to having humans do all the
testing.