TestOps

Source: Wikipedia, the free encyclopedia.

TestOps (or test operations) refers to the discipline of managing the operational aspects of testing within the

software delivery lifecycle
.

quality engineers, manual testers, product owners, and more are involved in the quality process.[2] As more people have become involved in the testing process and testing projects have grown, so too has the need to advance the discipline of software testing management and to manage the software quality processes, programmers, people, systems, and tests.[3]

TestOps helps teams scale their teams, tests, and quality processes in and effectively.

Elements of test operations (TestOps)

TestOps involves several important disciplines that can be broken down into:

test automation tools, the timing of the testing, the ownership of the testing at different phases, and the design
and outputs of the tests.

Management —

test environment, and the tests themselves. Tests follow a lifecycle pattern and must be managed whether they are in stages such as draft, active, or quarantine.[6]
TestOps helps ensure that the testing processes are efficient and scalable.

Control — As teams and tests grow in number and diversity, they naturally increase complexity. Change control processes such as

merges, collaboration tools, and ownership labeling can help ensure that changes to tests are properly approved.[7]

test coverage mapping, and risk coverage analysis.[9][10]

TestOps Features

DevOps integration — TestOps exists to ensure that the product development pipeline has all the testing frameworks and tools needed. It is common for QA engineers to rely on the pipelines that IT puts together without much input. TestOps changes this by owning test activities related to DevOps, allowing QA engineers and developers to have full ownership and visibility of the development pipeline, so they can tailor it to meet their needs.

Cloud integration — Integrating tests and test runs with cloud providers

Enhanced test planning — Automation is not effective if the entire codebase has to get tested every time a line of code is changed. TestOps provides a centralized platform that makes it easier for testers and developers to plan what tests to write, as well as identify what tests to run and when.

Test lifecycle management — Automated tests follow a lifecycle including creation, evaluation, active, and quarantine or removal. The status of the test should impact how it is treated in build automation systems like CI/CD.

Test

pull requests
in code.

Real-time

dashboards
— Real-time results and status help the test teams understand the state of software releases and the work that needs to be done to create, approve, or run more tests.

TestOps vs. DevOps [11]

DevOps is a broader, more inclusive concept that includes software feature planning, code development, testing, deployment, configuration, monitoring, and feedback. It was an attempt to integrate some of the disconnected toolchains. Testing is included in the broader DevOps methodology.

TestOps[12] is not simply providing additional emphasis on testing. It is focused on operational aspects of testing that are necessary to ensure that testing, whether performed in development, production, or in its own testing phase, is well planned, managed, controlled, and provides insights to enable continuous improvement.

The siloed working mindset is aimed to be removed from activities such as continuous delivery, software testing (manual and automated testing), environment setups, infrastructure and log management, and built-in security enforcement.

References

  1. ^ https://www.devopsonline.co.uk/devops-and-the-emergence-of-testops/
  2. ^ "Who Should Test Software?". Istqb Exams at Home Worldwide - Astqb - Istqb in the U.S.
  3. ^ https://www.professionalqa.com/test-management
  4. ^ https://www.diva-portal.org/smash/get/diva2:1117878/FULLTEXT02 [bare URL PDF]
  5. ^ "What is UX Research?".
  6. ^ "What is Software Testing Life Cycle (STLC)?".
  7. ^ https://iaonline.theiia.org/change-control-audits-a-must-for-critical-system-functionality
  8. ISBN 978-3-319-31543-0
    , retrieved 2022-11-04
  9. ^ "11 Test Automation Metrics and their Pros & Cons".
  10. ^ https://www.researchgate.net/profile/Mohamed_Mourad_Lafifi/post/What_test_should_I_do_to_measure_effectiveness_of_an_Automation_Project_that_we_implemented/attachment/59d63c5179197b80779994cb/AS%3A414847972986881%401475918872521/download/Useful+Automated+SOftware+Testing+Metrics.pdf [bare URL PDF]
  11. ^ "DevOps and the emergence of TestOps!". April 2019.
  12. ^ "What is TestOps (How Microsoft Does it)". 15 July 2021.
Retrieved from "https://en.wikipedia.org/w/index.php?title=TestOps&oldid=1224605914"