Most Important Metrics for Performance Testing

Consider six of the most critical metrics to monitor and the value they provide:

Response Metrics

  • Average response time is the time between a client’s initial request and the final byte of a server’s response, which includes the delivery of HTML, images, CSS, JavaScript, and any other resources. It is the most precise standard method of determining the actual user experience. 
  • Peak response time is a roundtrip time measurement for a request/response cycle, but it focuses on the longest cycle rather than an average. Rapid response times assist in identifying potentially problematic anomalies. 
  • Error Rate quantifies the proportion of problematic requests to total requests. While it is not uncommon for some errors to occur during periods of high load, error rates should be kept to a minimum to optimize the user experience.

(more…)

Why You Should Consider the Testing Pyramid Structure?

The purpose of the test pyramid is to provide a structure for designing and executing tests. It is also the cornerstone of testing at Google.

The test pyramid has four layers – unit tests, service tests, integration tests, end-to-end or acceptance tests. By dividing up the different types of tests into these levels, it becomes easier to decide what type of testing needs to be done when building and maintaining software.

(more…)

Who are Test Architects? What are their Roles/Responsibilities?

Who are Test Architects?

A Test Architect is a highly skilled testing professional with years of experience and extensive knowledge in the field. They work at a senior level and have the responsibility of designing efficient solutions to address testing problems that present business-related challenges.

The responsibilities of a Test Architect are largely dependent on the organization they work for. In most cases, they design and configure test solutions in accordance to requirements. They also work closely with stakeholders to continuously improve their test processes and tools.

Test Architect is essentially a deep technical specialist focusing on design, implementation, use, and enablement of the testing function as well as the overall development function so they don’t do test management.

The responsibilities of a test architect may include:

  • Supporting the Test Manager with their strategic goals for the Test Team by providing technical support.
  • To assist in the design and delivery of the team’s overall testing methodology, have a wide understanding of testing methodologies, procedures, and techniques.
  • Have the capacity to monitor the testing function’s efficiency and make adjustments based on insights acquired through analysis at all stages of the SDLC/STLC.
  • Determine which tools and technologies can be deployed, keeping in mind what is already in use throughout the development function and the team’s skill set.
  • Develop the test automation framework, harnesses, and code libraries so that the team can utilize and improve them across many projects.
    Take charge of test infrastructure, including environments and software, and collaborate with teams like DevOps and Support on CI/CD and IT budgets.
  • To test and other business functions, provide technical know-how, documentation, and training.
    Keep up with new process, practice, and technology advances so that they may be adopted in-house and used to improve the testing solutions.

Free Course – Applitools – Next Gen Visual Testing Tool (Powered by AI)

Applitools is Next generation test automation platform powered by Visual AI.
This tool can help you in Increase quality, accelerate delivery and reduce cost with the world’s most intelligent test automation platform.

This tool is now one of the most demanding test tools in the parket. UntimateQA is offering a free course on applitools. All folks who are currently working on Selenium should undergo thos course.
Link to course: https://courses.ultimateqa.com/courses/applitools (website seems still under development, but you can enroll the course)

Training Content Part 1: Getting started
  • 00-Course overview
  • Course prerequisites
  • 03 Course syllabus
  • How to download and install Visual Studio
  • Create Applitools account and install Nuget packages
  • Why must we automate visual testing
  • Benefits of Applitools

Part 2: Baselines and Dashboard
  • What is a baseline in Applitools
  • 01-Code overview
  • 02-Baseline examples
  • 03 1st comparison
  • 04 Zooming, resizing and layers
  • 05 Toggling and Floating region

Part 3: Match Levels and Regions
  • 01 Exact match level
  • 02 Strict match level
  • 03 Content match level
  • 04 Layout match level
  • 05 Introduction to Ignore regions
  • 06 Ignore regions in code
  • 07 Ignoring multiple regions
  • 08 Floating region
  • 09 Strict region
  • 10 Content region
  • 11 Layout region

Part 4: Test Manager
  • 01 Test Manager UI
  • 02 Batches
  • 03 Full page screenshots with CSS stitch
  • 04 CSS stitching vs standard scroll
  • 04 Bugs and test steps in UI
  • 05 Test steps code
  • 07 Fluent API
  • 08 How programatic regions look
  • 09 Conclusions
Link to course: https://courses.ultimateqa.com/courses/applitools (website seems still under development, but you can enroll the course)