CTAL-TAE — Test Automation Engineering (v2.0) glossary
273 terms the exam expects you to know, defined in plain language.
#
- 5 Whys Technique(5 whys)
- A root cause analysis technique that iteratively asks 'why' to drill down to the fundamental cause of a problem.
A
- API Versioning(api versioning)
- A practice of assigning version numbers to APIs and corresponding tests to handle changes gracefully.
- Abstraction Layers(abstraction layers)
- Layers that separate test case logic, business process steps, and technical implementation to reduce fragility.
- Abstraction Layers in Test Automation(abstraction layers)
- Layers that decouple reusable components from the system under test to reduce tight coupling.
- Action Keyword(keyword)
- A reusable function or method that performs a specific action on the application under test, mapped to a keyword in test cases.
- Adaptation Layer(adaptation layer)
- A layer that bridges test scripts and the system under test using page objects, API wrappers, or device drivers.
- Agile and DevOps Automation Requirement(agile devops automation requirement)
- Highly maintainable frameworks supporting rapid iteration and continuous testing to cope with changing requirements.
- Alignment of Metrics with Automation Objectives(alignment with automation objectives)
- The principle that metrics should directly support the goals of the test automation project.
- Automated Analysis Scripts(automated analysis scripts, log parsing scripts)
- Scripts that parse logs and apply statistical methods to highlight anomalies in failure data for automated root cause analysis.
- Automation Coverage(automation coverage)
- The percentage of test cases automated in a test automation solution.
- Automation Failure Categories(root cause categories)
- Common root causes including environment issues, test script bugs, test data problems, and flakiness.
- Automation Feasibility(feasibility)
- Assessment of whether automation is practical based on SUT, environment, and team skills.
C
- CI/CD Pipeline Integration(ci/cd pipeline integration, integration with ci/cd, ci/cd pipeline, ci/cd integration)
- The integration of the test automation solution with the continuous integration and delivery pipeline and reporting mechanisms.
- CI/CD Pipeline Integration for Test Automation(integration with ci/cd pipelines, ci/cd pipeline integration for test automation)
- Integration of configuration management practices into CI/CD pipelines to automatically retrieve correct artifact versions for testing.
- CI/CD pipeline integration for TAA(ci/cd integration, pipeline integration)
- The incorporation of the test automation solution into a continuous integration and continuous delivery pipeline.
- Code Review for Test Automation(code reviews)
- The systematic examination of test automation code by peers to identify defects and improve code quality.
- Code Reviews for Test Scripts(code reviews for test scripts)
- A quality assurance practice where test code is peer-reviewed to catch defects early, frequently omitted in automation.
- Commercial Tool(commercial tools)
- A software tool requiring a license purchase, often including vendor support, documentation, and regular updates.
- Common Mistake in Test Automation Adaptation(automation adaptation mistake)
- Applying the same automation approach across all SDLC models without adaptation, e.g., heavyweight frameworks in Agile.
- Community Support(community forums, community-dependent support)
- Support provided through user forums, documentation, and third-party consultants, typical for open-source tools.
- Compatibility Verification in TAA(verifying compatibility in the taa)
- Process of checking that each layer and component of the TAA aligns with the SUT's technology stack.
- Complementarity of Automation and Manual Testing(automation complements manual testing, complementarity, complementarity of automation and manual testing)
- The principle that automation complements, rather than replaces, manual testing, being most effective for regression and repetitive tests.
- Component Testing of Automation Modules(module testing)
- Testing individual automation components in isolation to verify their correctness and functionality.
- Configuration Files(configuration files)
- Files used to avoid hard-coding values in reusable components, allowing behavior to vary without code changes.
- Configuration Item(configuration item)
- Component of a system that is subject to configuration management, such as test scripts or data files.
- Configuration Management for Test Automation(configuration management, test automation configuration management, configuration management of test automation artifacts)
- Discipline of versioning, controlling changes, and auditing all test automation artifacts to maintain integrity and repeatability.
- Configuration and Data Layer(configuration and data layer)
- A layer that handles environment settings, test data, and credentials.
- Context factors for TAA selection(context factors, contextual factors)
- Factors such as SUT architecture, development methodology, team skills, and automation objectives that influence the choice of a test automation architecture.
- Context-Driven Testing Principle(x is better than y)
- A principle in software testing stating that best practices depend on the context, so no universal 'X is better than Y' applies.
- Contextual Reporting(context, include context)
- Including environment changes or known issues to prevent misinterpretation of test results.
- Continuous Assessment(continuous assessment)
- The practice of evaluating the test automation solution early and frequently throughout the lifecycle.
- Continuous Assessment of Test Automation(continuous assessment)
- The practice of evaluating the test automation solution throughout the development lifecycle rather than only at the end.
- Continuous Improvement Workflow(continuous improvement embedded in the team's regular workflow)
- The practice of embedding improvement activities like retrospectives and health checks into the team's regular workflow.
- Continuous Improvement of Test Automation(continuous improvement of test automation)
- The ongoing effort to enhance test automation processes and outcomes.
- Continuous Maintenance of Test Automation(test automation as an ongoing development activity, continuous maintenance)
- The practice of treating automation scripts as ongoing development work requiring regular refactoring and updates.
- Continuous improvement process for TAS(continuous improvement process)
- Regular evaluation of a TAS for effectiveness and efficiency, as per ISTQB CTAL-TAE syllabus.
- Core Libraries(core libraries)
- Encapsulate common functionality used by multiple test cases, such as database connections, API wrappers, and configuration readers.
- Core Libraries (Test Automation)(core libraries)
- A centralized set of common utilities and functions used by multiple test cases to avoid duplication.
- Correlation Analysis(correlation analysis)
- A technique that reveals relationships between failures and specific variables like test data values or execution order.
- Custom Test Harness(custom test harnesses, custom test harness)
- A reusable framework that provides a consistent environment for executing test scripts.
D
- Dashboard Visualization(dashboards)
- A real-time graphical display of key test automation metrics for quick stakeholder insight.
- Data Collection in Test Automation(data collection)
- The process of gathering information from test execution, such as pass/fail rates and execution times.
- Data Dependency(data dependencies)
- A relationship between test data sets that can cause test interference if not properly isolated.
- Data Driver(data driver component, data driver)
- A component that reads and parses test data from external sources and supplies it to the test script.
- Data Management Complexity(data management complexity)
- The added overhead of managing external test data and handling format issues.
- Data Provider Component(data provider)
- A framework component that reads and parses external data sources and passes data to the test script.
- Data Source(data source, data sources)
- An external repository (e.g., Excel, XML, JSON, database) that stores test data used by data-driven test scripts.
- Data Sources(data sources)
- Storage locations for test data used in data-driven scripts, such as Excel, JSON, or databases.
- Data Sources for Test Automation
- Sources such as test execution logs, CI/CD pipelines, and defect tracking systems.
- Data dependency management
- The practice of isolating test data to avoid interference and false failures.
- Data-Driven Approach(data-driven approach, data-driven design)
- A test design pattern where test data is externalized from scripts to support multiple scenarios.
- Data-Driven Framework(data-driven testing, data-driven framework)
- A test automation approach that separates test data from scripts, allowing the same script to run with multiple data sets.
- Data-Driven Testing Architecture(data-driven testing architecture)
- The structural design of a test automation framework that separates test logic from test data using data sources, data drivers, and parameterized scripts.
- Data-driven testing
- A testing approach that uses external data sources like Excel or JSON to drive test execution.
- Defect Density(defect density)
- A metric measuring the number of defects per unit size of the system.
- Defect Detection Rate(defect detection rate)
- A metric that measures how many defects the automated tests find.
- Dependency Injection(dependency injection)
- A technique to vary behavior without changing code by injecting dependencies from external configuration.
- Dependency Injection in Test Automation(dependency injection)
- A technique to vary component behavior without changing code by injecting dependencies via configuration.
- Design Patterns for Test Automation(factory, builder, strategy, design patterns in test automation, design patterns)
- Patterns like Factory, Builder, or Strategy used to make test components flexible and maintainable.
- Design for Testability(testability)
- The degree to which a system's design facilitates automated testing, affecting cost and effort.
- Documentation of Flaky Tests(documenting flaky tests)
- The practice of recording flaky tests and their resolutions to build a knowledge base.
- Drivers, stubs, and simulators(drivers, stubs, simulators)
- Components within the test adaptation layer that communicate with the system under test.
- Dynamic Analysis(dynamic analysis)
- A code analysis technique that examines automation code during execution to detect runtime errors, performance bottlenecks, and memory issues.
E
- Environment Configuration Drift(configuration drift)
- The gradual change in environment configurations over time, leading to potential inconsistencies and failures.
- Environment Instability(environment instability)
- Flakiness cause from network latency, resource contention, or varying system load.
- Environment Stability(environment stability)
- A testing principle ensuring reliable and repeatable test execution through consistent environment conditions.
- Explicit Wait(explicit waits)
- Synchronization mechanism using WebDriverWait instead of fixed sleeps to handle timing issues in tests.
- Explicit Waits(explicit waits)
- A resolution strategy that introduces fixed or conditional delays to synchronize test actions.
- External Data Source(external data source, data source)
- A storage location for test data such as CSV files, Excel spreadsheets, JSON, XML, or databases.
- Externalized Configuration(externalized configuration, externalize settings)
- Approach of using configuration files or environment variables to externalize settings, avoiding hard-coded values in test scripts.
F
- Failure Clustering(failure clustering)
- A technique that groups test failures by similar error messages, components, or environmental conditions to identify common causes.
- Failure Data Granularity(data granularity, failure data detail)
- Requirement that failure data must be detailed enough (e.g., error messages, timestamps) for effective root cause analysis beyond pass/fail counts.
- False Positive Risk(false positive)
- The possibility of incorrect test results due to stale or incorrect expected data in the data source.
- False Positives and Negatives in Automation(false positives, false negatives)
- Erroneous test results where automation reports a defect when none exists (false positive) or fails to detect a defect (false negative).
- False test result risk(false results)
- The possibility that an incompatible tool produces unreliable test outcomes, leading to incorrect decisions.
- Feature Set(feature sets)
- The collection of capabilities and functionalities provided by a tool, often richer in commercial tools.
- Fishbone Diagram(fishbone diagrams)
- A root cause analysis diagram that visually categorizes potential causes of a problem into major categories.
- Flakiness(flakiness, test flakiness)
- A metric indicating the inconsistency of test results across runs.
- Flaky Test(flaky test, flaky tests)
- A test that yields inconsistent pass/fail results without code changes, often due to environment issues.
- Flaky Test vs Genuine Defect(flaky test vs real defect)
- Distinguishing between non-deterministic test behavior and real system defects for appropriate remediation.
- Flexibility
- The ability to customize and extend a tool through access to its source code, typically greater in open-source tools.
- Fluent Page Object Pattern
- A UI automation pattern that uses method chaining to create more expressive test scripts.
- Framework Selection(choosing a framework)
- The process of choosing an appropriate test automation framework based on project requirements, team skill, and complexity.
G
- GUI vs API Automation(interface types)
- Comparison where API automation is faster and more reliable than brittle GUI automation.
- Generic TAA (gTAA)(gtaa)
- A conceptual reference architecture for test automation solutions with three main layers.
- Governance for Core Libraries(governance process, governance process for libraries)
- A process for assigning ownership, reviewing changes, and communicating updates to maintain library quality.
- gTAA(generic test automation architecture)
- A layered architecture that decouples test logic from the system under test to promote reuse and maintainability.
- gTAA (Generic Test Automation Architecture)(generic test automation architecture, gtaa, generic test automation architecture (gtaa))
- A layered structure defined by ISTQB for test automation, adapted for API testing to ensure separation of concerns and reusability.
H
- Hybrid Framework
- A test automation approach that combines elements of data-driven and keyword-driven frameworks, often with modular design.
I
- ISTQB CTAL-TAE Failure Data Fields(ctal-tae failure data fields, istqb failure data requirements)
- Specific data elements required by the ISTQB syllabus for failure capture: test case identifier, exact error message, environment details, and timestamp.
- ISTQB Glossary
- An official compilation of standardized terms and definitions used in ISTQB certifications.
- Implementation and Deployment Strategies for Test Automation(implementation and deployment strategies for test automation)
- Approaches for rolling out test automation within a project or organization.
- Improper Test Isolation(improper test isolation)
- Flakiness cause when tests share state such as database records or files without cleanup.
- Inadequate Error Handling(inadequate error handling)
- A risk where test scripts fail unpredictably because error handling is insufficient, reducing trust in automation.
- Incompatible tool risk(automation risk from incompatibility)
- The potential for increased maintenance, false test results, and abandonment of automation due to mismatch between tool and system under test.
- Independent Verification of Reusable Components(verified independently, independent verification, reusable component verification, independent verification of reusable components, component-level verification)
- The practice of verifying reusable components independently before integrating them into test scripts.
- Infrastructure as Code(iac, infrastructure as code)
- Practice of managing computing resources through machine-readable configuration files to maintain environment consistency.
- Insufficient Abstraction(insufficient abstraction)
- A risk where hard-coded test data and locators increase maintenance effort due to lack of abstraction.
- Integration testing of test automation(integration testing of the full test automation solution)
- Complementary testing that validates the full test automation solution alongside reusable components.
K
- K-Levels(k2, k3, k4)
- Cognitive levels (K2, K3, K4) used to classify learning objectives and exam question difficulty in ISTQB exams.
- Keyword Library(keyword library)
- A collection of reusable keyword implementations that encapsulate actions on the application under test.
- Keyword Naming Convention(keyword naming convention)
- A consistent naming scheme for keywords to ensure clarity, reusability, and maintainability in keyword-driven testing.
- Keyword Sequence(keyword sequence)
- A test case written as an ordered sequence of action keywords with associated parameters.
- Keyword-Driven Design(keyword-driven design)
- An approach that externalizes action keywords from the script, allowing non-technical stakeholders to write test cases.
- Keyword-Driven Framework(keyword-driven approach, keyword-driven test automation framework, keyword-driven framework)
- A test automation approach that uses action words in tables to decouple test logic from automation code.
- Keyword-Driven Testing(keyword-driven testing, keyword-driven frameworks)
- A scripting technique that uses data files to contain test data, expected results, and keywords related to the application under test.
L
- Lack of Modularity(lack of modularity)
- A risk where changes in one area require updates across many scripts due to non-modular design.
- Learning Curve(steep learning curve)
- The difficulty and time required to become proficient in using a tool, often steeper for open-source tools.
- Linear (Scripted) Framework(record-and-playback approach, linear test automation framework, linear (scripted) framework, scripted framework)
- A test automation approach where test scripts execute sequentially without reuse, simple but high maintenance.
- Logging component
- A component within the test execution layer that logs test activities.
- Long-Term Viability(long-term viability)
- The risk of a tool being discontinued or abandoned, affecting both open-source projects and commercial products.
M
- Maintainability of TAA(maintainability, long-term maintenance)
- The ability of a test automation architecture to be easily maintained and adapted over the long term.
- Maintenance Effort(maintenance effort)
- The time spent updating test scripts per release as a metric of maintainability.
- Maintenance Overhead of Test Automation(maintenance overhead, ongoing maintenance)
- The ongoing effort required to update and fix test scripts and frameworks as the system under test evolves.
- Metrics-Driven Improvement(metrics-driven improvement)
- An approach that uses objective metrics like coverage and pass rates to guide and measure test automation improvements.
- Modular Design in Test Automation(modularity)
- A design approach that breaks automation code into independent, interchangeable modules to enhance maintainability.
- Modular Framework
- A test automation approach that breaks test scripts into independent, reusable modules for specific functions.
- Modular and replaceable components(modular, replaceable)
- Design principle where TAA components are designed to be interchangeable to adapt to changes.
- Modular design of TAA(modular design, reusability)
- A design principle that promotes reusability of components across test cases and projects within a test automation architecture.
- Modular test automation framework(modular frameworks, modular framework)
- Test automation approach using independent reusable modules for improved maintainability.
N
- Non-Functional Requirements Automation(non-functional requirements automation, performance automation, security automation)
- Automation of performance, security, and other non-functional tests requiring specialized tools.
O
- Open-Source Tool(open-source tools)
- A software tool with publicly available source code, typically free to use but may incur costs for training and support.
- Order Dependency(order dependencies)
- Flakiness cause when tests assume a specific execution order or leave side effects for subsequent tests.
P
- Page Object Model(pom, page object frameworks)
- A design pattern that represents each web page as a class, encapsulating UI elements and actions to improve test maintenance.
- Page Object Model (POM)(pom, page object model)
- A design pattern for web test automation that isolates UI changes to a single layer, promoting maintainability and reusability.
- Page Object Pattern(page object, page object patterns, page objects, page object pattern)
- A design pattern where a class represents a screen or component, abstracting UI interactions into methods.
- Parameterization of Keywords(parameterization)
- The practice of using parameters with keywords to avoid duplication and enhance flexibility in test cases.
- Pass/Fail Rate(pass/fail rates)
- A metric indicating the proportion of tests that passed or failed.
- Pass/Fail Trend Analysis(pass/fail trends)
- Tracking pass and fail rates over time to identify test stability and regression patterns.
- Periodic Trend Report(periodic reports)
- A scheduled report presenting test automation metrics over time for trend analysis.
- Preparing for Test Automation
- A CTAL-TAE exam chapter covering assessment of SUT, technical considerations, infrastructure, and tool evaluation.
- Proof-of-Concept(poc, proof of concept on actual sut, poc on actual sut, proof of concept on the actual sut)
- A trial evaluation of an automation tool on the actual SUT to validate compatibility and performance.
- Proof-of-concept validation(proof-of-concept testing)
- A preliminary test to verify tool compatibility with representative features of the system under test before full adoption.
Q
- Qualitative Criteria for Test Scripts(qualitative criteria, script readability, modularity, reusability)
- Attributes such as readability, modularity, and reusability used to evaluate test script quality.
R
- RCA Process for Automation Failures(rca process steps)
- A structured approach including data collection, failure classification, analysis, corrective actions, and verification.
- Re-verification of Compatibility(re-verify compatibility)
- Need to re-check technology stack compatibility after the SUT's stack evolves, such as after a framework upgrade.
- Record-and-Playback Over-Reliance(over-reliance on record-and-playback)
- A risk where test scripts are generated by recording user actions, leading to brittle and hard-to-maintain scripts.
- Refactoring Test Automation Code(refactoring)
- The process of restructuring existing automation code without changing its external behavior to improve readability and reduce duplication.
- Reliable Test Automation Execution(reliable test automation execution)
- A principle ensuring that automated tests run consistently and produce dependable outcomes.
- Report Frequency Tailoring(frequency of reports, tailor the frequency)
- Adjusting how often reports are delivered based on stakeholder roles (daily, weekly).
- Reporting and Metrics for Test Automation(reporting and metrics for test automation)
- Methods and measures used to report on test automation results and effectiveness.
- Request-Response Model(request-response model)
- A test pattern where each test sends a request to an API and validates the response.
- Result reporter
- A component within the test execution layer that reports test results.
- Retry Mechanism for Flaky Tests(retry mechanisms)
- A technique that automatically re-runs a failed test to reduce false failures and improve reliability of the test suite.
- Return on Investment (ROI) for Test Automation(roi, return on investment)
- A comparison of automation costs versus manual testing costs and benefits to assess financial justification.
- Return on Investment for Test Automation(roi)
- A financial metric comparing automation costs to benefits gained, such as time saved.
- Return on Investment of Test Automation(roi, return on investment, return on investment of test automation, roi of test automation)
- A business consideration evaluating the value gained from automation relative to the costs of development and maintenance.
- Reusable Components(page objects, test data factories, test harnesses)
- Design elements like page objects and test data factories with single responsibility and clear interfaces for reuse.
- Reusable Components (Test Automation)(reusable components)
- Design elements like page objects, test data factories, and custom test harnesses with single responsibility and clear interfaces.
- Reusable component verification(verify reusable components in isolation)
- Testing isolated reusable components to catch defects early in test automation.
- Risk-Based Automation Decisions
- Automation decisions driven by risk, return on investment, and technical feasibility rather than automating all levels equally.
- Risks of Test Automation(risks of test automation, own risks)
- Introduced risks such as false positives, false negatives, and maintenance overhead that must be managed.
- Robust Locators(robust locators)
- Element locators that are resilient to UI changes, such as using IDs over XPath.
- Root Cause Analysis(root cause analysis, failure root cause analysis, rca, root cause analysis for automation failures, root cause analysis for test automation)
- A systematic process of identifying the underlying causes of test failures to enable corrective actions and continuous improvement.
- Root Cause Analysis for Flaky Tests(root cause analysis, root cause analysis (rca) for flaky tests)
- Systematic investigation focusing on timing, data, environment, order dependencies, and isolation issues.
- Root Cause Analysis of Automation Failures(rca for automation failures)
- A systematic process to identify underlying causes of automation failures to improve test automation reliability.
S
- SUT vs TAS Defect Differentiation(distinguishing sut defects and tas issues, sut defect vs tas issue, sut defects vs tas issues, differentiating sut and tas problems)
- The process of distinguishing genuine system under test defects from issues in the test automation itself.
- Screenplay Pattern(journey pattern)
- An alternative UI automation pattern that models user interactions as tasks performed by actors to improve readability and reusability.
- Script Duplication(script duplication)
- A risk where repeated test code increases effort when the application under test changes.
- Script Maintainability(script maintainability, maintainability)
- A qualitative criterion for test scripts including readability, modularity, and reusability.
- Script Stability(script stability)
- A metric indicating the reliability of test scripts, often measured by flaky test rate.
- Security Testing in API Automation(security testing)
- The inclusion of authentication and authorization checks in the API test automation architecture.
- Semantic Versioning(semantic versioning, semver)
- A versioning scheme to track changes and ensure backward compatibility of reusable components.
- Semantic Versioning for Test Libraries(semantic versioning)
- A versioning scheme that tracks changes and ensures backward compatibility for core libraries.
- Separation of Concerns(separation of concerns)
- A design principle that separates test logic, test data, and automation infrastructure into distinct layers.
- Separation of Concerns in Test Automation(separation of concerns)
- The principle of separating test logic, test data, and underlying automation library to improve modularity and maintainability.
- Sequential Model Automation Advantage and Drawback(sequential automation pros cons)
- Stable automated suites with lower maintenance but delayed defect detection due to late feedback cycles.
- Service Object Model(service object model)
- A design pattern that encapsulates API endpoints into reusable classes for test automation.
- Severity vs. Priority(severity vs. priority, severity and priority)
- A defect management distinction: severity measures impact, priority measures urgency.
- Single Responsibility Principle(srp)
- A software engineering principle ensuring each component has one clear purpose, improving maintainability and reusability.
- Single Responsibility Principle in Test Components(single responsibility)
- A design principle ensuring each component has one clear purpose and clear interfaces.
- Smoke Test(health check)
- A set of basic tests or health checks to validate that the test environment is functioning correctly.
- Software Engineering Principles in Test Automation(software engineering principles, sound software engineering principles)
- Sound software engineering methods applied to designing, developing, and maintaining test automation scripts and frameworks.
- Stable Test Environment(stable environment, stable environments)
- A controlled and consistent execution environment that minimizes external variability.
- Stakeholder Communication
- The practice of tailoring test reports and dashboards to different audiences.
- Stakeholder Needs Analysis(stakeholder needs)
- Identifying the varying information requirements of stakeholders to customize report content and detail.
- Stakeholder communication in decommissioning(communicate the decommissioning plan)
- Informing testers, developers, and operations about the decommissioning plan to avoid surprises.
- Stakeholder-Tailored Reporting(stakeholder-tailored reporting)
- The practice of customizing reports based on the audience's technical level and information needs.
- Static Analysis(static analysis, code analysis)
- A code review technique that evaluates automation code without execution to identify defects, coding standard violations, and maintainability issues.
- Static Analysis for Test Scripts(static analysis for test scripts, static analysis for test automation, static analysis tools)
- The practice of analyzing test code without executing it to detect defects and improve quality, often skipped in automation projects.
- Structured Failure Data Collection(structured failure data collection, failure data, failure data collection, structured failure data)
- The practice of capturing detailed failure information including error messages, stack traces, timestamps, and environment configurations.
- System Under Test Characteristics(sut characteristics)
- The architecture, interfaces, and testability of the SUT that influence automation feasibility.
T
- TAS decommissioning steps(steps in decommissioning, decommissioning validation, validation in decommissioning)
- The sequential process of assessment, planning, execution, validation, and review for retiring a TAS.
- TAS decommissioning triggers(triggers for decommissioning)
- Factors that initiate the retirement of a Test Automation System, such as obsolescence or cost.
- Technical Debt
- Poor code structure or lack of identifiers in the SUT that can hinder automation without refactoring.
- Technical Debt in Test Automation(technical debt)
- Maintenance burden from poor code structure or lack of identifiers, hindering automation without refactoring.
- Technology Stack Compatibility(tool compatibility, compatibility, technology stack compatibility)
- Requirement that the automation tool supports the SUT's platforms, languages, and protocols.
- Test Adaptation Layer(test adaptation layer)
- The layer of gTAA that interfaces with the system under test (SUT) and adapts test commands.
- Test Automation(test automation)
- The use of software to perform or support test activities, including test management, test design, test execution, and test results checking.
- Test Automation Architecture(test automation architecture, taa)
- The design of the test automation solution that aligns with the system under test and supports required test levels.
- Test Automation Architecture (TAA)(test automation architecture (taa), taa, test automation architecture, layered architecture for taa, layered architecture, layers)
- The structural design of test automation that includes layers such as data-driven, business, and presentation layers.
- Test Automation Architecture Chapter(architecture chapter)
- The largest chapter of the CTAL-TAE exam, covering gTAA, its layers, and framework selection, weighted 25%.
- Test Automation Architecture for DevOps(devops automation architecture)
- Architecture supporting deployment pipelines, containerization, infrastructure-as-code, and quick rollback in DevOps.
- Test Automation Assessment(test automation assessment)
- An evaluation of the test automation solution covering architecture, scripts, data, environment, and CI/CD integration.
- Test Automation Component Verification(verification of test automation components, component verification)
- The process of checking that test automation components are complete, correct, and consistent with the test automation architecture.
- Test Automation Components(automation components)
- The elements including test scripts, libraries, configuration files, test data, and the automation framework.
- Test Automation Deployment Strategy(deployment strategy)
- The approach for rolling out the test automation solution across the organization or project.
- Test Automation Development(test automation development)
- The process of creating automated test scripts and test automation frameworks.
- Test Automation Environment(test environment)
- An environment containing hardware, software, network configurations, and infrastructure needed to conduct tests.
- Test Automation Environment Verification(test automation environment verification, tas verification, environment verification, verification of test automation environment)
- Step of checking that the test automation environment and scripts are correct before attributing failures to system defects.
- Test Automation Focus Areas for Different SDLCs(sdlc-specific automation focus)
- Prioritizing stable features in sequential models, core functionality in Agile, and CI/CD integration in DevOps.
- Test Automation Framework(test automation framework, taf)
- A set of guidelines, assumptions, and rules for creating and managing test automation for APIs.
- Test Automation Maintainability(maintainability)
- A quality characteristic ensuring scripts are easy to update and debug as the system evolves.
- Test Automation Maintainability for Agile(agile automation maintainability)
- Requirement for test automation frameworks to be highly adaptable to rapidly changing requirements in Agile.
- Test Automation Metrics(metrics for test automation, automation metrics)
- A set of metrics used to evaluate test automation effectiveness.
- Test Automation Objectives(automation objectives, benefits of test automation, objectives of test automation, primary objectives, test objectives)
- Intended benefits such as improved efficiency, repeatability, and coverage.
- Test Automation Readability(readability)
- A quality of scripts being self-documenting through meaningful names and consistent formatting.
- Test Automation Refactoring(refactoring)
- The process of restructuring test automation code to improve maintainability, readability, and performance without changing behavior.
- Test Automation Report(test automation report, reports and dashboards)
- A document or dashboard presenting automation results tailored to stakeholder needs.
- Test Automation Reporting(reporting and metrics for test automation)
- The process of tailoring test automation results for different audiences to support decision-making.
- Test Automation Risks(risks of test automation, automation risks, false positives, false negatives)
- Potential negative outcomes including high initial investment, maintenance effort, and false sense of security.
- Test Automation Solution(test automation solution, tas)
- A first-class software product comprising test scripts and frameworks, requiring requirements, architecture, version control, and continuous improvement.
- Test Automation Solution (TAS)(tas, test automation solution)
- A first-class software product with its own requirements, architecture, version control, and continuous improvement.
- Test Automation Solution (TAS) Verification(tas verification, test automation system verification, verification of the tas)
- The process of verifying the test automation solution, including its components, scripts, and CI/CD pipeline.
- Test Automation Solution Components(test automation solution components, tas components)
- The components of a test automation solution including scripts, data, environment, and pipeline.
- Test Automation Solution Verification(verification of test automation solution, tas verification)
- The process of checking that TAS components work correctly together and are maintainable over time.
- Test Automation Strategy Adaptation to SDLC(adapting automation to sdlc)
- The principle that test automation approaches must be tailored to the specific SDLC model to be effective.
- Test Automation Success Factors(success factors for test automation)
- Elements that contribute to effective automation, such as proper tool selection, skilled team, and appropriate test cases.
- Test Automation as Complement to Manual Testing(automation complement to manual testing)
- Principle that automation is not a replacement but a complement to manual testing, best for repetitive or regression tests.
- Test Automation as Software Development
- The principle that test automation should follow software development best practices, including refactoring and code reviews.
- Test Automation as a Software Development Project
- The treatment of test automation with version control, configuration management, and proper deployment procedures.
- Test Automation in DevOps(devops test automation, continuous testing)
- Cornerstone of DevOps enabling continuous testing across the delivery pipeline with parallel execution and release gating.
- Test Case Selection Criteria for Automation(test case selection for automation)
- A set of guidelines prioritizing stable and frequently executed tests for automation.
- Test Case Selection for Automation(selection of test cases, not all test cases are suitable)
- The process of choosing test cases based on stability, execution frequency, and return on investment.
- Test Coverage(coverage)
- A metric quantifying the extent to which requirements or code are tested.
- Test Dashboard(dashboard)
- A visual display of the most important information needed to achieve one or more objectives.
- Test Data Adequacy(data adequacy)
- The property of test data covering all necessary test conditions for a given scenario.
- Test Data Builder Pattern(test data builder)
- A design pattern for creating test data objects in a flexible and readable manner, improving test data management and maintainability.
- Test Data Dependency(test data dependencies)
- Flakiness cause when tests rely on shared or non-deterministic data like random values or timestamps.
- Test Data Factory(test data factories, test data factory)
- A reusable component for creating test data in a centralized and configurable manner.
- Test Data Isolation(test data isolation, isolated test data, isolation, data isolation)
- The practice of keeping test data independent to prevent side effects between tests sharing the same data.
- Test Data Management(test data management, data dependencies, tdm)
- The approach to ensuring test data adequacy and reusability in test automation.
- Test Data Reusability(reusability)
- The ability of test data to be shared across multiple test runs without manual recreation.
- Test Data Separation(separation of test data from scripts)
- The principle of isolating test logic from test data to improve maintainability and reusability.
- Test Data and Environment Configurations Management(managing test data and environment configurations, test data and environment configurations management)
- Practice of managing test data and environment settings separately from test scripts to ensure flexibility and repeatability.
- Test Definition Layer(test definition layer)
- A component of API automation architecture that contains test scripts and data.
- Test Environment Risks(test environment risks)
- Risks from unstable test data, configuration drift, or other environment issues that can invalidate automation results.
- Test Environment Stability(test environment, environment stability)
- The reliability and consistency of the environment where automation executes, impacting test reliability.
- Test Execution Layer(test execution layer)
- A component of API automation architecture responsible for sending requests and processing responses.
- Test Execution Time(test execution time)
- The total time taken to execute automated test suites, used to assess efficiency.
- Test Generation Layer(test generation layer)
- The layer of gTAA responsible for creating test cases and test data.
- Test Isolation Issue(isolation issue, isolation issues)
- A flaky test cause where tests interfere with each other through shared state or resources.
- Test Level vs. Test Type(test level vs. test type)
- Test levels group activities (e.g., unit); test types target objectives (e.g., functional).
- Test Levels for Automation(test levels, automation levels)
- The selection of appropriate test levels (unit, integration, system, acceptance) based on suitability for automation.
- Test Manager vs. Test Management Role(test manager vs. test management role)
- Two role names in testing that are often confused; test manager is a specific role, while test management role is a broader category.
- Test Metrics Selection(automation metrics, meaningful metrics)
- Choosing meaningful metrics like pass rate and defect detection rate that drive improvement.
- Test Order Dependency(order dependency, order dependencies)
- A flaky test cause where test outcomes depend on the execution order of other tests.
- Test Quarantine(quarantining)
- Practice of excluding flaky tests from the main test suite until resolved to maintain suite reliability.
- Test Script Reusability(script reusability)
- The ability to run the same script with multiple data sets without code changes.
- Test artifact archiving(archiving test artifacts)
- The preservation of test scripts, data, and reports during decommissioning for future reference.
- Test automation tool compatibility(tool compatibility, technology stack compatibility)
- The degree to which a tool supports the operating systems, browsers, languages, and protocols of the system under test.
- Test case designer
- A component within the test generation layer that designs test cases.
- Test data generator
- A component within the test generation layer that generates test data.
- Test executor
- A component within the test execution layer that executes tests.
- Test harness
- A custom set of utilities that centralize common functions and support test execution.
- Test infrastructure layer(test infrastructure layer)
- A layer in the TAA that manages logging, reporting, and configuration for the test automation solution.
- Test script generator
- A component within the test generation layer that generates test scripts.
- Three-Layer Architecture(three-layer architecture)
- A layered design comprising a test layer, keyword implementation layer, and system under test layer in keyword-driven testing.
- Timing Issue(timing issues)
- Common cause of flakiness related to race conditions, insufficient waits, or asynchronous operations not properly synchronized.
- Tool Evaluation (OSS vs. Commercial)(oss vs. commercial)
- The process of comparing open-source and commercial test automation tools based on project needs.
- Total Cost of Ownership(tco)
- The full cost of using a tool over its lifetime, including initial fees and hidden costs like training and support.
- Trend Analysis(trend analysis)
- A technique that examines failure rates over time to detect patterns such as increasing flakiness or regression after deployments.
U
- Unit Tests for Library Code(unit tests for the library code)
- Independent verification of library components to ensure correctness before use in test scripts.
- Utility Layer(utility layer)
- A component of API automation architecture providing common functions like logging, reporting, and configuration management.
V
- V-Model Test Automation Alignment(v-model automation alignment)
- Alignment of test automation with each V-Model level (component, integration, system, acceptance) from early stages.
- Validation vs. Verification(validation vs. verification)
- Verification ensures correct build; validation ensures right product for user needs.
- Vanity Metrics(vanity metrics)
- Metrics that look good but do not drive actionable decisions.
- Vendor Lock-In(lock you into a specific vendor's ecosystem)
- Dependency on a specific vendor's ecosystem that makes future migration to another tool difficult.
- Vendor Support(vendor support)
- Dedicated support provided by the tool's vendor, often with service-level agreements and professional training.
- Verification of Test Automation Solution(verification of test automation solution)
- The process of confirming that the automation solution meets requirements and works correctly.
- Version Control for Test Automation(version control)
- The practice of managing changes to test automation code using a version control system to track history and enable collaboration.
- Version Control for Test Automation Artifacts(version control)
- The use of version control systems to manage changes to test scripts and related artifacts.
- Version Control of Test Automation Artifacts(version control of test automation artifacts)
- Practice of storing test scripts, data, and configurations in a version control system for traceability and collaboration.