ETL Testing Tools - Definition, Information, Online Training

Extract, Transform and Load (ETL)

General Goals of Testing an ETL Application:

1. Data completeness. Ensures that all expected data is loaded.
2. Data transformation. Ensures that all data is transformed correctly according to business rules and/or design specifications.
3. Data quality. Ensures that the ETL application correctly rejects, substitutes default values, corrects or ignores and reports invalid data.
4. Performance and scalability. Ensures that data loads and queries perform within expected time frames and that the technical architecture is scalable.
5. Integration testing. Ensures that the ETL process functions well with other upstream and downstream processes.
6. User-acceptance testing. Ensures the solution meets users' current expectations and anticipates their future expectations.
7. Regression testing. Ensures existing functionality remains intact each time a new release of code is completed.

Types of Testing

1. Application Testing: The focus of this article is data-centric testing so we’ll not discuss application testing here.
2. Data-Centric Testing: Data-centric testing revolves around testing quality of the data. The objective of the data-centric testing is to ensure valid and correct data is in the system. 

Following are the Couple of Reasons that Cause the Requirement of Performing Data-Centric Testing

1. ETL Processes/Data Movement: When you apply ETL processes on source database, and transform and load data in the target database
2. System Migration/Upgrade: When you migrate your database from one database to another or you upgrade an existing system where the database is currently running.

ETL Testing

Data Warehousing Concepts

• What is Data Ware House?
• Difference between OLTP and Data Ware Housing
• Data Acquisition

1. Data Extraction
2. Data Transformation
3. Data Loading

• Data Marts

1. Dependent Data Mart
2. Independent Data Mart

• Data Base Design

1. Star Schema
2. Snow Flake Schema
3. Fact constellation Schema

• SCD(slowly changing dimension)

1. Type-1 SCD
2. Type-2 SCD
3. Type-3 SCD

• Basic Concepts in SQL
• Overview of ETL Tool Architecture
• White Box and Black BOX Testing Functionality on
• Different Transformation Rules
• Data Ware House Life Cycle
• Different Types of Testing Techniques in ETL

1. Minus Queing
2. Count  Queing

ETL Testing Concepts

Introduction

1. What is use of testing
2. What is quality & standards
3. Responsibilities of a ETL Tester

Software development life cycle

1. Waterfall model
2. V-model
3. Agile model & methodology
4. Prototype model
5. Spiral model

Testing methodologies

1. White box testing
2. Black box testing
3. Grey box testing
4. ETL Testing Work Flow Process
5. How to Prepare the  ETL Test Plan
6. How to design the Test cases in ETL Testing.
7. How to reporting the Bugs in ETL Testing ?
8. ETL Testing Responsibilities in DataStage, Informatica, Abinitio etc.
9. How to detect the bugs through database queries
10. ETL Performing Testing & Performing Tuning