This document contains the transformation specifications for each BI column, including instructions for data cleansing, RI checking, reconciliation, and error handling, as well as algorithms for aggregations and summarizations.
ETL process flow diagram
The ETL process flow diagram shows the process sequence and the process dependencies among all ETL process components , such as program modules, temporary and permanent work files and tables, and sort , merge, and load utilities.
ETL program design document
This document is created from the source-to-target mapping document after the ETL process flow has been determined. It contains the actual programming specifications for every ETL program module for the initial load, historical load, and incremental load. Portions of this document will be given to different ETL developers to code the program modules.
Staging area
The staging area should contain program libraries with version control as well as dedicated space for temporary and permanent work files and tables.