DWH Staging Area Importance


The Data Warehouse Staging Area is temporary location where data from source systems is pulled in.


A staging area is mainly required in Data Warehousing architecture for timing reasons.  In short, all required data must be available before data can be integrated into the Data Warehouse. 


Due to varying business cycles, data processing cycles, hardware and network resource limitations and geographical factors, it is not feasible to extract all the data from all Operational databases at exactly the same time. 


One another reason for having staging area is to collect the data from heterogeneous databases and processing the data.


Not all business require a Data Warehouse Staging Area.  For many businesses it is feasible to use ETL to copy data directly from operational databases into the Data Warehouse.

 

Comments

  1. jeganMarch 31, 2020 at 10:04 PM

    It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me...
    ServiceNow Training In Chennai
    Tibco BW Training In Chennai
    Oracle SOA Training In Chennai
    Android Training In Chennai
    C C++ Training In Chennai
    iOS Training In Chennai

    ReplyDelete
  2. AnonymousJuly 17, 2023 at 9:50 PM

    Thanks for sharing valuable information, keep posting more Servicenow Course in Pune
    servicenow training institute in pune

    ReplyDelete

Post a Comment

Popular posts from this blog

Data Migration Testing Startegy

Image
1.   Purpose of the Article The purpose of this Aricle is to describe the different test stages that will be performed; how the testing will be prepared and executed for each stage, and the criteria that need to be met before transition from one stage to the next can occu r. 2.   Phases involved in Data Migration Testing Below are the phases involved in testing data migration. ·         Fusion ·         Release 1.       Design 2.       Implementation a)       Ear b)       Iterations 3.       SIT (System Integration Testing) 4.       UAT (User Acceptance Testing) 2.1.         Fusion (Discover and Define) In this Phase the requirements for the Data Migration project is gathered and identified from the Testing perspective. QA is responsible for defining the scope of testing; high level estimation and Requirement Specification docs. This phase we will perform pre-migration testing, these tests occur
Read more

Informatica DVO

What is Data Validation Option ? What can be tested ? To answer above two questions, Data Validation Option is a ETL Testing tool which comes along with power center and enables to test and validate data Data Validation Option reads table definitions from Power Center metadata repositories, and checks the data for inconsistencies Verify that moved or transformed data is complete and accurate and has not been changed because of errors in the movement or transformation process Will not check the correctness of transformations or mappings designed in Informatica Data Validation stages A typical workflow or stages for data validation consists of multiple tasks- 1. Data Validation Option reads one or more Power Center metadata repositories 2. We define the validation rules(creation of tests) in Data Validation Option 3. We run the rules(tests) to ensure the data conforms to the validation rules. When we do this, Data  Validation Option performs the following tasks: 1.
Read more

Differences between OLTP and OLAP

Online transaction processing system: *******************************   In OLTP system, the tables are in normalized structure As the OLTP is in normalized structure, DML operations like Updates and deletes will be faster Simple queries are run against the OLTP system OLTP system contains only current data. As the OLTP system does not contain history data, it cannot be used in reporting   Online analytic processing system: ****************************   In OLAP system, the tables are in de normalized structure   As the OLAP is in de normalized structure, the numbers of joins between tables are less and hence select statements will be faster   Complex queries are run against the OLAP system   OLTP system contains only history data and can be used for reporting purpose
Read more