Main Function of the Staging area in DWH ?
Answers were Sorted based on User's Feedback
Answer / guru avula
1.In a project source systems are differnet and also all
source systems are not availble in same time.for eg 1
source is availble at 1AM and 2n one at 2 AM etc
But our schedule jobs run at different time ,so we have to
pick the data from source system based on source availble
time and put into staging area.
2.All source systems table formats and column formats are
diffrent ,so we have to sync all .
For above two reasons we go for staging area
| Is This Answer Correct ? | 5 Yes | 1 No |
Answer / srinivas
I will add some points to first answer
Source system send the raw data what ever data they have simply they will send to us.
In staging we do the cleansing, remove-duplicate and null handling process and load the data into staging tables.
Then we applying business logic's and loading into dim and fact tables.
| Is This Answer Correct ? | 2 Yes | 1 No |
How you can fix the truncated data error in datastage?
My input has a unique column-id with the values 10,20,30.....how can i get first record in one o/p file,last record in another o/p file and rest of the records in 3rd o/p file?
what is the Difference Between Datastage Server Edition and Parallel Edition?
HOw Hash Partion Works Thank you in Advance i have doubts on Hash Partion TEch Could please give me the clear understandable notation example e_id,dept_no 1,10 2,10 3,20 4,20 5,30 6,40 i have TWo Nodes/Three Nodes My questions are: 1).if i select hash key as e_id how Hash partion will distribute the data in to two NOdes/three NOdes 2).if i select hash key as dept_no how Hash partion will distribute the data in to two NOdes/three NOdes sivakumar.katta7@gmail.com
What could be a data source system?
What is apt_config in datastage?
Difference between the Sequence and Sequencer in DS?
What is the difference between validated and compiled in the datastage?
Explain ibm infosphere information server and highlight its main features?
What are the different database update actions available?
WHAT IS FORCE COMPILE?
What are the types of hashed files in data stage