Main Function of the Staging area in DWH ?
Answers were Sorted based on User's Feedback
Answer / guru avula
1.In a project source systems are differnet and also all
source systems are not availble in same time.for eg 1
source is availble at 1AM and 2n one at 2 AM etc
But our schedule jobs run at different time ,so we have to
pick the data from source system based on source availble
time and put into staging area.
2.All source systems table formats and column formats are
diffrent ,so we have to sync all .
For above two reasons we go for staging area
| Is This Answer Correct ? | 5 Yes | 1 No |
Answer / srinivas
I will add some points to first answer
Source system send the raw data what ever data they have simply they will send to us.
In staging we do the cleansing, remove-duplicate and null handling process and load the data into staging tables.
Then we applying business logic's and loading into dim and fact tables.
| Is This Answer Correct ? | 2 Yes | 1 No |
Can you explain tagbatch restructure operator?
i have the source from Uk,north america how can i pass the data two tables based on the locations
what is sparse lookup?
I have a source table with column name CITY having 100 records, I want target table with column name start with 'A' and 'B',remaining columns as reject outputs. how can achieve this by data stage?please help me?????
in sequtial file 2 columns avaliable,iwant only one column load the target how do it.
What are the functionalities of link partitioner and link collector?
What are routines in datastage?
How do you load dimension data and fact data? Which is first
if we take 2 tables(like emp and dept), we use join stage and how to improve the performance?
what is the use of invokation id
Hi everyone,I have kept a project Sales And Distribution for a pharmaceutical company.can anybody explain one complex business rule that we had in our project and how did you accomplish it using DS?
hi everbody, i have a problem in my project.. Native Error Code: -407 "Assignment of a null value to a not null column" hi everbody, i have a problem in my project.. Native Error Code: -407 "Assignment of a null value to a not null column" i have no idea, what should i do..please help :(