1.How to read multiple file from sequential stage.
2.If a file doesn't arrive or doesn't exists in sequential
stage how do u handle this.
3.What do you do before taking data from source to staging
area.
4. I have a remove duplicate stage and transformer
stage.what will u do for optimizeing the performance of the
job.
Answers were Sorted based on User's Feedback
Answer / varma
Ans1 : We can use Read Method = “Specific Files” and give the full path of all the file one by one. Alternatively, you can use Read Method = “File Pattern” and specify the wild card.
Ans 2: We can control this using “Missing File Mode” Option. Values are “Ok” to skip the file and continue and “Error” to abort the job.
Ans3: It is important to make sure the meta data matches the record. It would be better to reject bad reject and collect them in “Reject Link”. This can be controlled by “Reject Mode” option. Values are “Continue”, “Fail” and “Output”. “Output” will collect the reject records in a reject link.
Is This Answer Correct ? | 3 Yes | 0 No |
Answer / jayanthi
1)read method should be set as file pattern(for reading
single file it should be specificfile)
Is This Answer Correct ? | 2 Yes | 0 No |
Answer / ashok
4.in case of only for duplicates removing i will use remove
duplicate stage.but in case of more logics applied i will
go to transformer.bcoz remove duplicate stage give better
performance compare to transformer
Is This Answer Correct ? | 1 Yes | 2 No |
Answer / nagaraz
1.READ METHODE SHOULD BE TAKE SPECIFIC FILE U CAN TAKE
MULTIPLE FILE
Is This Answer Correct ? | 0 Yes | 1 No |
where we use column generator stage in real time scenario?
What is the difference between validated and compiled in the datastage?
what is the difference between the active datawarehouse and datawarehouse
What is Fastly Changing Dimension?
how to get sum of sal based on dept_no and then sum of all sal irrespective of dept_no in same sql. output:- 10, 200(sum of sal for dept_no 10), 5000(sum of all sal)
Hi This is Vijay, How can your remove the duplicates in sequential File?
15 Answers HCL, Scope International,
What are the functionalities of link collector?
What are transforms and what is the differenece between routines and transforms?
hi my source is:: empno,deptno,salary 1, 10, 3.5 2, 20, 8 2, 10, 4.5 1, 30, 5 3, 10, 6 3, 20, 4 1, 20, 9 then target should be in below form... empno,max(salary),min(salary),deptno 1, 9, 3.5, 20 2, 8, 4.5, 20 3, 6, 4, 10 can anyone give data flow in data stage for the above scenario.... thanks in advance...
Nls stands for what in datastage?
What is the use of surrogate key stage?
How to perform incremental load in datastage?