How to remove duplicates in transformer stage? in parallel
mode
Answer Posted / praveen sarva
STEP 1) TRANSFORMER STAGE PROPERTIES--> ADVANCED -->
EXECUTION MODE ---> PARLLEL
STEP 2) TRANSFORMER STAGE PROPERTIES --> INPUT -->
PARTITIONING--> PARTITION TYPE --> HASH ---> ENABLE SORT ---
> ENABLE UNIQUE
Simple u will get non duplicate records....
| Is This Answer Correct ? | 11 Yes | 0 No |
Post New Answer View All Answers
A signal has a wavelength of 1 micro min in air.how far can the front of the wave travel during 1000periods?
Hi , Can anyone give few examples of scenarios and there corresponding design in datastage..i am new to this tool...confused in design while my manager asking to design the job.. Please post the URL if there..so i can go through it.. Thanks in advance...
Define Merge?
What is the purpose of pivot stage?
Can you explain how could anyone drop the index before loading the data in target in datastage?
how to connect source to db?generally what r stages u used? how to find the data is having delimiter format?
How can one find bugs in job sequence?
What are the types of containers in datastage?
What are stage variables, derivations and constants?
Describe the main features of datastage?
What is the difference between orabulk and bcp stages?
Which is the best institute in Hyderabad to learn OBIEE and DataStage?Please tell me faculty name also
1)How will u implement SCD2 by using surrogate key. 2)What are the disadvantages with surrogate key. 3)How will you handle nulls in your project for the varchar, integer data types. 4)Can I use two fact tables in star schema. 5)3 jobs are running on the 2 nodes after I added one more node so can I compile those jobs to run on three nodes.
What are the functionalities of link collector?
Define Job control?