how many types of remove the duplicate records?
Answer Posted / rohit babar
There are 3 ways by which we can remove the duplicate records
1. By using remove duplicate stage. We have control here on which record we want to remove it's first or last. There is option record to retain in remove duplicate stage where we select first or last option.
2. By using sort stage. there is option allow duplicate in sort stage. We set this option true when we want duplicate records & If we want unique records we set it to the false
3. By in-line sorting. In Partition tab of any stage when we select key base partition tech. then perform sort option will enable if we check this option next 2 option will enable which is stable & unique if we select stable that means we allow duplicate records & if we select unique that means we remove duplicate records and getting unique records
| Is This Answer Correct ? | 5 Yes | 0 No |
Post New Answer View All Answers
Define data aggregation?
Can you explain kafka connector?
im new to this tool im now at project plz tell me step by step process how to design plz help me i wnt to go with exp for job plz give me d proper design and explination
Define Merge?
What are the functionalities of link collector?
Why do you need stage variables?
What is data partitioning?
What are routines in datastage? Enlist various types of routines.
for example You have One Table with 4 Columns (Mgr ID, Department ID, Salary, Employee ID). Can you find out the Average Salary and Number of Employee present per Department and Mgr
Differentiate between Symmetric Multiprocessing and Massive Parallel Processing?
What is the differentiate between data file and descriptor file?
Can you explain tagbatch restructure operator?
How will you load you daily/monthly jobs datas in to Fact and Dimension table using datastage.
what is use of SDR function?
What is difference between symmetric multiprocessing and massive parallel processing?