how many types of remove the duplicate records?
Answer Posted / rohit babar
There are 3 ways by which we can remove the duplicate records
1. By using remove duplicate stage. We have control here on which record we want to remove it's first or last. There is option record to retain in remove duplicate stage where we select first or last option.
2. By using sort stage. there is option allow duplicate in sort stage. We set this option true when we want duplicate records & If we want unique records we set it to the false
3. By in-line sorting. In Partition tab of any stage when we select key base partition tech. then perform sort option will enable if we check this option next 2 option will enable which is stable & unique if we select stable that means we allow duplicate records & if we select unique that means we remove duplicate records and getting unique records
| Is This Answer Correct ? | 5 Yes | 0 No |
Post New Answer View All Answers
On which Dimension Table you implemented SCD Type in your Project
What is the flow of loading data into fact & dimensional tables?
explain about citrix scheduling tool in datastage
how can we validate the flat files using the date in the header and number of records in the flat file? Using both conditions at a time.
Define repository tables in datastage?
Why do you need stage variables?
What are the various kinds of containers available in datastage?
What are the main features of datastage?
how to read 100 records at a time in source a) hw is it fr metadata Same and b) if metadata is nt same?
Why do we use link partitioner and link collector in datastage?
Which warehouse using in your datawarehouse
What are routines in datastage? Enlist various types of routines.
WAT TYPE OF PL/SQL QUERRYS USED IN DATASTAGE
what is the use of skid in reporting?
8000 jobs r there i given commit, suddenly job will abort? what happens? 2)diff b/t transformer stage & filter stage? 3)how to load the data in the source?