how many types of remove the duplicate records?

Answer Posted / rohit babar

There are 3 ways by which we can remove the duplicate records
1. By using remove duplicate stage. We have control here on which record we want to remove it's first or last. There is option record to retain in remove duplicate stage where we select first or last option.

2. By using sort stage. there is option allow duplicate in sort stage. We set this option true when we want duplicate records & If we want unique records we set it to the false

3. By in-line sorting. In Partition tab of any stage when we select key base partition tech. then perform sort option will enable if we check this option next 2 option will enable which is stable & unique if we select stable that means we allow duplicate records & if we select unique that means we remove duplicate records and getting unique records

Is This Answer Correct ?    5 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is the difference between server job and parallel jobs?

658


What is the difference between validated and compiled in the datastage?

693


What is a quality stage in datastage tool?

619


What are data elements?

648


What is ibm datastage flow designer?

676






A signal has a wavelength of 1 micro min in air.how far can the front of the wave travel during 1000periods?

2018


Where do the datastage jobs get stored?

715


What is a datastage job?

611


What are the difference types of stages?

614


I have a few records just I want to store data in to targets cycling way how?

1888


What is size of a transaction and an array means in a datastage?

727


Difference between sequential file and data set?

634


What are the components of datastage?

642


Differentiate between Symmetric Multiprocessing and Massive Parallel Processing?

612


What are sequencers?

608