how CAN we remove duplicates in dataset?

Answers were Sorted based on User's Feedback



how CAN we remove duplicates in dataset?..

Answer / disney

In dataset stage, Input tab of partitioning --> used the key
partition instead of auto partition , then check the
perform sort and check the unique, It will remove the
duplicate from dataset

Is This Answer Correct ?    25 Yes 0 No

how CAN we remove duplicates in dataset?..

Answer / markonda

by using remove duplicate stage we can remove duplicates

Is This Answer Correct ?    3 Yes 6 No

Post New Answer

More Data Stage Interview Questions

How you Implemented SCD Type 1 & Type 2 in your project?

0 Answers  


3) Sequential file contains data like Empno ename sal 111 abc 2000 Trgt file: Trgt1----111 Trgt2----abc Trgt3---2000

2 Answers  


What is the Environment Variable need to Set to TRIM in Project Level?(In transfermer, we TRIM function but I need to impliment this project level using Environment variable)

0 Answers   IBM,


1.new record it will insert but changes of natural key is not present in taget i want to update (here key is composite natural key )can any one help this to explan how to do

0 Answers   IBM,


how may datastage variables/parameters will be in trnsformer stage? 1 2 3 4 ?

1 Answers   Wipro,






what is the difference between lookup stage reject link and merge stage reject link in datastage Parallel jobs?

9 Answers   HCL,


Name the third party tools that can be used in datastage?

0 Answers  


What are the types of containers and how to create them?

0 Answers  


types of errors in datastage?

2 Answers   Reliance,


What are the differences between datastage and informatica?

0 Answers  


1.How do u handle NULL in sequential stage. 2.Difference between switch stage and filter stage.

4 Answers  


What is a merge in datastage?

0 Answers  


Categories