how CAN we remove duplicates in dataset?

Answers were Sorted based on User's Feedback



how CAN we remove duplicates in dataset?..

Answer / disney

In dataset stage, Input tab of partitioning --> used the key
partition instead of auto partition , then check the
perform sort and check the unique, It will remove the
duplicate from dataset

Is This Answer Correct ?    25 Yes 0 No

how CAN we remove duplicates in dataset?..

Answer / markonda

by using remove duplicate stage we can remove duplicates

Is This Answer Correct ?    3 Yes 6 No

Post New Answer

More Data Stage Interview Questions

What is confirmed Dimension? what is Factless Fact? give one example? What are Additive, Semi-Additive Facts?

1 Answers   TCS,


What is the difference between account and directory options ?

0 Answers  


What is staging variable?

0 Answers  


what is .dsx files

3 Answers   IBM,


What is audit table?

1 Answers  






i have a table col1 10 20 30 40 10 20 50 my requirement is how to retrive only duplicates like 10 10 20 20 like this how it's possible in SQL?

11 Answers   Cap Gemini,


If you want to use a same piece of code in different jobs, how will you achieve this?

0 Answers  


what is hash file

2 Answers   CTS, IBM,


what is a force compile

2 Answers   Cap Gemini, IBM,


i have 4 jobs i want run 1job should run on 1node and 2job runon 2node and.... how to make it possible?

1 Answers  


I have a file it contain 2 records like empname,company as Ram, Tcs and Ram, IBM. But i want empname, company1,company2 as Ram, TCS,IBM in the target. How?

6 Answers   Cap Gemini,


1)s.key generate 1 to 700 records today. tomorrow another 400 will updated how to update the records using s.key generator? 2)source is like :-- DB --> T/F stage1 --> seq1file T/f 1 is linking with T/F2 ---> seq 2 how to load the data? in source i given some conditions those r going in seq1. The another data will going to seq2 how to do this ?

0 Answers   Wipro,


Categories