Sort the incoming data using a sort stage & use remove duplicates on

Hi This is Vijay,

How can your remove the duplicates in sequential File?

Question Posted / arun

Answer Posted / arun

Sort the incoming data using a sort stage & use remove
duplicates on the key columns. This will remove the
duplicates in ur source file.

Is This Answer Correct ?

5 Yes

3 No

Please Help Members By Posting Answers For Below Questions

Give an idea of system variables.

1007

Where do the datastage jobs get stored?

1191

How do you run datastage job from the command line?

1075

Can you explain kafka connector?

1289

I/p : F1 table have A,B,C,D,E and F2 table having C,E,V i need output 0utput1: ABD output2: V any one suggest me this

996

What are the different kinds of views available in a datastage director?

1018

Can you define merge?

1102

What are the types of jobs we have in datastage?

1058

What are the main differences you have observed between 7.x and 8.x version of datastage?

1072

client know skid info?

2066

Which algorithm you used for your hashfile?

1166

Difference between IBM DATA STAGE8.5 and DATA STAGE9.1 ?

3782

What are the different plug-ins stages used in your projects?

1062

What is a datastage job?

1005

Explain entity, attribute and relationship in datastage?

1084