Sort the incoming data using a sort stage & use remove duplicates on

Hi This is Vijay,

How can your remove the duplicates in sequential File?

Question Posted / arun

Answer Posted / arun

Sort the incoming data using a sort stage & use remove
duplicates on the key columns. This will remove the
duplicates in ur source file.

Is This Answer Correct ?

5 Yes

3 No

Please Help Members By Posting Answers For Below Questions

table actions available in oracle connector?

1649

How a source file is populated?

1108

how to add a new records into source?

2049

What is datastage?

1128

What are stage variables?

1250

What are the various kinds of containers available in datastage?

1100

what are .ctl(control files) files ? how the dataset stage have better performance by this files?

2866

Where the datastage stored his repository?

1132

What is oci?

1349

Can you implement SCD2 using join, transformer and funnel stage?

1601

What is Ad-Hoc access? What is the difference between Managed Query and Ad-Hoc access?

3015

What are the repository tables in datastage?

1348

Can anyone tell me a difficult situation who have handled while creating Datastage jobs?

3290

What can we do with datastage director?

1289

What is the importance of the exception activity in datastage?

1110