Hi This is Vijay,

How can your remove the duplicates in sequential File?

Answer Posted / arun

Sort the incoming data using a sort stage & use remove
duplicates on the key columns. This will remove the
duplicates in ur source file.

Is This Answer Correct ?    5 Yes 3 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What are the areas of application?

658


How one source columns or rows to be loaded in to two different tables?

654


What is aggtorec restructure operator?

722


how to achieve this output ? Two Input columns(ID & Name) - ID | Name 1 | Jack 1 | Kara In output there should be only 1 column which will be populated as - 1,Jack 1,Kara

359


What are the different layers in the information server architecture?

641






Can you define merge?

664


Can you explain engine tier in information server?

650


What are the main features of datastage?

659


What are stage variables?

636


What are the types of containers in datastage?

703


hi.... am facing typical problem in every interview " I need some critical scenarios faced in real time" plz help me guys

2424


What is the difference between server job and parallel jobs?

662


how to get sum of sal based on dept_no and then sum of all sal irrespective of dept_no in same sql. output:- 10, 200(sum of sal for dept_no 10), 5000(sum of all sal)

521


Notification Activity

895


What are stage variables and constants?

700