1)How to Duplicate Records Delete in Sequential file?

Answers were Sorted based on User's Feedback



1)How to Duplicate Records Delete in Sequential file?..

Answer / naga

connect sequential file to dataset and use partition
technique and perform sort and select unique

Is This Answer Correct ?    19 Yes 6 No

1)How to Duplicate Records Delete in Sequential file?..

Answer / vinod upputuri

In the sequential File stage there is a option called filter.
there we can use UNIX command.

syntax for Remove duplicate: uniq or sort -u

Is This Answer Correct ?    11 Yes 1 No

1)How to Duplicate Records Delete in Sequential file?..

Answer / subhash

small correction to Vinod answer,
If we use UNIQ, it will remove duplicate if they are
consecutive only..
so, better to use
sort -u
or
sort file_name | uniq

Is This Answer Correct ?    9 Yes 0 No

1)How to Duplicate Records Delete in Sequential file?..

Answer / topper

Select the data set and press delete..

Is This Answer Correct ?    0 Yes 15 No

Post New Answer

More Data Stage Interview Questions

Why we need datasets ratherthan sequential files?

5 Answers  


how to find no.of records in sequntial file itself?

4 Answers  


HOW U CAN ABORT THE JOB IF THE DATA IS DUPLICATE?

1 Answers   IBM,


what are the types of nodes

4 Answers   HCL, TCS,


How to reverse the string using SQL?

0 Answers   CTS,






Unix Qn asked in datastage interview: I have diff type(.txt, .tmp, .bat etc) of file in 4 diff directories, I want move all '.txt' file from 4 directories to other folder. And need to delete all the files except which are created TODAY?

2 Answers   TCS,


What is the difference between operational data stage (ods) and data warehouse?

0 Answers  


what is difference between migration project and integration project? can anyone explain with the example Thanks in advance

2 Answers   Satyam,


Define Routines and their types?

0 Answers  


what is the use of surogate key in datastage

0 Answers   TCS,


which r the connectors used in san?

0 Answers  


1.new record it will insert but changes of natural key is not present in taget i want to update (here key is composite natural key )can any one help this to explan how to do

0 Answers   IBM,


Categories