Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...


I have source file which contains duplicate data,my
requirement is unique data should pass to one file and
duplicate data should pass another file how?

Answers were Sorted based on User's Feedback



I have source file which contains duplicate data,my requirement is unique data should pass to one f..

Answer / dilip anand k

Its Simple!!

All you have to do is link your source to a Sort Stage.
Sort the data and generate a Key Change column.
Key Change column = ‘1’ represents that the record is
unique while Key Change Column = ‘0’ represents the
duplicates.

Put a Filter stage and filter out the data into two
different outputs based on the generated Key Change Column.

Is This Answer Correct ?    21 Yes 5 No

I have source file which contains duplicate data,my requirement is unique data should pass to one f..

Answer / farzana kalluri

input output
1 T1 T2
2 4 1
2 6 2
1 7 3
3 4
4 5
3
5
5
6
7
for this

seq file---->Aggregate(key=id)---->filter---->2 targets

In aggregate use count rows...
in filter count=1 it goes to target1
if count=2 it goes to target2..

Is This Answer Correct ?    9 Yes 3 No

I have source file which contains duplicate data,my requirement is unique data should pass to one f..

Answer / ramachandra rao

After source use aggregator stage and use option aggregator
type is count and count the records after that use filter in
where clause count>1 ie duplicate records go to one target
and another where clause count=1 ie unique records go to
another target.

Is This Answer Correct ?    3 Yes 0 No

I have source file which contains duplicate data,my requirement is unique data should pass to one f..

Answer / sonali s

The above solution doesnt give required output. The requirement is as below:
Input:
A
B
B
C
D
D
D

Output should have 2 files as below.

File 1
A
C

File 2
B
B
D
D
D

Please provide solution for this

Is This Answer Correct ?    0 Yes 0 No

I have source file which contains duplicate data,my requirement is unique data should pass to one f..

Answer / purba

Input:
A
B
B
C
D
D
D

Required output:
A
B
C
D

Solution:
Seq file----->sort stage(create key change column for the I/p key row)
O/p:
A 1
B 1
B 0
C 1
D 1
D 0
D 0

Now take filter stage to filter for key column=0 & keycol=1
We get 2 outputs:
A. B
B. D
C. D
D

Is This Answer Correct ?    0 Yes 0 No

I have source file which contains duplicate data,my requirement is unique data should pass to one f..

Answer / riyazahamedmohamed

take two links using copystage, of your input file,one is your input file output, another one is for keychange column(using sort stage set the key change column to true) with filter "0" out of transformer, to the look up stage.set the lookup option to continue-reject.you will get the desired output.reject will capture unique records.output file will capture duplicate records.

Is This Answer Correct ?    0 Yes 0 No

I have source file which contains duplicate data,my requirement is unique data should pass to one f..

Answer / krishna

As per my knowledge
initially soure is in sequential stage anc take aggrigator
stage and select the grouping option and select which column
you want to group then go to option command and select
column for calculation and select the which column you want
to do the operation .in column for calculation w have seen
many options and select missing count column name and give
the column name for output.and add transformer stage with in
the transformer stage add constraints .and give the two outputs
if column name=1 then 1 else 0
if column name>=2 then 1 else 0
it will work

Is This Answer Correct ?    0 Yes 6 No

Post New Answer

More Data Stage Interview Questions

How to RD using transformer?

0 Answers   CTS,


how do u catch bad rows from OCI stage? And what CLI stands for?

0 Answers  


how to design the change capture stage in(data stage parallel jobs) type 2

2 Answers   IBM,


i have a project manager round on sat this week can you post what are the main question i have to check.if you have any idea regular question on project pls send me. thanks in advance

2 Answers   IBM,


how do you pass parameters in a script?

1 Answers   L&T,


Explain ibm infosphere information server and highlight its main features?

0 Answers  


How to create a file using vi editor? 2)how to delete a file in vi editor? 3)How to connect the server datastage to unix? what r the command lines we r using? 4)30 jobs r runnig in unix i want to find out my job. how to do this? give me command?

0 Answers   Wipro,


In my source i have 10 records but i want 11 records in target. How can i acheive this in Server jobs.

2 Answers   IBM,


What is the difference between operational data stage (ods) and data warehouse?

0 Answers  


I have the following columns in the EMP table Empid,Empname,Sal,month(Sal),year(Sal) and DOB(let us say the dob is 15th-Jan-1981) Desing a job such that the output contains the following empname,year(sal),tot(sal) and current age i.e. whether 18yrs or so on

1 Answers   Accenture,


What is the surrogate key? what is the use of surrogate key? how to Create surrogate key Generator in scd2 in 8.5?

5 Answers   SLK Software,


Which type of joins Merge stage can support?

7 Answers   IBM,


Categories