how to remove duplicates in transformer stage by using
stage variables?one example?

Answers were Sorted based on User's Feedback



how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / ds

In Stage variable:

stage_variable3 <map> stage_variable1
if column=stage_variable1 than 0 else 1 <map>
stage_variable2
column <map> stage_variable3

Put stage_variable2 as constrain to target stage.

Is This Answer Correct ?    12 Yes 2 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / venu

if you want to remove duplicates in transformer stage
use one of the partition technic hash partition you can
easily remove duplicatess

Is This Answer Correct ?    8 Yes 2 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / peeyush sehgal

sv1=inputlink
sv2=if inputlink=sv3 then 1 else 0
sv3=sv1

Is This Answer Correct ?    0 Yes 2 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / prasad

take two stage variables

sV1: Input_column

sV2: if Input_column = sV1 then 0 else 1

and put 'sV1=1' as constraint

Plz correct me, If am wrong.....

Is This Answer Correct ?    4 Yes 7 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / amit

using hash partition technique, we can bring duplicate data(based on key columns) in one partition. Then in stage constraints filter out data with setting @inrownum = 1.

This will remove duplicate in transformer stage.

Is This Answer Correct ?    0 Yes 7 No

how to remove duplicates in transformer stage by using stage variables?one example?..

Answer / subodh

duplication of transformer stage is removed b7y using a
call by referance and call by value , using we create one
object and no other duplication is done

Is This Answer Correct ?    1 Yes 14 No

Post New Answer

More Data Stage Interview Questions

What are orabulk and bcp stages?

0 Answers  


Hi am sundar, i have datas like 00023-1010 00086-1010 00184F2-1010 . . . . SCH-AS-1010 200-0196-039 . . . Now i want the result as values before the delimiter should come under the column ITEM_CODE and values after the delimiter should come under the column LOC_CODE.. But some datas like "SCH-AS-1010", for this, "SCHAS" should come under the column ITEM_CODE and 1010 should come under the column LOC_CODE.. Pls help me..

1 Answers  


what is parameterset?

4 Answers   Wipro,


How to reverse the string using unix?

0 Answers   CTS,


Hai..,This Kiran . how to immlement SCD's through sequential file.please explain briefly.if nt ask me i will explain ,what i know.

2 Answers  






What is a ds designer?

0 Answers  


What is difference between 8.1 , 8.5 and 9.1 ?

1 Answers   IBM,


if 3 table having different columes. like first table having 4 columns , second table having 3 columns and third table having 2 columns then how to capture the data by using funnel stage in parallel jobs...srinu.thadi

17 Answers   IBM, TCS,


wt is the diff b/w odbc and oracle stage

2 Answers   Accenture, HCL,


what is set mapping in datastage??

2 Answers   ADP,


Can aggregator and transformer stages use to sort the data? How ?

2 Answers  


How to work with XML out put stage? Please explain step by step? i need to generate XML file using Table data. Given is the .XSD file. Please help?

2 Answers   TCS,


Categories