how to remove duplicates in transformer stage by using
stage variables?one example?

Answer Posted / amit

using hash partition technique, we can bring duplicate data(based on key columns) in one partition. Then in stage constraints filter out data with setting @inrownum = 1.

This will remove duplicate in transformer stage.

Is This Answer Correct ?    0 Yes 7 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Hi,can any one please mention list of dimension and fact tables for Sales and Distribution System for a Pharmacutical company.

1672


Difference between ‘validated ok’ and ‘compiled’ in data stage?

681


tell me 5 situations when we r using oracle db stages like orecle connector, oracle enterprise

2710


How do you import and export data into datastage?

707


Explaine the implimentation of scd's in ds indetail, please send me step by step procedure to perform scd's 1,2,3. Please replay for this, Thanks in advance

1755






Differentiate between Join, Merge and Lookup stage?

651


What are data elements?

664


Where the datastage stored his repository?

623


i have a job with 3 possibiliies finish with ststus ok abbort warning how do you handle these 3 in job sequence? explain the situation where you have appiled scd in your project? chandu

2277


how to get sum of sal based on dept_no and then sum of all sal irrespective of dept_no in same sql. output:- 10, 200(sum of sal for dept_no 10), 5000(sum of all sal)

530


How you can fix the truncated data error in datastage?

1210


What are the functionalities of link partitioner and link collector?

600


Differentiate between Symmetric Multiprocessing and Massive Parallel Processing?

633


What is datastage?

652


Differentiate between odbc and drs stage?

597