I have a scenario like
Deptno=10---->First record and last record
Deptno=20---->First record and last record
Deptno=30---->First record and last record
I want those first and last records from each department in
a single target. How to do this in DataStage, any one can
assist me.
Thanks in advance.
Answers were Sorted based on User's Feedback
Answer / ashok
Source--->Sort stage--->copy stage
From copy stage we have to take two source stages
(source1,source2)
source1-->Removeduplicate stage(in this we can get first
record from each dept)
source2--->Remove duplicate stage(in this we can get last
record from each dept)
using funnel we can add these results.
| Is This Answer Correct ? | 10 Yes | 4 No |
Answer / d anil babu
take source--->copy---->remove dupli stage---->
----->remove dupli stgae-->funnel-->dataset
in first remove duplicate stage select duplicate retain first
in second rmd select duplicate retain last and in funnel u
have to select the sort funnel
| Is This Answer Correct ? | 3 Yes | 1 No |
Answer / amjad pasha
SOURCE ---> SORT STAGE(sort key mode = sort, create cluster
key change column and create key change column should be
false) ---> COPY STAGE ---> (2 REMOVE DUPLICATE STAGES)
REMOVE DUPLICATE STAGE_1 (key=dept and Duplicate to Retain
= First) AND REMOVE DUPLICATE STAGE_2 (key=dept and
Duplicate to Retain = Last) ---> FUNNEL STAGE (Funnel
Type=Continues Funnel) ---> TARGET
| Is This Answer Correct ? | 2 Yes | 0 No |
Answer / prabhu
source->sortstage->removeduplications->dataset
in sortstage->create key changecolumn=true
after
removeduplicates stage->duplicates retain:-last
we can get last and first record group wise.
| Is This Answer Correct ? | 4 Yes | 2 No |
1.
Source--->Sort stage--->copy stage======>(SRC1,SRC2)
From copy stage we have to take two source stages
(SRC1,SRC2)
SRC-->Removeduplicate stage(in this we can get first
record from each dept--> Duplicates To Retain=First)
SRC2--->Remove duplicate stage(in this we can get last
record from each dept--> Duplicates To Retain=Last)
using funnel we can add these results.
2.
source->sortstage->removeduplications->dataset
in sortstage->create key changecolumn=true
this will set '1' for 1st records and '0' next duplicate
records.
after
removeduplicates stage(key columns=Deptno, CreateKeyChange
Columns)->duplicates retain:-last
we can get last(CreateKeyChange is zero and from all the
duplicates in that group, we are retaing last record) and
first(CreateKeyChange is 1) record group(Dept) wise.
| Is This Answer Correct ? | 2 Yes | 0 No |
Answer / naga
take a sequential file and give the output link to copy
stage and from copy stage give one output link to head
stage and one output to tail stage and in head and tail
stages give no. of partitions per record =1 and give the
output to funnel stage and give funnel type = sequence and
mention the link order to displays which records first and
give the output link to dataset and you will get the output
you want
| Is This Answer Correct ? | 4 Yes | 3 No |
Answer / c raghavendra nivas
-------removeduplicate(first)
source---copy ------funnel----output
-------removeduplicate(last)
it works i did it
try if u want
if its a database you can do witha co-related sub query
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / naga
take sequential file and give its output to copy and copy
it to two datasets.in one dataset select the partition on
deptno type=modulus and perform sort and select both stable
and unique you will get first redcords and in another
dataset select partition on deptno and type modulus and
perform sort and select only unique and give give both
dataset outputs to funnel and give its output to dataset
| Is This Answer Correct ? | 1 Yes | 3 No |
How to RD using transformer?
What is the flow of loading data into fact & dimensional tables?
Difference between the Sequence and Sequencer in DS?
tab1 tab2 1,a 1,d 2,b 3,c perfoms outerjoin what is the o/p? write sql query for outerjoin?
one file contains col1 100 200 300 400 500 100 300 600 300 from this i want to retrive the only duplicate like this tr1 100 100 300 300 300 how it's possible in datastage?can any one plz explain clearley..........?
What is the use of hoursfromtime() function in transformer stage in datastage?
A flat file contains 200 records. I want to load first 50 records at first time running the job, second 50 records at second time running and so on, how u can develop this job?
Give an idea of system variables.
What are the various kinds of containers available in datastage?
i have flat file and using unix how can i generate sequence number into targer?
what is the exact difference between dataset and fileset in datastage?
explain about completely flow of sequencers technicaly,without using example??explain about lookup,nullhandling?