A flatfile contains 200 records.I want to load first 50
records at first time running the job,second 50 records at
second time running and so on,how u can develop the job?pls
give the steps?pls pls
Answer Posted / varun
Design the job like this:
1. Read records from input flat file and click on option of
rownumbercolumn in the file. It will generate a unique
number corresponding to each record in that file.
2. Use filter stage and write the conditions like this:
a. rownumbercolumn<=50(in 1st link to load the records
in target file/database)
b. rownumbercolumn>50 (in 2nd link to load the records
in the file with the same name as input file name, in
overwrite mode)
So, first time when your job runs first 50 records will be
loaded in the target and same time the input file records
are overwritten with records next first 50 records i.e. 51
to 200.
2nd time when your job runs first 50 records(i.e. 51-100)
will be loaded in the target and same time the input file
records are overwritten with records next first 50 records
i.e. 101 to 200.
And so on, all 50-50 records will be loaded in each run to
the target
| Is This Answer Correct ? | 19 Yes | 9 No |
Post New Answer View All Answers
How can we improve the performance in datastage?
Differentiate between operational datastage (ods) and data warehouse?
Hi , Can anyone give few examples of scenarios and there corresponding design in datastage..i am new to this tool...confused in design while my manager asking to design the job.. Please post the URL if there..so i can go through it.. Thanks in advance...
How do you import and export the datastage jobs?
What are the various kinds of containers available in datastage?
What is the flow of loading data into fact & dimensional tables?
What are stage variables and constants?
How can you write parallel routines in datastage PX?
What is difference between join, merge and lookup stage?
client know skid info?
What are orabulk and bcp stages?
What is the Environment Variable need to Set to TRIM in Project Level?(In transfermer, we TRIM function but I need to impliment this project level using Environment variable)
What are the different plug-ins stages used in your projects?
Define Job control?
Name the different sorting methods in datastage.