If there is a file that contains 1000 records, I need the ouput to contain these 1000 records with the header as file name concatenated with the current timestamp and trailer as the count of records
Answers were Sorted based on User's Feedback
Answer / raj
Method 1:
In Order to get this , the file name has to be parameterized.
Row Generator ->
Source -> Column Generator -> Funnel -> Destination
Aggregator ->
Column Generator:
Create column named 'Count' starting with 1 and incrementing by 1. By this, the last row will have the value of1000 in the 'Count' column.
Aggregator:
Get max of count which is 1000.
We also pass the actual data through another link.
Aggregator count is passed into funnel which is the trailer count.
The three inputs
1. File name concatenated with timestamp is passed from row generator.
2. Actual data is passed directly after column generator.
3. Header count is passed through the third link.
are joined in a funnel stage.
As funnel needs same number of columns across all the input we set all other columns as NULL.
Method 2...
This is an easy method using after job sub routine.
After the job is complete run a after job sub routine to get record count from any link and append to the file
Similar operation could be done for the header record.
| Is This Answer Correct ? | 0 Yes | 0 No |
Can you let us know what you have tried?
www.datagenx.net
http://goo.gl/atN4AT
| Is This Answer Correct ? | 0 Yes | 1 No |
when U have a remove dublicate option in sort stage, why we have a remove dublicate stage in PX, thought it is recamended to sort data before using a remove dublicate stage. I hae been thinking this from days....
what is the difference between the active datawarehouse and datawarehouse
Different ways a project can be moved to production ?...example ….export-import and Version control.
what is data mapping
Can you explain repository tables in datastage?
Unix command to view the data in a dataset
Name the different sorting methods in datastage.
How to LOG 'unmatched Master' records and 'Reject Updates' in log files using MERGE stage?
To see hidden files in LINIX?
How do u call shellscript/Batch file from DS?
What is ibm datastage flow designer?
what is materialized view used datastage?