With out using Funnel Stage, how to populate the data from
different sources to single target
Answers were Sorted based on User's Feedback
Hi Kiran ,
We can populate the sources metadata to target without
using funnel stage using "Seqential File" Stage.
let me explain
In Sequential file we have a property called "File" so first
u give the file name and load the data.
Next time in the same sequential file right side we have a
property "File" just click on that so it will ask another
file name just give other file name ...do not load the data
, in the same you can give how many files u have.
Finally u ran the job Automatically the data will be appended.
Thks
| Is This Answer Correct ? | 14 Yes | 5 No |
Answer / sagar
better use join stage kiran,bcause join stage accepts
toretrive the records from different stages,and also join
accepts many inputs and one output link.so dis stage can
satisfies ur condition.and also ihave to say merge,lookup
accepts rejects u need one target so join will satisfies....
ur's
sagar
| Is This Answer Correct ? | 8 Yes | 2 No |
Answer / venugopal
Hi Kiran,
We can populate the sources metadata to target without
using funnel stage using "Seqential File" Stage.
let me explain
In the source file path uu can mention process date and
file name with *.txt extension
For Ex:
#SRC_DATA_DIR#/JD/incoming/intermediate/*#PROC_DT#_SHIPMENT*
.txt
Above path PROC_DT is process date and SHIPMENT is file
name
Now the data can be retrieved from multiple files and
populated into a single file.
Hopes this will help you Kiran.
Any Doubts cal on 09767117168
| Is This Answer Correct ? | 4 Yes | 2 No |
1. Parameterise the File name and pass the diff file names
at run time, in the target we can put write mode 'append'
2. We can add multiple 'File' properties in the seq file
stage and give them diff file names and run it.
3. If all files are in same directory, then
File: DirectoryName/*#Date#.txt
and run the job.
| Is This Answer Correct ? | 3 Yes | 1 No |
Answer / kiran
hai sagar,gourav and natasha..,Ur answer is correct but my
quetion is wrong .
my reqment is, i am having multiple sources(flatfies)
and sources metadata same and poulated to target without
using funnel stage
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / sag
so kiran,iam not hving idea viewers plz respond kiran's
requirement
sag
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / sesadri
In sequential Stage keep file method as File Pattern, and provide the file name as File_Name_*.csv and file should have similar naming convention.
| Is This Answer Correct ? | 1 Yes | 0 No |
Hi kiran,
in one same job you create as follows,
seq1------>tseq1
seq2------>tseq2
step1:load first source into tseq1 as file name tgt.txt
step2:load second source into tseq2 as file name
tgt.txt(ensure file name first file name only)
step3:Give file upload mode=Append
run for one time you will get...
| Is This Answer Correct ? | 2 Yes | 2 No |
diff between OLTP and OLAP? what TOP-DOWN and BOTTOM-UP Approach? which is best? what are Star Schema and Snow Flake Schema?
What is Fastly Changing Dimension?
How many types of hash files are there?
what is the Difference Between Datastage Server Edition and Parallel Edition?
What are the types of jobs we have in datastage?
WHAT ARE THE STAGES U WILL USE IN IMPLEMENTING SCD2/DATE FIELD
what is diff b/w datastage 8.1,8.5,8.7?
How can u execute the sql query through unix? What is the Primary key for Dimension table? what is the primary key for Fact table?
Display all files which have size more 3KB in given directory/folder.
WHAT IS FORCE COMPILE?
what is meta data? Explain? Where it is used?
What are the third party tools you used in your project?