my source is sequencial file and my target is dataset.
i am running the job in two node configuration file.
my source having 10 records how the data move to target?
Answers were Sorted based on User's Feedback
Answer / bala
Depends on your partitioning method. If its auto - entire
rows will pass in single node.
| Is This Answer Correct ? | 10 Yes | 1 No |
Answer / kavi
If we use Round Robin partitioning method,5 rows in one
node & another 5 rows in 2nd node.
If it is Entire partitioning method,all the 10 rows go into
both the nodes.
| Is This Answer Correct ? | 10 Yes | 1 No |
Answer / ankit gosain
Hi All,
Well it depends upon the partitioning technique used at the
target.
Note: Since source is a Sequential file which is sequential
operator, it will run on a single node, no matter how many
node the configuration file is & all the 10 records will go
sequentially. But Dataset is used as a target which is a
parallel operator, it will run parallely on all the nodes
defined & the data will be distributed according to the
partitioning technique used at the target ( if the records
are not duplicate on the basis of key then we can say that
the data distribution amongs the nodes will be even).
Cheers,
Ankit :)
| Is This Answer Correct ? | 2 Yes | 1 No |
How to Convert the columns into rows?
HOw Hash Partion Works Thank you in Advance i have doubts on Hash Partion TEch Could please give me the clear understandable notation example e_id,dept_no 1,10 2,10 3,20 4,20 5,30 6,40 i have TWo Nodes/Three Nodes My questions are: 1).if i select hash key as e_id how Hash partion will distribute the data in to two NOdes/three NOdes 2).if i select hash key as dept_no how Hash partion will distribute the data in to two NOdes/three NOdes sivakumar.katta7@gmail.com
when we have to go for a sequential file stage & for a dataset in datastage?
How one source columns or rows to be loaded in to two different tables?
we run a job in 4 nodes,i want to run same job on 8 nodes is it possible? job recompling is mandtory?why?
How a server job can be converted to a parallel job?
What is Horizontal transformation, vertical transformation,diagonal transformation?
how to get sum of sal based on dept_no and then sum of all sal irrespective of dept_no in same sql. output:- 10, 200(sum of sal for dept_no 10), 5000(sum of all sal)
How to clean the datastage repository?
source contains 2 columns comes to target 4 columns how
What is PX?
Which is the best institute in Hyderabad to learn OBIEE and DataStage?Please tell me faculty name also