my source is sequencial file and my target is dataset. i am running the job in

my source is sequencial file and my target is dataset.
i am running the job in two node configuration file.
my source having 10 records how the data move to target?

Question Posted / trinath.nist

3 Answers
8271 Views
TCS, I also Faced
E-Mail Answers

Answers were Sorted based on User's Feedback

my source is sequencial file and my target is dataset. i am running the job in two node configurati..

Answer / bala

Depends on your partitioning method. If its auto - entire
rows will pass in single node.

Is This Answer Correct ?

10 Yes

1 No

my source is sequencial file and my target is dataset. i am running the job in two node configurati..

Answer / kavi

If we use Round Robin partitioning method,5 rows in one
node & another 5 rows in 2nd node.
If it is Entire partitioning method,all the 10 rows go into
both the nodes.

Is This Answer Correct ?

10 Yes

1 No

my source is sequencial file and my target is dataset. i am running the job in two node configurati..

Answer / ankit gosain

Hi All,

Well it depends upon the partitioning technique used at the
target.

Note: Since source is a Sequential file which is sequential
operator, it will run on a single node, no matter how many
node the configuration file is & all the 10 records will go
sequentially. But Dataset is used as a target which is a
parallel operator, it will run parallely on all the nodes
defined & the data will be distributed according to the
partitioning technique used at the target ( if the records
are not duplicate on the basis of key then we can say that
the data distribution amongs the nodes will be even).

Cheers,
Ankit :)

Is This Answer Correct ?

2 Yes

1 No

Post New Answer