How many parallelisms are in Abinitio?
Answers were Sorted based on User's Feedback
Answer / pradeep
pipeline parallelism,data parallelism,component parallelism
| Is This Answer Correct ? | 12 Yes | 0 No |
Answer / sohanvarma
Component parallelism:- A graph with multiple processes
running simultaneously on separate data uses component
parallelism.
Data parallelism :- A graph that deals with data divided
into segments and operates on each segment simultaneously
uses data parallelism. Nearly all commercial data
processing tasks can use data parallelism. To support this
form of parallelism, Ab Initio provides Partition
components to segment data, and Departition components to
merge segmented data back together .
Pipeline parallelism :- A graph with multiple components
running simultaneously on the same data uses pipeline
parallelism. Each component in the pipeline continuously
reads from upstream components, processes data, and writes
to downstream components. Since a downstream component can
process records previously written by an upstream
component, both components can operate in parallel. NOTE:
To limit the number of components running simultaneously,
set phases in the graph.
| Is This Answer Correct ? | 2 Yes | 0 No |
What do you mean by the term data warehousing? Is it different from data mining?
What is the difference between check point and phase?
what is difference between chk point n phase.Say im loading a file (containig 1 lakh records) and my graph fails after loading 50,000th record.What is the advantage of using check point in this case. Will i be able to start from 51000th record.
What is data encoding?
explain checkin and checkout?
We know rollup component in abinitio is used to summarize a group of data record then why do we use aggregation?
What is local and formal parameter?
What do you mean by a transaction file and how it is different from that of a sort file?
Explain what is the architecture of abinitio?
What are differences between different gde versions(1.10,1.11,1.12,1.13and 1.15)?what are differences between different versions of co-op?
Explain what is sort component in abinitio?
What is difference between API
2 Answers CitiGroup, IBM, TCL,