How many parallelisms are in Abinitio?
Answers were Sorted based on User's Feedback
Answer / pradeep
pipeline parallelism,data parallelism,component parallelism
Is This Answer Correct ? | 12 Yes | 0 No |
Answer / sohanvarma
Component parallelism:- A graph with multiple processes
running simultaneously on separate data uses component
parallelism.
Data parallelism :- A graph that deals with data divided
into segments and operates on each segment simultaneously
uses data parallelism. Nearly all commercial data
processing tasks can use data parallelism. To support this
form of parallelism, Ab Initio provides Partition
components to segment data, and Departition components to
merge segmented data back together .
Pipeline parallelism :- A graph with multiple components
running simultaneously on the same data uses pipeline
parallelism. Each component in the pipeline continuously
reads from upstream components, processes data, and writes
to downstream components. Since a downstream component can
process records previously written by an upstream
component, both components can operate in parallel. NOTE:
To limit the number of components running simultaneously,
set phases in the graph.
Is This Answer Correct ? | 2 Yes | 0 No |
When we should use 'jobid' for commit table (Output table component??
Difference between public and private projects and how to make private to public?
What is a rollup component?
What are the co> operating system’s assorted library of integrated components?
Do we really work with ACTUALDATA in development phase.
What will be the skew for, input file->partition by key-> partition by round robin->output file
What do you mean by the term data warehousing? Is it different from data mining?
What do you mean by continuous graph? what is it significance?
List out the file extensions used in abinitio?
Which Ab initio version has Hadoop connector ? and what is the latest GDE version available ?
How to move data from developement to testing and testing to production?
1 Answers BitWise, CTS, Satyam, Wipro,
What are the different types of parallelism used in abinitio?