How many parallelisms are in Abinitio?
Answers were Sorted based on User's Feedback
Answer / pradeep
pipeline parallelism,data parallelism,component parallelism
| Is This Answer Correct ? | 12 Yes | 0 No |
Answer / sohanvarma
Component parallelism:- A graph with multiple processes
running simultaneously on separate data uses component
parallelism.
Data parallelism :- A graph that deals with data divided
into segments and operates on each segment simultaneously
uses data parallelism. Nearly all commercial data
processing tasks can use data parallelism. To support this
form of parallelism, Ab Initio provides Partition
components to segment data, and Departition components to
merge segmented data back together .
Pipeline parallelism :- A graph with multiple components
running simultaneously on the same data uses pipeline
parallelism. Each component in the pipeline continuously
reads from upstream components, processes data, and writes
to downstream components. Since a downstream component can
process records previously written by an upstream
component, both components can operate in parallel. NOTE:
To limit the number of components running simultaneously,
set phases in the graph.
| Is This Answer Correct ? | 2 Yes | 0 No |
What is the difference between a DB config and a CFG file?
Can you read multiple input files using one input file component ? (Same DML) How to use in abinitio graph?
What are the primary keys and foreign keys?
hi, am put into Ab initio now. I need some material for to learn it!! i have to give a test also.. can anyone help me provide material please....
Why do you think data processing is important?
what is the syntax of m_dump command?
What is the difference between partitioning with key and round robin?
What is EME?What is GDE?What is Co-operating system?What is the link between all these?Please explain elaborately.
Can you explain the performance and scalability of co> operating system?
Explain how abinitio eme is segregated?
Hi friends, what are the new features in abinito3.0?
What is the best way of creating huge test feeds?