How many parallelisms are in Abinitio?

Answer Posted / sohanvarma

Component parallelism:- A graph with multiple processes
running simultaneously on separate data uses component
parallelism.
Data parallelism :- A graph that deals with data divided
into segments and operates on each segment simultaneously
uses data parallelism. Nearly all commercial data
processing tasks can use data parallelism. To support this
form of parallelism, Ab Initio provides Partition
components to segment data, and Departition components to
merge segmented data back together .
Pipeline parallelism :- A graph with multiple components
running simultaneously on the same data uses pipeline
parallelism. Each component in the pipeline continuously
reads from upstream components, processes data, and writes
to downstream components. Since a downstream component can
process records previously written by an upstream
component, both components can operate in parallel. NOTE:
To limit the number of components running simultaneously,
set phases in the graph.

Is This Answer Correct ?    2 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Describe the process steps you would perform when defragmenting a data table. Does this table contain mission-critical data?

575


How to convert a single column values 1 2 3 4 to single row of 4 columns ? And vice-versa

663


Can anyone give me an exaple of realtime start script in the graph?

603


What do you mean by the term data warehousing?

628


You can ask about different vector functions. How to use in abinitio graph?

5041






What is broadcasting and replicate?

717


What do you know about abinitio?

773


What is the difference between rollup and scan?

1270


What is MAX CORE of a component?

725


Input Data: AAABBBCC CCAAABB expected output A3B3C2 A3B2C2 How can I achieve this in Ab initio? where In output count of occurrences should be sorted from high to low

876


Do you think effective communication is necessary for data processing? What is your strength in terms of same?

667


What is the difference between check point and phase?

694


What is the architecture of abinitio?

676


What is the core of co> operating system?

649


How do you add default rules in the transformer?

661