How many parallelisms are in Abinitio?
Answers were Sorted based on User's Feedback
Answer / pradeep
pipeline parallelism,data parallelism,component parallelism
| Is This Answer Correct ? | 12 Yes | 0 No |
Answer / sohanvarma
Component parallelism:- A graph with multiple processes
running simultaneously on separate data uses component
parallelism.
Data parallelism :- A graph that deals with data divided
into segments and operates on each segment simultaneously
uses data parallelism. Nearly all commercial data
processing tasks can use data parallelism. To support this
form of parallelism, Ab Initio provides Partition
components to segment data, and Departition components to
merge segmented data back together .
Pipeline parallelism :- A graph with multiple components
running simultaneously on the same data uses pipeline
parallelism. Each component in the pipeline continuously
reads from upstream components, processes data, and writes
to downstream components. Since a downstream component can
process records previously written by an upstream
component, both components can operate in parallel. NOTE:
To limit the number of components running simultaneously,
set phases in the graph.
| Is This Answer Correct ? | 2 Yes | 0 No |
How do you add default rules in transformer?
What do you mean by a transaction file and how it is different from that of a sort file?
How to implement the funtionality in the custom component to use in the graph?
I had 10,000 records r there i loded today 4000 records, i need load to 4001 - 10,000 next day how is in Type 1 and how is it on type 2?
When we should use 'jobid' for commit table (Output table component?? How to use in abinitio graph?
46.How you can create cross joined output using join component ? 47.What is the default layout of watcher files ? How to use in abinitio graph? 48.Why you get 'too many open files' error ? How to use in abinitio graph? 49.What is the significance of vnode folder under AB_WORK_DIR ? How to use in abinitio graph? 50, What is the significance AB_AIR_BRANCH? How to use in abinitio graph? 51. How can you select only unique records from a set of records ? How to use in abinitio graph? 52. How next_in_sequence work in parallel layout ? How to use in abinitio graph? 53. Why you want to set a modest number in limit ? How to use in abinitio graph? 54. How you can encrypt a password and use it in dbc file? How to use in abinitio graph? 55. Which function you should be using if you do not want to process non printable char from a feed file ? How to use in abinitio graph? 56. How you can run a component for certain conditions ? How to use in abinitio graph? 56. What is catalog and when you should use it ? How to use in abinitio graph? 57. How you can use reformat as a router ? How to use in abinitio graph? 58. How many process gets created for a n-way parallel component ? How to use in abinitio graph? 59. Why delimited DMLs take more time to process than fixed length DMLs? How to use in abinitio graph? 60. How can you select only first and last record from a file without using next_in_sequence? How to use in abinitio graph? 61.Why you should always keep largest input as driving input for Join ? How to use in abinitio graph? 62. What a catalog file contains ? How to use in abinitio graph? 63. What Is private project and public project ? How to use in abinitio graph? 64. Why you should not use checkpoint after replicate ? How
0 Answers Accenture, Mind Tree,
What is standard environment ?
What is the use of aggregation when we have rollup as we know rollup component in abinitio is used to summarize a group of data record? Then where we will use aggregation?
I installed AbInito in my PC.In components there is no "select" component.How can i get that component?and How we can create user defined components?
What is air-project parameter ? How to use in abinitio graph?
3 Answers IBM, TCL, Tech Mahindra,
How does PBK and Sort component and Join(in memory sort) work?I mean in the join component i have used In Memory Sort,so how will it work in terms of performence as compared with PBKand Sort Component?
How to convert a single column values 1 2 3 4 to single row of 4 columns ? And vice-versa