How to Improve Performance of graphs in Ab initio?
Answer Posted / ananya
There are many ways to improve the performance of the
graph. It also depends on a particular graph, the
components used in it.
In general the following tips can be used for improving
performance:
1> Try to use partitioning in the graph
2> try minimising the number of components
3> Maintain lookups for better effeciency
4> Components like join/ rollup should have the option
Input must be sorted, if they are placed after a sort
component.
5> If component have In memory: Input need not be sorted
option selected, use the MAX_CORE parameter value
efeciently.
6> Use phasing of a graph effeciently.
7> Ensure that all the graphs where RDBMS tables are used
as input, the join condition is on indexed columns.
8> Try to perform the sort or aggregation operation of data
in the source tables at the database server itself, instead
of using it in AbInitio.
| Is This Answer Correct ? | 26 Yes | 1 No |
Post New Answer View All Answers
Name any two stages of the data processing cycle and provide your answer in terms of a comparative study of them?
What is common among data validity and data integrity?
What are the operations that support avoiding duplicate record?
What dedup-component and replicate component does?
What is the syntax for m_dump in abinitio?
How scientific data processing is different from commercial data processing?
Dear all, Please send me the ab initio pdfs and faqs i need... my mail id is rrajesh.intel@gmail.com
How to insert/update a csv file by comparing it with another csv file? for example, i have 2 input files : ColA ColB ColC 1 A AA 2 B AB 3 C CC and second one : ColA ColB ColC 2 B BB 4 D DC Job should compare these 2 files and update the records present in first input file. so the output file will look like this: ColA ColB ColC 1 A AA 2 B BB 3 C CC 4 D DC
What a local lookup is?
What are the steps to create a repository in ab initio?
What is sort component in abinitio?
What are the various types of layout supported by abinitio?
Difference between informatica vs ab initio?
When we should use 'jobid' for commit table (Output table component?? How to use in abinitio graph?
How to find the project(pub,priv,common,client) in between public, Private,common?Any identification?