Difference in the implementation of lookup and join
stages,in joining two tables?
Answers were Sorted based on User's Feedback
Answer / kiran
Hai This is Kiran...
If u want to join more than one table ,u can use join,lookup
and merge also.
Join: it is used join more than one table based one key
column .it can perform 4 join as inner join,left outer
join,right join and full outer join.
Lokk-UP:it is used join more than one table,but not necesary
to join based ont he key column but it need data-type.it
give reference link and single out put link and give reject
link also.it can perform inner join and left outer jojn.
main difference: if the huge amount of the data contain in
reference table refer to join else look-up.
| Is This Answer Correct ? | 14 Yes | 2 No |
Answer / krishna
Generally we are using lookup for comparision purpose,
based on the reference table size we r using join or lookup.
If the reference table size is less than the main table
then use lookup stage other wise use join stage.
In lookup we have two types:
Normal lookup - reference lookup is less no of rows
compared to main table
sparse lookup - reference lookup is more no of rows
compared to main table.
But the peformance wise use join if the reference table has
more data.
Regards,
Krishna
| Is This Answer Correct ? | 8 Yes | 0 No |
Answer / zulfi123786
Hi This is Zulfi
Basically Join is used when you have large amount of data
about in millions and it performs inner join,left
outer,right outer and full outer joins
The join stage requires the incomming data to be hash
partitioned and sorted on the joining keys
The look up is used when the reference records are fewer in
number about less than one lakh and it doesnot require the
incomming source data to be sorted, instead the refrence
link should be in Entire partition mode.
In look up there are two types
Normal and Sparse
Sparse is available only when the reference is a database.
usually Normal has to be used unless when the refrence to
source rows ratio is 100:1
| Is This Answer Correct ? | 8 Yes | 0 No |
Answer / sadanand
HI All,
I would like to add one more point to JOIN.
To achieve full outer join the number of inputs need would
be only two.
The Primay table need to be sorted.
Memory used is very less compared to Lookup.
Regards,
Sadanand.
| Is This Answer Correct ? | 2 Yes | 0 No |
Answer / indian
Hi Zulfi..you are answer is more explained one and clear
we will go for Merge if we want the rejected data for every
update link
| Is This Answer Correct ? | 0 Yes | 0 No |
4) source target c1 c1 c2 c3 c2 c4 c4 c5 c3 c6 c7 c4 c5 c6 c7 please send me answer this question my mail
how many datamarts we will use in real time project and when will use the datamart?pls send the replay early
What is the difference between datastage and datastage tx?
1. How many People are part of your Team? 2. Explain how you create jobs or flow of project? 3. Join Stage vs Lookup vs Merge Stage 4. Summation scenario based question - How you find sum of salary for a specific employee (Explain stages and flow of job)? 5. Explain Remove duplicates stage ? Can you do sort in this stage? 6. SQL Questions - Joins - Types, Difference between Join and Union 7. Unix Questions - How you run the Job, How you list all jobs in project 8. Explain Environmental Variables? 9. SQL Scenario - If you have 3 Identical record in a Table, Ex: 1, Ram, Xyz; 1, Ram, Xyz; 1, Ram, Xyz; Delete only 2 of the records and keep only 1 using the Delete query. How you will you do this?
What is the difference between informatica and datastage?
hi everbody, i have a problem in my project.. Native Error Code: -407 "Assignment of a null value to a not null column" hi everbody, i have a problem in my project.. Native Error Code: -407 "Assignment of a null value to a not null column" i have no idea, what should i do..please help :(
What's the Main Function of the Staging area in DWH
What are stage variables and constants?
How to LOG 'unmatched Master' records and 'Reject Updates' in log files using MERGE stage?
hi this is kiran i have one table i want divide the table with two different table like even rows and odd rows how can i do this one tell me plzz
How to display errors in datastage?
How to write a left outer join condition by using Transformer stage in server jobs? Could any one help me?