i have two sources two flatfiles same structure
one flatfile contain 100 million recs
another flatfile contain 10 million recs
i have to connect single target(performance oriented answer)
what are the steps we have to do this scenario
Answers were Sorted based on User's Feedback
Answer / babu
Hi Teja,
The two sources are haveing same structure,so beter to
use list file,to load the data into single TARGET.
Procedure:
----------
1.Place the two source paths in a note pad and
save as it '.list' format.
2.create a maping as per your requirement in
that mapping you have to take only one source no need to
take two sources.
3. Create a session and workflow.
4.In session give a SOURCE FILE PATH
is '.list' file and SOURCE FILE TYPEA as INDIRECT.
Let me know if any thing wrong.
Thanks,
dwarak.vbr@gmail.com
| Is This Answer Correct ? | 16 Yes | 0 No |
Answer / srikanth
Hi,
Both teja and Babu Answers are correct..
But here we need to consider Performance wise which one is
better.
here we have only two flat files one is having 100 million
records and second one having 10 million records.
union transformation can supports for flat files also and it
is acting as union all(don't worry about this).
first drag the 100 million records source and then drag the
10 million records source on mapping designer.
connect these two sources to union transformation.
union transformation can merge the Data By COLUMN by COLUMN.
so it is trying to merge only 10 million records with
existing 100 million records
Then we can tune the performance here.
if we have lot of flat files(same structure) then we have to
go for file indirect.
| Is This Answer Correct ? | 1 Yes | 0 No |
Answer / sudheer
As u r using source as flat file so u can go for partitioning preferably Single-Thread or Multi-Thread partitioning.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / tejaetl
i answered this question both the flatfiles connet to union
connect to single target
| Is This Answer Correct ? | 0 Yes | 1 No |
How to load query faster,so that It will take less time to load?
I need an oracle query for convert Char to Integer?. Can any one help me how to do this?
What are the technical challenges faced in Informatica production support member? Give any one example and how to solve it?
suppose i have source 101 a 101 b 101 c 101 d i want target like 101 abcd how will u achive this please give me the answer
i have a wf i want to run this very day 3 time every 3 hours how can you scheduled that?
What is difference between a gateway node and worker node?
Why do you use Mapping Parameter and mapping variable?
what is the gap analysis?
how many new transformations are introduced in 8.1 which are not available in 7.1? any new transformation in 8.6?
Source and Target are flat files, Source table is as below ID,NAME 1,X 1,X 2,Y 2,Y On Target flat file i want the data to be loaded as mentioned below ID,NAME,REPEAT 1,X,2 1,X,2 2,Y,2 2,Y,2 How to achieve this, Can i get a map structure
After a load is done to my target table, I need to insert a last row, which might be formed at some expression transformation and brought to target. Do I have to have separate mapping to be run after the 1st mapping? Or in a single mapping how to achieve this?
define galaxy repository in informatica