generate Unique sequence numbers for each partition in session with Unconnected Lookup ?




Hi All,

Please help me to resolve the below issue while Applying partitioning concept to my Session.

This is a very simple mapping with Source, Lookup , router, and target.

I need to Lookup on the target and compare with the source data, if any piece of data is new then Insert, and If any thing change in the existed data then Update.

while Inserting the new records to the target table I'm generating sequence numbers with Unconnected lookup, by calling the maximum PK ID from the target table.

The above flow is working fine from last one year.

Now I wish to apply the Partitioning concept to the above floe(session)

At source I used 4 pass through partitions.(For Each partition different filter conditions to pull the data from source)

at Target I used 4 passthrough Partitions.

it is working fine for some data, but for some rows for Insert Operation , it is throwing Unique key errors, because while Inserting the data it is generating the same sequence key twice.


In detail : 1st row is coming from 1st partition and generated the sequence number 1 for that row.

2nd row is coming from 1st partition and generated the sequence number 2 for that row

3rd row is coming from the 2nd partition generated the sequence number 2 again for that row. (it must generate 3 for this row)

the issue is becuase of generating the same sequence numbers twice for different partitions.

Can any one Please help me to resolve this issue.

While Applying partitions how can I generate a Unique Sequence numbers from Unconnected lookup for Each partitioned data.


Regrads,
N Kiran.

Answer Posted / sufi

Most simple way to handle this type scenario is use DB Sequence Generator (write Stored Procedure) and Trigger on INSERT on top of it.

Is This Answer Correct ?    2 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Define joiner transformation?

827


What is the reusable transformation?

856


what are 3 tech challenges/ common issues you face?

2127


Explian the Process of deployment groups in informatica

838


What is the need of an ETL tool?

866


How do you load first and last records into target table? How many ways are there to do it? Explain through mapping flows.

906


What are the components of workflow manager?

815


1)you have multiple source system where u receive files ,how do you actually load into mapping using transformation,what are the transformation you use? 2)you have files in ftp location ,how do you get it into mapping with you ETL concept?

1914


What is the format of informatica objects in a repository?

820


Difference between Data and Index Caches?

889


what is song in infrmatica...?

1937


What is the maplet?

828


How can we create index after completion of load process?

850


How do you use reject loader.

2340


If I have 10 flat files with same name abc.txt files with different timestamps as source I need to load them in tgt table oracle. in between job execution fails and rows are not loaded into tgt. how can I make them load in that target even if my job fails?

1262