generate Unique sequence numbers for each partition in session with Unconnected Lookup ?




Hi All,

Please help me to resolve the below issue while Applying partitioning concept to my Session.

This is a very simple mapping with Source, Lookup , router, and target.

I need to Lookup on the target and compare with the source data, if any piece of data is new then Insert, and If any thing change in the existed data then Update.

while Inserting the new records to the target table I'm generating sequence numbers with Unconnected lookup, by calling the maximum PK ID from the target table.

The above flow is working fine from last one year.

Now I wish to apply the Partitioning concept to the above floe(session)

At source I used 4 pass through partitions.(For Each partition different filter conditions to pull the data from source)

at Target I used 4 passthrough Partitions.

it is working fine for some data, but for some rows for Insert Operation , it is throwing Unique key errors, because while Inserting the data it is generating the same sequence key twice.


In detail : 1st row is coming from 1st partition and generated the sequence number 1 for that row.

2nd row is coming from 1st partition and generated the sequence number 2 for that row

3rd row is coming from the 2nd partition generated the sequence number 2 again for that row. (it must generate 3 for this row)

the issue is becuase of generating the same sequence numbers twice for different partitions.

Can any one Please help me to resolve this issue.

While Applying partitions how can I generate a Unique Sequence numbers from Unconnected lookup for Each partitioned data.


Regrads,
N Kiran.

Answer Posted / subhrangshu

Hi,
Take one parameter (i.e. $$seq) and assign initial value for the unique key (i.e. 1000). Now, from Source Qualifier take all the ports to one expression transformation. Add two additional ports in the Expression Transformation as below.

v_seq (variable port) = IIF(v_seq>0,v_seq+1,$$seq)
SEQ_NO (output port) = v_seq

In this way, the Sequence transformation can be avoided but we will have the same facility in partition scenario as we are changing the port values only.

Though I believe it will work but please let me know if it is not.

Is This Answer Correct ?    0 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

Define mapplet?

834


explain one complex mapping with logic? sales project?

6430


Mine is Insurance Domain, So interviewer asked about terms like underwriting, disbursement amt, Reinsurance

1812


1. When u r checking out what ll happens for version no? a. Increase b. decrease c.reset to 0 d. reset to 1 e. no change 2. Salary of all employees needed to add with the commision. What transfrmation to be used? a. SQ and Expression b. SQ c. Update Strategy d. Expression 3. Which of the task is used to run a session based on success of the other session? a. Decision b. Event wait c. Email d. Command e. None 4. Types of sources in Informatica? a. Homogenous n Heterogenous b. None c. Cobol n XML d. Flat files e. Flat files and Homogenous n Heterogenous 5. Servers are available in informatica? a. Informatica Server and Workflow server b. Informatica Server and Informatica Repository Server c. Informatica Server d. Workflow server e. Informatica Repository Server 6. While using Pmcmd in cmd line mode, each command must include the connection info of which of the following? a. workflow manager b. Power Center server c. Workflow monitor d. Repository manager e. Designer 7. Workflow montior displays workflows that have run a. once b. twice c. never d.four times e. thrice 8. Mode for handling sessions n workflows? a. server mode b. Wait mode c. Command line mode d. User mode e. Interactive mode 9. Connection details configured in? a. Mapping designer b. Workflow manager c. Workflow monitor d. Repository manager e. Worklet designer Thanks in Advance

3977


What is event and what are the tasks related to it?

857


what is song in infrmatica...?

1951


HAI FRIENDS THIS KISHORE FROM KUMBAKONAM. I HAVE COMPLETED MY MCA IN SASTRA UNIVERSITY WAITING FOR MY 6 TH SEM RESULT.DURING MY PROJECT I HAVE DONE INFORMATICA COURSE AS MY AREA INTEREST COURSE IN CORE MIND TECHNOLOGIES CHENNAI.I HAVE ENQUIRY ABT ALL IT PEOPLE FOR DATAWAREHOUSING THERE IS NO OPENING FOR FRESHERS. WITH SOME EXPERIENCE ANY OTHER DOMAIN TNEN ONLY U CAN GET THAT DOMAIN(DATAWAREHOUSING) JOB.BUT I AM MORE INTEREST ON THAT TO WORK ON THAT DOMAIN(INFORMATICA).WHAT TO I DO. I AM IN HELPLESS FRIENDS/EXPORTS.WAITING FOR REPLY

1928


Can informatica load heterogeneous targets from heterogeneous sources?

963


Where is metadata stored?

823


can u give example for factless fact table

6006


What is dimensional table? Explain the different dimensions.

950


Explain the difference between mapping parameter and mapping variable?

831


What is a router transformation?

863


is it possible to index the data in cache of lkp transformation ?

1766


I have worked on Informatica 7.1.1. I want to know the answer for the below question. Target is not created initially.Then how to take the DDL script from the source and run the Mapping by creating the Target dynamically?Is it possible by SQL Transformation?

1698