Hi guys,
In sequencer job,
we have 3 sources, in that 1st source have some records,
Here requirement is 1st source records are 100 then only run
the job otherwise total job will abort...
How to calculate this. please design the job.
Thanks.
Answer / anil
Hi,
We can do it with one seq job and one parallel job
First create parallel job (p1) that calculates aggregate count. If aggregate count is less than 100 then abort the parallel job
Paralled Job Design(P1)
1. Take the data from source.
2. Add a column generator with column name as Temp and its value as A
3. Add aggregrator stage, where group by column is Temp and calculation is count rows. So after aggregation, count will be calculated and stored in Total Count column.
4. In the transformer, add a constraint for output link to a peak stage saying totalcount < 100 and abort after 1 row.
SO if count is greater than 100, parallel job (P1) is successful, Else failed
Sequence Job
1. Add parallel job(p1) to the sequence and add exception handler and terminator activity stage.
2. After P1 you can create whatever sources you want to as a each parallel job.
3. Add automatically handle failed activities in the sequence job properties
Now if P1 fails, sequence fails else rest will run.
| Is This Answer Correct ? | 2 Yes | 0 No |
how to remove duplicates in transformer stage by using stage variables?one example?
How many number of reject links merge stage can have?
how do u reduce warnings
HOw Hash Partion Works Thank you in Advance i have doubts on Hash Partion TEch Could please give me the clear understandable notation example e_id,dept_no 1,10 2,10 3,20 4,20 5,30 6,40 i have TWo Nodes/Three Nodes My questions are: 1).if i select hash key as e_id how Hash partion will distribute the data in to two NOdes/three NOdes 2).if i select hash key as dept_no how Hash partion will distribute the data in to two NOdes/three NOdes sivakumar.katta7@gmail.com
What is the Environment Variable need to Set to TRIM in Project Level?(In transfermer, we TRIM function but I need to impliment this project level using Environment variable)
can a fact table contains textual information
6 Answers HCL, HCL BSERV, IBM,
how to connect source to db?generally what r stages u used? how to find the data is having delimiter format?
A job is having only 2 stages I/p dataset and target table.Job is taking very long time to load 50 million records.How to improve performance of this job.
What is the method of removing duplicates, without the remove duplicate stage?
What is active and passive stage?
What is ibm datastage?
whats difference between ls -ltr and ls -lrt?