Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...


Out of 4 mill records only 3 mill records are loaded to
target
and then job aborted. How to load only those 1 mill(not
loaded records) for next run.
This job is not sequential job, it is stand alone parallel
job.What are the possibilities available in datastage8.1?

Answers were Sorted based on User's Feedback



Out of 4 mill records only 3 mill records are loaded to target and then job aborted. How to load ..

Answer / prasanna

Use already loaded records TGT as reference lookup,and use
lookup stage,with DROP option..and design the job.u ll get
req answer. refer
.
.
sour.......>lookup......>tgt

Is This Answer Correct ?    7 Yes 4 No

Out of 4 mill records only 3 mill records are loaded to target and then job aborted. How to load ..

Answer / nish

there are plenty of options available.
just carefully study the scenario.

Source: 4 Mil records (doesn't change)
Target: 3 Million already loaded
Option1:
you just need to identify those 1Million pool them and then load to target.

This is clearly a case for Change Data Capture (CDC) stage.
use the Source As Before Table and Target as After.
Write those 1 Mil records based on change_code() (Deleted) to a file.
Move the contents of this file to target.

Option 2: This scenario also hints at updating the target with merge stage.use the DROP option to gather into a file and then update the target.

Option 3: Look Up being a performance concern should be your alternative.

Is This Answer Correct ?    2 Yes 0 No

Out of 4 mill records only 3 mill records are loaded to target and then job aborted. How to load ..

Answer / bharathq

Check point option is for only for sequence jobs,
but not for the parallel jobs.

Is This Answer Correct ?    1 Yes 0 No

Out of 4 mill records only 3 mill records are loaded to target and then job aborted. How to load ..

Answer / siva

Hi Chethan,can u elaborate ur answer?

Is This Answer Correct ?    0 Yes 0 No

Out of 4 mill records only 3 mill records are loaded to target and then job aborted. How to load ..

Answer / pranay

in target rdbms we can select insert rows which does not
exist

Is This Answer Correct ?    0 Yes 0 No

Out of 4 mill records only 3 mill records are loaded to target and then job aborted. How to load ..

Answer / chethankumar

just use checkpoint option

Is This Answer Correct ?    4 Yes 5 No

Out of 4 mill records only 3 mill records are loaded to target and then job aborted. How to load ..

Answer / venkatesh

first load the data using with surrogate stage
after that use filter stage and take that key of
surrogateand in lookup maintain the Drop option

Is This Answer Correct ?    2 Yes 8 No

Post New Answer

More Data Stage Interview Questions

I am defining one varaible parameter date in job parameters.I want use this variable date in where clause in source query.

2 Answers   TCS,


What is ibm datastage flow designer?

0 Answers  


How will you move hashed file from one location to another location?

0 Answers   NTT Data,


What are the functionalities of link partitioner and link collector?

0 Answers  


How many nodes supported by a one cpu in parallel jobs?

3 Answers   IBM,


Hi guys, Design job sequence, we have 3 sources, in that 1st source in abort then only run the remaining sources.. How please design the job. Thanks.

2 Answers   IBM,


SOURCE LIKE I_D,F1,F2 --------- 100,N,Y 100,N,N 100,Y,N 101,Y,Y 101,N,Y 102,Y,N 103,N,N 104,Y,Y 105,N,N 106,N,Y 102,N,Y 105,Y,Y O/P LIKE ID flag1 flag2 101 Y Y 101 N Y 102 Y N 102 N Y 104 Y Y 106 N Y

4 Answers  


my source is sequencial file and my target is dataset. i am running the job in two node configuration file. my source having 10 records how the data move to target?

3 Answers   TCS,


In my previous project we get data from mainframe and load it into datastage DB2 tables.Sometimes we get data as flat file or a mainframe tables itself directly we fetch the data.Is this a migration project?

1 Answers   TCS,


how to load meta data

2 Answers   IBM,


what is stage is used for below Input columns: dept|mgr|employee|salary Output columns: mgr|count of employee per mgr|avg salary per dept note: each dept has one mgr and each mgr has many employees

0 Answers  


If you want to use a same piece of code in different jobs, how will you achieve this?

0 Answers  


Categories