Answer Posted / rohit babar

There are 3 ways by which we can remove the duplicate records
1. By using remove duplicate stage. We have control here on which record we want to remove it's first or last. There is option record to retain in remove duplicate stage where we select first or last option.

2. By using sort stage. there is option allow duplicate in sort stage. We set this option true when we want duplicate records & If we want unique records we set it to the false

3. By in-line sorting. In Partition tab of any stage when we select key base partition tech. then perform sort option will enable if we check this option next 2 option will enable which is stable & unique if we select stable that means we allow duplicate records & if we select unique that means we remove duplicate records and getting unique records

What is the method of removing duplicates, without the remove duplicate stage?

954

---

What are the components of ascential data stage?

1110

---

Which warehouse using in your datawarehouse

2113

---

Could anyone give brief explanation bout datastage admin

2310

---

Describe the architecture of datastage?

949

---

how to abort the job its matain duplicates?

2531

---

what is the use of skid in reporting?

2307

---

what are the devoleper roles in real time? plz tell i am new to datastage....

2094

---

What are the steps required to kill the job in Datastage?

1148

---

What is difference between symmetric multiprocessing and massive parallel processing?

1078

---

how to sort two columns in single job in datastage.

2840

---

What are the job parameters?

1156

---

On which interface you will be working as a developer?

985

---

create a job that splits the data in the Jobs.txt file into four output files. You will direct the data to the different output files using constraints. • Job name: JobLevels • Source file: Jobs.txt • Target file 1: LowLevelJobs.txt − min_lvl between 0 and 25 inclusive. − Same column types and headings as Jobs.txt. − Include column names in the first line of the output file. − Job description column should be preceded by the string “Job Title:” and embedded within square brackets. For example, if the job description is “Designer”, the derived value is: “Job Title: [Designer]”. • Target file 2: MidLevelJobs.txt − min_lvl between 26 and 100 inclusive. − Same format and derivations as Target file 1. • Target file 3: HighLevelJobs.txt − min_lvl between 101 and 500 inclusive. − Same format and derivations as Target file 1. • Rejects file: JobRejects.txt − min_lvl is out of range, i.e., below 0 or above 500. − This file has only two columns: job_id and reject_desc. − reject_desc is a variable-length text field, maximum length 100. It should contain a string of the form: “Level out of range: ”, where is the value in the min_lvl field. My Question is how do you write the stage variable for reject rows.

2670

---

What are the functionalities of link partitioner?

971

---