Answer / archana

1. Design & Runtime Performance Changes:
DS8.5: Implemented by Internal code change. Design and Runtime performance is better than 8.1, 40% performance improvement in job open, save, compile etc.
DS8.7: Improvements in Xmeta. Significant Performance improvement in Job Open, Save, Compile etc.
2. PX Engine Performance Changes :
DS8.5: Not Exist
DS8.7: Improved partition/sort insertion algorithm. XML parsing performance is improved by 3x or more for large XML files.
3. Added View Job Log in Designer client
DS8.5: Not Exist
DS8.7: New Feature has been added (Menu -> View -> Job Log) .
Job log is now viewed in Designer client.
5. Interactive Parallel Job Debugging
DS8.5: Not Exist
DS8.7: Breakpoints with conditional logic per link and node.
(Link -> Rclick -> Toggle Breakpoint)
The running job can be continued or aborted by using multiple breakpoints with conditional logic per link and node. (row data or job parameter values can be examined by breakpoint conditional logic)
6. Added Vertical Pivot : Pivot Enterprise Stage
DS8.5: Extended to current horizontal parallel pivot. Enhanced pivot stage to support vertical pivoting. (mapping multiple input rows with a common key, to a single output row containing multiple columns)
DS8.7: No Change
7. Balance Optimization :
DS8.5: Balanced Optimization is that to redesign the job automatically with maximize performance by minimizing the amount of input and output performed, and by balancing the processing against source, intermediate, and target environments. The Balanced Optimization enables to take advantage of the power of the databases without becoming an expert in native SQL.
DS8.7: No Change
8. Transformer Enhancements
DS8.5: Looping in the transformer, Multiple output rows to be produced from a single input row. 1. New input cache: SaveInputRecord(), GetSavedInputRecord().
2. New System Variables: @ITERATION, @Loop Count, @EOD(End of data flag for last row).
3. Functions : LastRowInGroup(InputColumn).
4. Null Handling more Options.
DS8.7: No Change
9. Big Data File Stage :
DS8.5: Not Exist
DS8.7: Big Data File Stage for Big Data sources (Hadoop Distributed File System-HDFS).
11. Added Encryption Techniques
DS8.5: Not Exist
DS8.7: Encrypted because of security reasons.
1. Strongly encrypted credential files for command line utilities.
2. Strongly encrypted job parameter files for dsjob command.
3. Encryption Algorithm and Customization.

Can you implement SCD2 using join, transformer and funnel stage?

0 Answers   Cognizant,

---

WHERE YOU USE UNIX COMMANDS AS A ETL DEVELOPER?

2 Answers   Wipro,

---

Create a job to load all unique products in one table and the duplicate rows in to another table. The first table should contain the following output A D The second target should contain the following output B B B C C Q2. Create a job to load each product once into one table and the remaining products which are duplicated into another table. The first table should contain the following output A B C D The second table should contain the following output B B C

3 Answers   Deloitte, IBM,

---

How can we improve performance of data stage jobs?

0 Answers  

---

types of errors in datastage?

2 Answers   Reliance,

---

Explain usage analysis in datastage?

0 Answers  

---

I have a few records all are same structures data, I want to store data in multiple targets how?

4 Answers   Polaris,

---

in job of 30 one job is very slow due to this entire job is very slow how can u know which job is slow?

0 Answers   IBM,

---

Field,NVL,INDEX,REPLACE,TRANSLATE,COLESC

0 Answers   CTS,

---

How to Remove Duplicate using SQL?

0 Answers   CTS,

---

How to transfer file from one system to another system in UNIX?which command to be use?

4 Answers   Cap Gemini, TCS,

---

In which situations we can use normal and sparse lookup stages

4 Answers   IBM,

---