Answer / pavan

1. Balance Optimization :
DS8.5: Balanced Optimization is that to redesign the job automatically with maximize performance by minimizing the amount of input and output performed, and by balancing the processing against source, intermediate, and target environments. The Balanced Optimization enables to take advantage of the power of the databases without becoming an expert in native SQL.
DS8.7: No Change
DS9.1: Balanced Optimization for Hadoop.








2. Transformer Enhancements
DS8.5: Looping in the transformer, Multiple output rows to be produced from a single input row. 1. New input cache: SaveInputRecord(), GetSavedInputRecord().
         2. New System Variables: @ITERATION, @Loop Count, @EOD(End of data flag for last row).
         3. Functions : LastRowInGroup(InputColumn).
         4. Null Handling more Options.
DS8.7: No Change
DS9.1: New Transformation Expressions has been added. EREPLACE :  Function to replace substring in expression with another substring. If not specified occurrence, then each occurrence of substring will be replaced.








3. Big Data File Stage :
DS8.5: Not Exist
DS8.7: Big Data File Stage for Big Data sources (Hadoop Distributed File System-HDFS).
DS9.1: New Enhancement on
1. The IBM Big Data Solution Integrate and manage the full variety, velocity and volume of data.
2. New Hadoop-based Big Data Support Any to Big Data.
3. Big Data Integration with DataStage.




4. Added Java Integration Stage
DS8.5: Not Exist
DS8.7: Not Exist
DS9.1: Java code and creates baseline for upcoming big data source support.


5. Added Unstructured text stage
DS8.5: Not Exist
DS8.7: Not Exist
DS9.1: Excel read capabilities on all platforms with rich features to support ranges, multiple worksheets and New Unstructured data read

What is size of a transaction and an array means in a datastage?

0 Answers  

---

how can we create tables in datastage?

1 Answers  

---

What is the purpose of interprocessor stage in server jobs?

0 Answers   ASD Lab,

---

what is materialized view used datastage?

1 Answers   HSBC,

---

HOW U CAN ABORT THE JOB IF THE DATA IS DUPLICATE?

1 Answers   IBM,

---

how to get the unique records on multiple columns by using sequential file stage only

3 Answers  

---

8000 jobs r there i given commit, suddenly job will abort? what happens? 2)diff b/t transformer stage & filter stage? 3)how to load the data in the source?

0 Answers   Wipro,

---

types of errors in datastage?

2 Answers   Reliance,

---

which is more expensive hash or modulus partitioning? when do you use modulus partitioning?

2 Answers   TIAA CREF,

---

why we use parameters instead of hard code in datastage

4 Answers   HCL,

---

I/p : F1 table have A,B,C,D,E and F2 table having C,E,V i need output 0utput1: ABD output2: V any one suggest me this

0 Answers  

---

In a batch if a job fails in between and you want to restart the batch from that particular job and not from the scratch then what will you do?

0 Answers  

---