What is difference between partioning of relatonal target
and partitioning of file targets?
- 2 Answers
- 12108 Views
- I also Faced
- E-Mail Answers
Answer Posted / isha_gtb
How to Partition Flat files?
Sessions can run on single or multiple nodes (in a grid). Row distribution depends on two factors –
Number of Threads
Number of Partitions
A. Flatfile Sources
Partitioning allowed for both Direct and Indirect type Flat file sources
Some Source Qualifier transformation with subsequent transformations like Joiner transformation (configured with sorted input) require sorted row order.
It is important to preserve the row order while distributing rows between partitions. This is to be achieved by setting an appropriate value for “Concurrent Read Partitioning” in Session properties.
B. Flatfile Targets
While writing a target, you can configure Informatica to write to different files one for each partition or you can configure to write data concurrently.
All these files can be merged to one file when the process completes as indicated in the merge type
To merge the files, you can either set below properties / write a post session command – Merge Type, Merge File Directory, Merge File Name
Informatica allow you to merge the target files in three different ways –
Sequential Merge – Informatica creates one output file for each partition and sequentially merge them to a single file when the session completes
Concurrent Merge – Informatica writes the output data for all partitions concurrently on to one merge file. Sorting order will not be preserved in this type of merge
File List – Informatica creates and write one output file for each partition and write the file directory and file name to a separate list file.
Ref :
http://etllabs.com/informatica/informatica-partitions/4810/
| Is This Answer Correct ? | 1 Yes | 0 No |
Post New Answer View All Answers
Slowly changing dimensions, types and where will you use them
What is substr in informatica?
Hi, I want to change date type char value integer value? I tried alter table tab_name modify (newcolumn newdatetype). But The columns have 10 million values(char type) so I want to load now numeric data. How it is possible? Old Values New Value(I want to load numeric data but the old value should be there in the column) Y 1 N 0 ERROR at line 1: ORA-01439: column to be modified must be empty to change datatype Please help on this. Thanks, GM
explain about unit testing? in real time?
In development project what is the process to follow for an etl developer from day1
Explain the features of connected and unconnected lookup.
which one is better performance wise joiner or look up
r u done any partitions in ur project?
How to generate sequence numbers?
What is the format of informatica objects in a repository?
What is the way to execute pl/sql script using informatica mapping?
is there any way to read the ms excel datas directly into informatica?like is there any possibilities to take excel file as target?
Describe the scenarios where we go for joiner transformation instead of source qualifier transformation?
Describe expression transformation?
What are the types of caches in lookup?
