What is difference between partioning of relatonal target
and partitioning of file targets?
Answer Posted / isha_gtb
How to Partition Flat files?
Sessions can run on single or multiple nodes (in a grid). Row distribution depends on two factors –
Number of Threads
Number of Partitions
A. Flatfile Sources
Partitioning allowed for both Direct and Indirect type Flat file sources
Some Source Qualifier transformation with subsequent transformations like Joiner transformation (configured with sorted input) require sorted row order.
It is important to preserve the row order while distributing rows between partitions. This is to be achieved by setting an appropriate value for “Concurrent Read Partitioning” in Session properties.
B. Flatfile Targets
While writing a target, you can configure Informatica to write to different files one for each partition or you can configure to write data concurrently.
All these files can be merged to one file when the process completes as indicated in the merge type
To merge the files, you can either set below properties / write a post session command – Merge Type, Merge File Directory, Merge File Name
Informatica allow you to merge the target files in three different ways –
Sequential Merge – Informatica creates one output file for each partition and sequentially merge them to a single file when the session completes
Concurrent Merge – Informatica writes the output data for all partitions concurrently on to one merge file. Sorting order will not be preserved in this type of merge
File List – Informatica creates and write one output file for each partition and write the file directory and file name to a separate list file.
Ref :
http://etllabs.com/informatica/informatica-partitions/4810/
| Is This Answer Correct ? | 1 Yes | 0 No |
Post New Answer View All Answers
Do you find any difficulty while working with flat files as source and target?
what is the Default Source Option For Update Strategy Transformation?
What is main use of mapplet?
Explain the types of transformations?
What is a joiner transformation and why it is an active one?
what is the hint? how to use it to reduce the query processing in program?
What is the function of aggregator transformation?
What is the difference between power center and power mart? What is the procedure for creating independent data marts from informatica 7.1?
To import the flat file definition into the designer where should the flat file be placed?
What is the difference between source qualifier transformations source filter to filter transformation?
How would you copy the content of one repository to another repository?
What is a difference between complete, stop and abort?
Explain about cumulative Sum or moving sum?
What do think which one is the better joiner or look up?
Name at least 5 different types of transformations used in mapping design and state the use of each.?