What is difference between partioning of relatonal target
and partitioning of file targets?
Answer Posted / isha_gtb
How to Partition Flat files?
Sessions can run on single or multiple nodes (in a grid). Row distribution depends on two factors –
Number of Threads
Number of Partitions
A. Flatfile Sources
Partitioning allowed for both Direct and Indirect type Flat file sources
Some Source Qualifier transformation with subsequent transformations like Joiner transformation (configured with sorted input) require sorted row order.
It is important to preserve the row order while distributing rows between partitions. This is to be achieved by setting an appropriate value for “Concurrent Read Partitioning” in Session properties.
B. Flatfile Targets
While writing a target, you can configure Informatica to write to different files one for each partition or you can configure to write data concurrently.
All these files can be merged to one file when the process completes as indicated in the merge type
To merge the files, you can either set below properties / write a post session command – Merge Type, Merge File Directory, Merge File Name
Informatica allow you to merge the target files in three different ways –
Sequential Merge – Informatica creates one output file for each partition and sequentially merge them to a single file when the session completes
Concurrent Merge – Informatica writes the output data for all partitions concurrently on to one merge file. Sorting order will not be preserved in this type of merge
File List – Informatica creates and write one output file for each partition and write the file directory and file name to a separate list file.
Ref :
http://etllabs.com/informatica/informatica-partitions/4810/
| Is This Answer Correct ? | 1 Yes | 0 No |
Post New Answer View All Answers
Explain sessions. Explain how batches are used to combine executions?
can you please explain me pre session and post session options?
Explain the pipeline partition with real time example?
What is workflow? What are the components of workflow manager?
I have worked on Informatica 7.1.1. I want to know the answer for the below question. Target is not created initially.Then how to take the DDL script from the source and run the Mapping by creating the Target dynamically?Is it possible by SQL Transformation?
What is the difference between a connected look up and unconnected lookup?
How to extract the informatica rejected data?
How do you load unique records into one target table and duplicate records into a different target table?
What happen if you have 3 ports in SQ and 4 ports in SQL override of SQ( provided all ports are in same order and they are connected with proper source and target)? Also what happens when I have 4 ports and will extract 3 values in SQloverride.. What will be the value in 4th port ?
What do you mean by channel change?
Clarify the utilization of aggregator cache record?
how many types of dimensions are available in informatica?
Explain sql transformation in script mode examples in informatica
Slowly changing dimensions, types and where will you use them
Enlist few areas or real-time situations where informatica is required.