What is difference between partioning of relatonal target
and partitioning of file targets?
Answer Posted / isha_gtb
How to Partition Flat files?
Sessions can run on single or multiple nodes (in a grid). Row distribution depends on two factors –
Number of Threads
Number of Partitions
A. Flatfile Sources
Partitioning allowed for both Direct and Indirect type Flat file sources
Some Source Qualifier transformation with subsequent transformations like Joiner transformation (configured with sorted input) require sorted row order.
It is important to preserve the row order while distributing rows between partitions. This is to be achieved by setting an appropriate value for “Concurrent Read Partitioning” in Session properties.
B. Flatfile Targets
While writing a target, you can configure Informatica to write to different files one for each partition or you can configure to write data concurrently.
All these files can be merged to one file when the process completes as indicated in the merge type
To merge the files, you can either set below properties / write a post session command – Merge Type, Merge File Directory, Merge File Name
Informatica allow you to merge the target files in three different ways –
Sequential Merge – Informatica creates one output file for each partition and sequentially merge them to a single file when the session completes
Concurrent Merge – Informatica writes the output data for all partitions concurrently on to one merge file. Sorting order will not be preserved in this type of merge
File List – Informatica creates and write one output file for each partition and write the file directory and file name to a separate list file.
Ref :
http://etllabs.com/informatica/informatica-partitions/4810/
| Is This Answer Correct ? | 1 Yes | 0 No |
Post New Answer View All Answers
how many types of dimensions are available in informatica?
How can we handle two sessions in informatica?
What is a joiner transformation?
Explain what are the different versions of informatica?
What do you understand by term role-playing dimension?
How to improve the performance of a session using sorter transformation?
If I have 10 flat files with same name abc.txt files with different timestamps as source I need to load them in tgt table oracle. in between job execution fails and rows are not loaded into tgt. how can I make them load in that target even if my job fails?
I have three same source structure tables. But, I want to load into single target table. How do I do this? Explain in detail through mapping flow.
What is the different lookup cache(s)?
Explain the features of connected and unconnected lookup.
Where can we find the throughput option in informatica?
Briefly define a session task?
To Provide Support For Mainframes Source Data, which Files Are Used As A Source Definitions?
Have you worked with/created Parameter file
Mention some types of transformation?