What is difference between partioning of relatonal target
and partitioning of file targets?
Answers were Sorted based on User's Feedback
Answer / swetha
If you parttion a session with a relational target
informatica server creates multiple connections o the
target database to write target data concurently.If you
partition a session with a file target the informatica
server creates one target file for each partition. yoU can
configure session properties to merge these target files.
| Is This Answer Correct ? | 6 Yes | 0 No |
How to Partition Flat files?
Sessions can run on single or multiple nodes (in a grid). Row distribution depends on two factors –
Number of Threads
Number of Partitions
A. Flatfile Sources
Partitioning allowed for both Direct and Indirect type Flat file sources
Some Source Qualifier transformation with subsequent transformations like Joiner transformation (configured with sorted input) require sorted row order.
It is important to preserve the row order while distributing rows between partitions. This is to be achieved by setting an appropriate value for “Concurrent Read Partitioning” in Session properties.
B. Flatfile Targets
While writing a target, you can configure Informatica to write to different files one for each partition or you can configure to write data concurrently.
All these files can be merged to one file when the process completes as indicated in the merge type
To merge the files, you can either set below properties / write a post session command – Merge Type, Merge File Directory, Merge File Name
Informatica allow you to merge the target files in three different ways –
Sequential Merge – Informatica creates one output file for each partition and sequentially merge them to a single file when the session completes
Concurrent Merge – Informatica writes the output data for all partitions concurrently on to one merge file. Sorting order will not be preserved in this type of merge
File List – Informatica creates and write one output file for each partition and write the file directory and file name to a separate list file.
Ref :
http://etllabs.com/informatica/informatica-partitions/4810/
| Is This Answer Correct ? | 1 Yes | 0 No |
Hi, I saw one mapping implemented by my seniors . In Expression transformation they implemented following logic. That is iif(is_date(in_UC_DATINV,'YYYYMMDD'),to_date(in_UC_DATINV,'Y YYYMMDD'),'Inventory Date is either invalid or null') Inventory_Date is validated only for is_date() But not validated for notisnull() . But error says “ either invalid or null “ why? Whether is_date() also check for not isnull() ? or in this logic something is different ? Please answer me . Advance thanks
Which files are created during the session rums by informatics server?
I have a scenario with router transformation. but i dont want to capture records from default group. how can we achieve this.
What is different between the data warehouse and data mart?
what is metadata?
There are n numbers of flatfile of exactly same format are placed in a folder .Can we load these flatfile's data one by one to a single relational table by a single session??
What is CDC? How to implement CDC?
What can we do to improve the performance of informatica aggregator transformation?
i having mapping emp---> sq_emp--->target using this mapping i have to load dept table values into target... (condition assume there is no primary and foreign key relation between emp(table x) and dept (table Y))
to improve the performance of aggregator we use sorted input option and use sorter t/r befor aggregator. But here we are increasing one more cache in our mapping i.e; sorter. So how can u convince that you are increasing the performance.?
what is the difference between look up and joiner(don't say joiner sopport only = where as look up support non-equijoin).
what is mapping optimization? wat are the techniques for tat