3,if our source containing 1 terabyte data so while loading
data into target what are the thing we keep in mind?
Answers were Sorted based on User's Feedback
Answer / chinni
1tera data is huge amount of data so if we use normal load
type it takes so much of time....to overcome this better to
use bulk loading...and also taking the large commit
intervals we can get good performance....and one more
technique is external loading.....
| Is This Answer Correct ? | 9 Yes | 1 No |
I agree with you Chinni.
But my suggestion is instead of loading huge amount of data
at a time,we can always split the source if it is a file
using unix and extract the data from all the source files
using indirect type and load into target.
Please let me know if you have any suggestions.
Thanks.
James.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / chiranjeevi k
We can use push down optimizationto to handle the huge
volume of data.
Thanks
Chiranjeevi
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / bakshu shaik
one more thing we need to take into consideration, along with above suggestions:
If the target having an index, Loading time (huge amount of data) increases/performance hazard......so it's always better to drop the index before loading(Stored procedure transformation) and create again after loading completed...!
| Is This Answer Correct ? | 0 Yes | 0 No |
Along with the above suggestions......
Better to use partitioning (single or multiple thread) and and increase the commit level to 50 lacs. Better to load first flat file instead of loading into table.
then if u r db is oracle better to use sql loader to load data from file to table.If DB2 than use db2 loader.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / upendra
large amount of data in source file.So we can devide partitions and commit level ur own wish,then connected to different target table, each one target table better for bulk load.
| Is This Answer Correct ? | 0 Yes | 0 No |
How can we improve session performance in aggregator transformation?
Differentiate between joiner and lookup transformation?
Different types of Power center errors?
On a day, I load 10 rows in my target and on next day if I get 10 more rows to be added to my target out of which 5 are updated rows how can I send them to target? How can I insert and update the record?
if we have input eno 1,2,3,1,2,3 year 2001,2002,2003,2001,2002,2003 and sal 10000,20000,30000,20000,30000,40000 ex-output eno totsal 1 30000 2 50000 3 70000
what are surrogate keys?
What are the components of workflow manager?
hi guys i have an question how do you find out weather the column is numeric or combination of char and numbers or it contains char,numeric and special characters.
write a sql query following source? subject mark maths 30 science 20 social 80 requird output maths science social 30 20 80
What is a shortcut and copy in Informatica and how two are different with each other?
write a query to get maximum salary from the employers table without duplicates....kindly help me
HOE DO U IMPLIMENT SCHEDULING IN INFORMATICA?