3,if our source containing 1 terabyte data so while loading
data into target what are the thing we keep in mind?
- 7 Answers
- 8038 Views
- TCS, I also Faced
- E-Mail Answers
Answers were Sorted based on User's Feedback
Answer / chinni
1tera data is huge amount of data so if we use normal load
type it takes so much of time....to overcome this better to
use bulk loading...and also taking the large commit
intervals we can get good performance....and one more
technique is external loading.....
| Is This Answer Correct ? | 9 Yes | 1 No |
I agree with you Chinni.
But my suggestion is instead of loading huge amount of data
at a time,we can always split the source if it is a file
using unix and extract the data from all the source files
using indirect type and load into target.
Please let me know if you have any suggestions.
Thanks.
James.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / chiranjeevi k
We can use push down optimizationto to handle the huge
volume of data.
Thanks
Chiranjeevi
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / bakshu shaik
one more thing we need to take into consideration, along with above suggestions:
If the target having an index, Loading time (huge amount of data) increases/performance hazard......so it's always better to drop the index before loading(Stored procedure transformation) and create again after loading completed...!
| Is This Answer Correct ? | 0 Yes | 0 No |
Along with the above suggestions......
Better to use partitioning (single or multiple thread) and and increase the commit level to 50 lacs. Better to load first flat file instead of loading into table.
then if u r db is oracle better to use sql loader to load data from file to table.If DB2 than use db2 loader.
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / upendra
large amount of data in source file.So we can devide partitions and commit level ur own wish,then connected to different target table, each one target table better for bulk load.
| Is This Answer Correct ? | 0 Yes | 0 No |
write s sql query following table some duplicate present i want unique one column duplicate another column display? name id a 1 a 1 b 2 b 2 c 3 i want the required output like unique duplicate name id name id a 1 a 1 b 2 b 2 c 3
how i will stop my workflow after 10 errors
What is an active transformation?
Plz can anybody send Informatica and Cognos FAQ Plz To thid ID anil643@gmail.com (or) kumar643@gmail.com
What are the conditions needed to improve the performance of informatica aggregator transformation?
what is the architecture of any Data warehousing project?
when load type is selected as bulk or normal in session level ?let me know the internal process and give me an example?
What is Data Caches size?
Make a note of the quantity vaults made in informatica?
What is the functionality of update strategy?
What is the main purpose of Unconnected lookup other than updating slowly changing dimensions? or In which case u use Unconnected lookup?
What are the new features in Informatica 5.0?
Teradata 
