generate Unique sequence numbers for each partition in session with Unconnected Lookup ?
Hi All,
Please help me to resolve the below issue while Applying partitioning concept to my Session.
This is a very simple mapping with Source, Lookup , router, and target.
I need to Lookup on the target and compare with the source data, if any piece of data is new then Insert, and If any thing change in the existed data then Update.
while Inserting the new records to the target table I'm generating sequence numbers with Unconnected lookup, by calling the maximum PK ID from the target table.
The above flow is working fine from last one year.
Now I wish to apply the Partitioning concept to the above floe(session)
At source I used 4 pass through partitions.(For Each partition different filter conditions to pull the data from source)
at Target I used 4 passthrough Partitions.
it is working fine for some data, but for some rows for Insert Operation , it is throwing Unique key errors, because while Inserting the data it is generating the same sequence key twice.
In detail : 1st row is coming from 1st partition and generated the sequence number 1 for that row.
2nd row is coming from 1st partition and generated the sequence number 2 for that row
3rd row is coming from the 2nd partition generated the sequence number 2 again for that row. (it must generate 3 for this row)
the issue is becuase of generating the same sequence numbers twice for different partitions.
Can any one Please help me to resolve this issue.
While Applying partitions how can I generate a Unique Sequence numbers from Unconnected lookup for Each partitioned data.
Regrads,
N Kiran.
Answer Posted / sufi
Most simple way to handle this type scenario is use DB Sequence Generator (write Stored Procedure) and Trigger on INSERT on top of it.
| Is This Answer Correct ? | 2 Yes | 0 No |
Post New Answer View All Answers
What is the need of etl tools?
What is a standalone command task?
I am not able to connect to the domain with the client although all services and databases are up and there is no network issue?
One of the optimizing technique to improve the session performance is push down optimization,by using push down optimization we push as much as transformation logic to source/target database,but this degrades the d/b performance,how to overcome this?
What is workflow monitor?
what is diff b/t sorter t/r and agg have the option sorter property...
How is Source Side push down optimization different to just providing a SQL override in Source qualifier transformation.
How can we use batches?
write a query to retrieve the latest records from the table sorted by version(scd)
Mention a few design and development best practices for informatica?
Can some one explain me about Telecommunications(wireless) project in Informatica? Thanks in advance
Slowly changing dimensions, types and where will you use them
What is meant by a domain?
What is rank transformation?
What do you understand by term role-playing dimension?