How to eliminate duplicates in FF and oracle both
Answers were Sorted based on User's Feedback
Answer / ravindra.15aug
In RDBMS we can write sql queary in Source qualifer by
using rowid, in sorter by using select distinct option, In
aggregator by using groupby, in Rank by using groupby.
In FF level also we can do except sql queary in source
qualifier.
| Is This Answer Correct ? | 9 Yes | 0 No |
Answer / akash
In addition to the above answers I will add one more option.
We can use expression to check whether a record is
repeating or not and set an output port as flag. For first
occurence of any record this flag is 1. Use router after
this with condition "i_FLAG = 1". This output will give
only unique records. Default output will give only
duplicate records.
Also we can use a filter after the above expression with
the condition "i_FLAG = 1"
| Is This Answer Correct ? | 3 Yes | 0 No |
Answer / priyank
For FF, place an Aggregator transformation, do a group by
on all the columns, it will remove the duplicates from the
flat file.
In Oracle, use distinct in SQ sql override to remove the
duplicates.
| Is This Answer Correct ? | 1 Yes | 0 No |
explain about session partitions ?
How can you differentiate between powercenter and power map?
What is the command used to run a batch?
what is the difference between stop and abort
Define mapping and session?
I have 4 columns in a table say, name ,address, salary and city. So based on distinct city names, i need to combine the other data and send it to a flat file. Distinct city names can be 4 or 5 or 6. So it has to dynamically generate flat files(4 or 5 or 6) corresponding to the city names.
If we have lookup table in workflow how do you trouble shhot to increase performance?
SOURCE NAME SAL GANGA 30000 RAJU 20000 PAVAN 25000 TARGET NAME SAL MAXSAL GANGA 30000 30000 RAJU 20000 30000 PAVAN 25000 30000 in mapping level how to achive that
how can we load starting with 11th record of a table from source to target
what is degenerated dimension
In indirect file loading, suppose we have less no.of flat files then we can enter files names manually in list file creation. If millions of files are there, how can we enter the flat file names in list file?
How to update or delete the rows in a target, which do not have key fields?