Eliminating of duplicate records without using dynamic lookups
Answers were Sorted based on User's Feedback
Answer / pooja ahmed
1. you can you use sorter transformation .... in that you
select distinct option
2. use agg trans .... in that go for group by
usi8ng above metyhod you can remove duplicate rec...
| Is This Answer Correct ? | 6 Yes | 0 No |
Answer / bsgsr
duplicate records can be eliminated the following ways:
1) by using select distinct option
2) by over riding sql with group by port on the column
which gets duplicate values ( P_key column)
3) by connecting the source to an expression transformation
and flagging the duplicate records to another target by
writing an expression in the exp editor
| Is This Answer Correct ? | 3 Yes | 0 No |
Answer / raghav
with out distinct we can do it in 3 possible ways.
1. Using Group by function which will act like a distinct in
TD13.0 database
2. using SET table concept, like first we create the multi
set table and insert the duplicate rows into them and then
create the set table and use the insertselcet concept, in
this case only distinct rows will be inserted.
3. use rowid, derived table or sub query concept then we can
do this
| Is This Answer Correct ? | 1 Yes | 0 No |
Difference between flat files and relational sources?
What is data modeling and data mining?
How many types of transformations supported by sorted input?
how to join two tables without using joiner transformation .advantages of joiner over lookup and vice versa.
what is architecture of your datastage project??? i came across this question many times in interviews in specific what can i answer plz help me.
How to recover a workflow? What are the different approaches?( In prod i.e no access to modify)
0 Answers IBM, Saama Tech, Wipro,
What is tracing level and what are the types?
how do u estimate the number of partitions that a mapping really requires? Is it dependent on the machine configuration?
Explain about enterprise scalability and roi of data integration suite?
What is partitioning? Explain different types of partitioning?
what is pmrep command?
how do u identify the changed records in operational data?