I have Seq file, I don't want 10, 11th(or any two records like 20, 30th records ) records in the output
Answers were Sorted based on User's Feedback
Answer / subbuchamala
SeqFile---->Tranfrmr----->TGT
in Seq file we can add 'ROW NUMBER COlumn' as ROW_NUM which will numbers to each row.
we add 2 parameters to the job: RowNum1, RowNum2
in transformer, in the constrain we can specify below condition:
ROW_NUM<>RowNum1 OR ROW_NUM<>RowNum2
then we can skip those two records.
| Is This Answer Correct ? | 11 Yes | 0 No |
Answer / subhash (subbuchamala)
If we use @INROWNUM, then we have to run transformer on 'single' NODE.
| Is This Answer Correct ? | 8 Yes | 0 No |
Answer / ankit gosain
Hi,
You can block any specified record(s) from the source seq.
file with the help of a Transformer Stage.
Source Seq. File ----> Transformer ---->Target Seq. File
Now, in Transformer stage create a Stage Variable (say
row_num) & initialize it with ZERO.
In it's derivation, just increment it by ONE (i.e.
row_num+1)
Now, Insert a new column in the output & it's derivation,
assign the variable (row_num).
Now, in the contraint tab wirte row_num<>10 OR row_num<>11
If you have some other doubts or queries, you can mail me
on ankitgosain@gmail.com
Cheers,
Ankit :)
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / srinivas
We can do it by using filter option in sequencial file by using sed command
sed '10d;11d' filename then you will get required output
| Is This Answer Correct ? | 1 Yes | 0 No |
Answer / sushil
SeqFile---->Tranfrmr----->TGT
To number of rows in a sequential file in Transformer we
can use @INROWNUM, store value in variable ROW_NUM and then
by providing condition as same condition as:
ROW_NUM = '10' and ROW_NUM = '11' we can skip such records.
| Is This Answer Correct ? | 0 Yes | 0 No |
5) A file contains 10 (1-10) I want trgt like Trgt 1 trgt 2 trgt 3 1 2 3 4 5 6 7 8 9 10
If there is a file that contains 1000 records, I need the ouput to contain these 1000 records with the header as file name concatenated with the current timestamp and trailer as the count of records
Two source files contains same meta data third file contains different data types can I funnel that file.
What is the Environment Variable need to Set to TRIM in Project Level?(In transfermer, we TRIM function but I need to impliment this project level using Environment variable)
how can we join one oracle & flat files ?
i have seq file that contents 10 million records load to target any data base.. in that case it takes lot of time for loading..how do performance tuning in that situation...?
What is a datastage job?
what is the use of DSattchJob?DetachJob? where can we find it?
HOw Hash Partion Works Thank you in Advance i have doubts on Hash Partion TEch Could please give me the clear understandable notation example e_id,dept_no 1,10 2,10 3,20 4,20 5,30 6,40 i have TWo Nodes/Three Nodes My questions are: 1).if i select hash key as e_id how Hash partion will distribute the data in to two NOdes/three NOdes 2).if i select hash key as dept_no how Hash partion will distribute the data in to two NOdes/three NOdes sivakumar.katta7@gmail.com
Hi dude, i/p eno ename date edate deptno 1 x 10thjuly 30july A 2 y 10th aug 30 aug B 1 x 1aug ------ A 3 z 1jan ------ c 2 y 1sep ------ B o/p is eno ename date edate deptno 1 x 1aug ------ A 2 y 1sep ------ B 3 z 1jan ------ c Here edate is System generates we don't know that value. Please design the job by using SCD stage and Sql query. If any body know this answer please tel me. Tanks.
we run a job in 4 nodes,i want to run same job on 8 nodes is it possible? job recompling is mandtory?why?
how to cleansing data