how to get the unique records on multiple columns by using
sequential file stage only
Answers were Sorted based on User's Feedback
Answer / chandu
in sequential file there is one option is there i.e
filter.in this filter we use unix commands like what ever we
want.in this question we use uniq command in filter.
| Is This Answer Correct ? | 7 Yes | 0 No |
Answer / todearhari
Just a small correction to Above Answer ,First we need to sort the Data then use the Uniq then only you will get Complete uniq records as uniq compares line by line.
Command:
Sort |Uniq
| Is This Answer Correct ? | 2 Yes | 0 No |
What is the difference between the local container and shared container?
1.What is a delta record? How you will read it? 2.What are the different types of sorting?
my source seq file have col1 1 2 3 4 5 6 7 8 9 i have 4 targets t1 t2 t3 t4 1 2 3 4 5 6 7 8 9 like this how we can get?
How to Convert a string function to date function by using only sequential file stage with out using other stages ?
What is Fastly Changing Dimension?
1)s.key generate 1 to 700 records today. tomorrow another 400 will updated how to update the records using s.key generator? 2)source is like :-- DB --> T/F stage1 --> seq1file T/f 1 is linking with T/F2 ---> seq 2 how to load the data? in source i given some conditions those r going in seq1. The another data will going to seq2 how to do this ?
What are the different types of lookups in datastage?
1)How to do error handling in datastage? 2)Did sequential stage accepts .xl files ,xml? znd how?
IS FILE SET CAN SUPPORT I/P AND O/P LINK AT A TIME?
in sequtial file 2 columns avaliable, i want only one column load the target. for this we can do by modify and copy stage. But here when using modify stage (in property drop column1) until it is ok. if target is data set How to view the data. with out using data management. what is the reason for this. if any body know this answer plz tel me. thanks.
parallel jobs run on cluster machines. server jobs run on smp and mpp. What do mean by cluster mechines and SMP and MPP..?
create a job that splits the data in the Jobs.txt file into four output files. You will direct the data to the different output files using constraints. • Job name: JobLevels • Source file: Jobs.txt • Target file 1: LowLevelJobs.txt − min_lvl between 0 and 25 inclusive. − Same column types and headings as Jobs.txt. − Include column names in the first line of the output file. − Job description column should be preceded by the string “Job Title:” and embedded within square brackets. For example, if the job description is “Designer”, the derived value is: “Job Title: [Designer]”. • Target file 2: MidLevelJobs.txt − min_lvl between 26 and 100 inclusive. − Same format and derivations as Target file 1. • Target file 3: HighLevelJobs.txt − min_lvl between 101 and 500 inclusive. − Same format and derivations as Target file 1. • Rejects file: JobRejects.txt − min_lvl is out of range, i.e., below 0 or above 500. − This file has only two columns: job_id and reject_desc. − reject_desc is a variable-length text field, maximum length 100. It should contain a string of the form: “Level out of range: <min_lvl>”, where <min_lvl> is the value in the min_lvl field. My Question is how do you write the stage variable for reject rows.