How to exclude first and last lines while reading data into a sequential file(having some 1000 records).I guess probably by using unix filter option but not sure which to use
Answers were Sorted based on User's Feedback
Answer / sam
In sequential file stage, properties tab --- options -- filter
At filter type unix command -- sed '1d;$d'
| Is This Answer Correct ? | 8 Yes | 0 No |
In order to exclude the contents while reading from the
sequential file stage we have to use the filter option.
There we have to specify the unix command:
Sed -e '1d' -e '$d' <filename>
| Is This Answer Correct ? | 8 Yes | 1 No |
In sequential file stage use the filter in the options
In filter use sed '1d;$d'
You can use sed '<start>,<end>d' to delete particular rows and use sed -n '<start>,<end>p' to keep particular rows
| Is This Answer Correct ? | 1 Yes | 0 No |
Answer / shiv
Sreenu is also right, but we have another option as well.
Use head and tail stages in datastage like this:
Seq_File-->Tail_stage--->Head_Stage---->Dataset(Target)
in this way first u can exclude the first record using tail specify 999 record in tail stage, then u can exlclude last record by using head stage.(998 top records).
| Is This Answer Correct ? | 1 Yes | 2 No |
Well if must use filter option in sequential stage then
the Ans is:
head -n 10 'FileName' | tail -n 8
explanation:
suppose if ur file has 10 records + column name then total
lines are 11.
col1
1
2
3
4
5
6
7
8
9
10
head -n 10 will fetch column name + 9 records
and
tail -n 8 will fetch 2 to 9 records excluding colname and
1st record.
like :
2
3
4
5
6
7
8
9
Thats it.
| Is This Answer Correct ? | 0 Yes | 2 No |
how can we create rank using datastage?what is the meaning of rank?
what is normalization and denormalization
can any 1 put a difference between datastage 7.5 and 8.0 all concepts plz r mail 2 me anu4u09@gmail.com
1.How to read multiple file from sequential stage. 2.If a file doesn't arrive or doesn't exists in sequential stage how do u handle this. 3.What do you do before taking data from source to staging area. 4. I have a remove duplicate stage and transformer stage.what will u do for optimizeing the performance of the job.
How many types of views are there in a datastage director?
Pls tell me what is troubleshooting in datastage view?
AGGREGATOR default datatype
What is the roundrobin collector?
how to use self join using datastage ? can u tell me using stage how can we implemnet the self join
How will you load you daily/monthly jobs datas in to Fact and Dimension table using datastage.
1.which index is follows the dimensions tables?why? 2.what is the use of trigger in job sequence? 3.what is the mean of optimization? 4.what is the job control?when we use it? what is difference bet batch and sequencer? 6.seq--->seq,seq--->copy--->seq which one is best and efficient?
How to create a file using vi editor? 2)how to delete a file in vi editor? 3)How to connect the server datastage to unix? what r the command lines we r using? 4)30 jobs r runnig in unix i want to find out my job. how to do this? give me command?