How to exclude first and last lines while reading data into a sequential file(having some 1000 records).I guess probably by using unix filter option but not sure which to use
- 6 Answers
- 28858 Views
- IBM, I also Faced
- E-Mail Answers
Answers were Sorted based on User's Feedback
Answer / sam
In sequential file stage, properties tab --- options -- filter
At filter type unix command -- sed '1d;$d'
| Is This Answer Correct ? | 8 Yes | 0 No |
In order to exclude the contents while reading from the
sequential file stage we have to use the filter option.
There we have to specify the unix command:
Sed -e '1d' -e '$d' <filename>
| Is This Answer Correct ? | 8 Yes | 1 No |
In sequential file stage use the filter in the options
In filter use sed '1d;$d'
You can use sed '<start>,<end>d' to delete particular rows and use sed -n '<start>,<end>p' to keep particular rows
| Is This Answer Correct ? | 1 Yes | 0 No |
Answer / shiv
Sreenu is also right, but we have another option as well.
Use head and tail stages in datastage like this:
Seq_File-->Tail_stage--->Head_Stage---->Dataset(Target)
in this way first u can exclude the first record using tail specify 999 record in tail stage, then u can exlclude last record by using head stage.(998 top records).
| Is This Answer Correct ? | 1 Yes | 2 No |
Well if must use filter option in sequential stage then
the Ans is:
head -n 10 'FileName' | tail -n 8
explanation:
suppose if ur file has 10 records + column name then total
lines are 11.
col1
1
2
3
4
5
6
7
8
9
10
head -n 10 will fetch column name + 9 records
and
tail -n 8 will fetch 2 to 9 records excluding colname and
1st record.
like :
2
3
4
5
6
7
8
9
Thats it.
| Is This Answer Correct ? | 0 Yes | 2 No |
What are the environmental settings for data stage,while working on parellel jobs?
How to remove ctrl M or(^M) characters in file using Sequential File stage?
2 Answers Bank Of America, Satyam,
I have a source table with column name CITY having 100 records, I want target table with column name start with 'A' and 'B',remaining columns as reject outputs. how can achieve this by data stage?please help me?????
what are fact tables and dimension tables? give example assuming one table.
EXPLAIN SCD
1.How to read multiple file from sequential stage. 2.If a file doesn't arrive or doesn't exists in sequential stage how do u handle this. 3.What do you do before taking data from source to staging area. 4. I have a remove duplicate stage and transformer stage.what will u do for optimizeing the performance of the job.
i have a job with 3 possibiliies finish with ststus ok abbort warning how do you handle these 3 in job sequence? explain the situation where you have appiled scd in your project? chandu
what is the use of materialized view?
What is container and then types?
explain unit testing,systemtesting,integrated testing
which unix commands mostly used in datastage
how to clear the source file? 2) diff b/t odbc & Oracle?what is node? 3) explain one complex job u face in ur project
Teradata 
