I have Seq file, I don't want 10, 11th(or any two records like 20, 30th records ) records in the output
Answers were Sorted based on User's Feedback
Answer / subbuchamala
SeqFile---->Tranfrmr----->TGT
in Seq file we can add 'ROW NUMBER COlumn' as ROW_NUM which will numbers to each row.
we add 2 parameters to the job: RowNum1, RowNum2
in transformer, in the constrain we can specify below condition:
ROW_NUM<>RowNum1 OR ROW_NUM<>RowNum2
then we can skip those two records.
| Is This Answer Correct ? | 11 Yes | 0 No |
Answer / subhash (subbuchamala)
If we use @INROWNUM, then we have to run transformer on 'single' NODE.
| Is This Answer Correct ? | 8 Yes | 0 No |
Answer / ankit gosain
Hi,
You can block any specified record(s) from the source seq.
file with the help of a Transformer Stage.
Source Seq. File ----> Transformer ---->Target Seq. File
Now, in Transformer stage create a Stage Variable (say
row_num) & initialize it with ZERO.
In it's derivation, just increment it by ONE (i.e.
row_num+1)
Now, Insert a new column in the output & it's derivation,
assign the variable (row_num).
Now, in the contraint tab wirte row_num<>10 OR row_num<>11
If you have some other doubts or queries, you can mail me
on ankitgosain@gmail.com
Cheers,
Ankit :)
| Is This Answer Correct ? | 2 Yes | 1 No |
Answer / srinivas
We can do it by using filter option in sequencial file by using sed command
sed '10d;11d' filename then you will get required output
| Is This Answer Correct ? | 1 Yes | 0 No |
Answer / sushil
SeqFile---->Tranfrmr----->TGT
To number of rows in a sequential file in Transformer we
can use @INROWNUM, store value in variable ROW_NUM and then
by providing condition as same condition as:
ROW_NUM = '10' and ROW_NUM = '11' we can skip such records.
| Is This Answer Correct ? | 0 Yes | 0 No |
How to create user defined environment varibale(parameter)?
What's the Main Function of the Staging area in DWH
how to call sequential generator in datastage?
diff between OLTP and OLAP? what TOP-DOWN and BOTTOM-UP Approach? which is best? what are Star Schema and Snow Flake Schema?
How do u view log file for a particular job?
How to remove duplicates in transformer stage? in parallel mode
What is the difference between validate and compile?
What are the functionalities of link collector?
What are the different type of jobs in datastage?
1)What is ur project architecture ? 2)how to move project from developement to uat? 3)What is the difference between datastage 6,7.1 and datasttage 7.5? 4).How to do error handling in datastage? 5)3.Whta is unit testing, system testing and integration testing? 6)What is the Exact difference between BASIC Transformer and NORMAL Transformer?When we will go for BASIC Or NORMAL Transformer 7)why we use third party tools in datastage? 8)What is the purpose of Debugging stages? In real time Where we will use?
6 Answers CTS, HCL, IBM, Wipro,
tell me 5 situations when we r using oracle db stages like orecle connector, oracle enterprise
How do you design PX Routines ?