Hi friends,
I have 100 records in my input file, if i run first,the
first 10 records are stored into the output and if i run
second time next 10 records stored into the output file like
that
please let me know the answer
Thanks,
krishna
Answers were Sorted based on User's Feedback
Answer / pujan patra
Use partion by round robin and block size will be 10 .It
will give the desired output
Is This Answer Correct ? | 19 Yes | 14 No |
Answer / jitender k
You can use I/F-->Reformat-->Rep-->Rollup-->lookup file
--> output_file
In reformat need to add next_in_sequence() >= lookup_match(lookup_file,count) and next_in_sequence() < lookup_match(lookup_file,count)+10
And in Rollup, we will have key as NULL and count function which will count the number of record process so far which stored in a separate file,so every time when your graphs runs it will pick from the next number of records.
Is This Answer Correct ? | 2 Yes | 1 No |
Answer / jerry
Hi,
You can create a graph with 2 parameters,say count1 and count2.
Now u can use a 'filter by' transform and give the filter
condition as
"next_in_sequence > count1 and next_in_sequence < count2".
U can give the value for parameters in the pset as 0,10
respectively.
this is just one way. :)
Is This Answer Correct ? | 6 Yes | 8 No |
Approach 1: Least Number of components. (only 3)
-----------
1. Declare a Parameter $COUNT to get the count of the Output file
2. Use that parameter in a FILTER BY EXPRESSION component after the input file. Use the below filter.
((next_in_sequence() + 1)/ 2 ) > $COUNT
and (next_in_sequence()/2 ) < (11 + $COUNT)
NOTE: The complicated logic above is used because of two next_in_sequence() functions which would be incremented by 2 for each record.
Alternative approach is to use a scan and local variables to create the sequence manually and use the appropriate filter. OR use two FILTER BY EXPRESSIONS, with the below filters:
next_in_sequence() > $COUNT
next_in_sequence() < 11
Approach 2:
-----------
1. Join the Output and Input file on all keys (or primary key if applicable)
2. Use a Filer component after the Unused port for the Input file. Filter should be next_in_sequence() < 11
Is This Answer Correct ? | 1 Yes | 4 No |
What are the reasons for which business can trust the approach of data processing?
What do you mean by a transaction file?
Difference between output_index and output_indexes in reformat
How will you use EME for view or publish metadata reports using EME?
Which component breaks the pipe line parallelism in graph?
11. What is the use of allocate()?
How is the partitioning with key different from round robin partition?
One file contains header,body,trailer records and header in a single row as well as trailer too.How to segregate these header,trailer and body records and once it gets segregated,i want to make the body data in reverse i.e if i have 10 body records,the 10th record should be the first record,9th record should be the second line,etc..
What are the facts that can compromise data integrity?
Can sorting and storing be done through single software or you need different for these approaches?
Need Ab-Initio Material - Harini
i have 2 files. First file contains a,b,c,d as rows and second file contains 1,2,3,4 as rows. how do we make single a1b2c3d4 and 4 different rows a1, b2, c3,d4.