1.How to read multiple file from sequential stage.
2.If a file doesn't arrive or doesn't exists in sequential
stage how do u handle this.
3.What do you do before taking data from source to staging
area.
4. I have a remove duplicate stage and transformer
stage.what will u do for optimizeing the performance of the
job.
Answers were Sorted based on User's Feedback
Answer / varma
Ans1 : We can use Read Method = “Specific Files” and give the full path of all the file one by one. Alternatively, you can use Read Method = “File Pattern” and specify the wild card.
Ans 2: We can control this using “Missing File Mode” Option. Values are “Ok” to skip the file and continue and “Error” to abort the job.
Ans3: It is important to make sure the meta data matches the record. It would be better to reject bad reject and collect them in “Reject Link”. This can be controlled by “Reject Mode” option. Values are “Continue”, “Fail” and “Output”. “Output” will collect the reject records in a reject link.
Is This Answer Correct ? | 3 Yes | 0 No |
Answer / jayanthi
1)read method should be set as file pattern(for reading
single file it should be specificfile)
Is This Answer Correct ? | 2 Yes | 0 No |
Answer / ashok
4.in case of only for duplicates removing i will use remove
duplicate stage.but in case of more logics applied i will
go to transformer.bcoz remove duplicate stage give better
performance compare to transformer
Is This Answer Correct ? | 1 Yes | 2 No |
Answer / nagaraz
1.READ METHODE SHOULD BE TAKE SPECIFIC FILE U CAN TAKE
MULTIPLE FILE
Is This Answer Correct ? | 0 Yes | 1 No |
how many stages are there in Datastage... Please clarify mee??
What is meta stage?
How you can fix the truncated data error in datastage?
How to work with XML out put stage? Please explain step by step? i need to generate XML file using Table data. Given is the .XSD file. Please help?
Lookup constraints
source which format u will get either fixed or delimiter length format? what is the symbol of delimiter?
How u implement the slowly changing dimensions if my source table is consisting of cid,cname,add,phno,email but i need to capture the changes for first three columns how u implement?
in one scenario source flat file like Fileld1 00122001550056200568 00256002360014500896 00123004560078900258 00147004560025800256 divide each 5 numbers as one column i.e here i need field1 field2 field3 field4 00122 00155 00562 00568 00256 00236 00145 00896 00123 00456 00789 00258 00147 00456 00258 00256 plz help me....
How many types of views are there in a datastage director?
Can you explain kafka connector?
What is audit table?
Hi, I am getting data from sequential file like below column1 A&B C&D A&E X&Y&Z v&x But I need the target column as like below column1 A and B C and D A and E X and Y and Z v and x