Hi This is Vijay,

How can your remove the duplicates in sequential File?

Answer Posted / chowdary

in sequntial file options filter--> sort | uniq -d
this will give best performence to remove duplicates.

Is This Answer Correct ?    1 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

On which interface you will be working as a developer?

718


Explain entity, attribute and relationship in datastage?

732


Can you explain link buffering?

825


What is the purpose of pivot stage and types of containers in datastage

710


Hi , Can anyone give few examples of scenarios and there corresponding design in datastage..i am new to this tool...confused in design while my manager asking to design the job.. Please post the URL if there..so i can go through it.. Thanks in advance...

3854






Differentiate between Symmetric Multiprocessing and Massive Parallel Processing?

723


On which Dimension Table you implemented SCD Type in your Project

1686


How to create a file using vi editor? 2)how to delete a file in vi editor? 3)How to connect the server datastage to unix? what r the command lines we r using? 4)30 jobs r runnig in unix i want to find out my job. how to do this? give me command?

2153


What is ds designer?

762


what is 'reconsideration error' and how can i respond to this error and how to debug this

2211


Highlight the main features of datastage?

699


Source has 2 columns: USA,NewYork INDIA,MUMBAI INDIA,DELHI UDS,CHICAGO INDIA,PUNE i want data in target like below: INDIA,MUMBAI1 INDIA,DELHI2 INDIA,PUNE3 USA,NEWYORK1 USA,CHICAGO2

443


Have you used Unstructured data?

920


1)what is the size of Fact table and dimension table? 2)how to find the size of Fact table and dimension table? 3)how to implement the surrogate key in transform stage? 4)write the configuration file path? 5)how many types of datasets explain? 6)diff b/w developed projects and migration projects? 7)how to delete the header and footer file of the sequencer file? 8)how can u call the parameters in DS in unix environment? 9) how much data ur getting daily ? 10)

2416


Which warehouse using in your datawarehouse

1778