how will you remove the duplicate records from flat file
without using sorter?
- 7 Answers
- 16838 Views
- I also Faced
- E-Mail Answers
Answers were Sorted based on User's Feedback
Answer / rkumar.etl
use aggregator transformation and group by all ports and
create one port for checking count...and pass the results
accordingly to target tables.
| Is This Answer Correct ? | 24 Yes | 3 No |
Answer / sathish
use aggregater T/R after source qualifier select all ports in group by clause it will removes the duplicates
| Is This Answer Correct ? | 5 Yes | 2 No |
Answer / ajit kumar pradhan
if it is a relational source then click on source Qualifier
properties then check Distinct option.
if it is a flat file then it can't work .......
click on target defination select target menu and click
generate/execute then it come out one dialog box come out
then check primary key check box..it avoid duplicale row...
| Is This Answer Correct ? | 0 Yes | 0 No |
Answer / sathish
put primary key to target it will reject duplicate rows
| Is This Answer Correct ? | 1 Yes | 4 No |
Answer / amedela chandra sekhar
SD---S.Q----EXP t/r------TGT.
add two port in exp t/r.
one is variable port v_seq expression:seq+1
one output port o_seq expression:v_seq
required ports connect to target.
| Is This Answer Correct ? | 1 Yes | 4 No |
We can use the option 'SELECT DISTINCT' in the source
qualifier.
Anybody please tell me whether this works or not.
| Is This Answer Correct ? | 5 Yes | 23 No |
rank() over (partition by opt2.dim_plat_site_id, opt2.dim_site_opt_sid order by case when opt2.dm_market_flg in ('Y', 'U') then 1 else 2 end, lkp.contact_rank) as rank1, case opt2.contact_type when 'Buyer' then row_number() over (partition by opt2.dim_plat_site_id, opt2.dim_site_opt_sid, lkp.contact_rank order by has_name_flg desc, ship_to_flg desc , last_order_dt desc) when 'Decision Maker' then row_number() over (partition by opt2.dim_plat_site_id, opt2.dim_site_opt_sid, lkp.contact_rank order by has_name_flg desc , last_quote_dt desc , mailability_score desc , source_ranking desc) when 'Influencer' then row_number() over (partition by opt2.dim_plat_site_id, opt2.dim_site_opt_sid, lkp.contact_rank order by has_name_flg desc, mailability_score desc, source_ranking desc) when 'Payer' then row_number() over (partition by opt2.dim_plat_site_id, opt2.dim_site_opt_sid, lkp.contact_rank order by has_name_flg desc, mailability_score desc, source_ranking desc) --elu 05/28/2013 else row_number() over (partition by opt2.dim_plat_site_id, opt2.dim_site_opt_sid, lkp.contact_rank order by has_name_flg desc, mailability_score desc, source_ranking desc) end rank2 row_number() over (partition by opt3.dim_plat_site_id, opt3.dim_site_opt_sid order by rank1,rank2) as "rank", case when "rank"<= opt3.maximum_value then 'Y' else 'N' end as include_flg
Any one tell me some 5 session failure in real time?And why problem occur how to solve the issues?
How do you join more than 3 flat files in informatica?
What is Target Update Override? What is the Use ?
Describe an informatica powercenter?
Can I create one wrkflw which will run different wrkflws on schedule time?
In indirect file loading, suppose we have less no.of flat files then we can enter files names manually in list file creation. If millions of files are there, how can we enter the flat file names in list file?
What is the Rank index port in Rank transformation?
major difference between normal loading and bulk loading?
What are the active and passive transforamtions?
What is the difference between a table and the materialized view?
My source table having some records ,i want load 1st record and last record into one target?
Teradata 
