In Apache Pig, data compression can be achieved by using Storing policies.

How do you handle compression in pig?

Question Posted / Tripti Agarwal

1 Answers
609 Views
I also Faced
E-Mail Answers

Answer Posted / Tripti Agarwal

In Apache Pig, data compression can be achieved by using Storing policies. The STORED AS part of the CREATE TABLE or LOAD command is used to specify the storage policy. You can use 'org.apache.hadoop.hive.conf.HiveConf' to set the serialization and compression properties like 'serialization.format.version', 'io.compression.codecs' etc. For example, you can compress data using Gzip or Snappy compression by setting 'io.compression.codec.gzip' or 'io.compression.codec.snappy' respectively.

Is This Answer Correct ?

0 Yes

0 No

Post New Answer View All Answers

Please Help Members By Posting Answers For Below Questions

What is the function of UNION and SPLIT operators? Give examples?

579