By default, when an RDD is created from a local file using `textFile()` or

By Default, how many partitions are created in RDD in Apache Spark?

Question Posted / Deepak Diwakar

1 Answers
328 Views
I also Faced
E-Mail Answers

Answer Posted / Deepak Diwakar

By default, when an RDD is created from a local file using `textFile()` or `wholeTextFiles()`, Spark creates 20 partitions for the RDD. When reading data from HDFS, Spark creates as many partitions as there are blocks in the file on the HDFS cluster.

Is This Answer Correct ?

0 Yes

0 No

Post New Answer View All Answers

Please Help Members By Posting Answers For Below Questions

List the advantage of Parquet file in Apache Spark?

474

What is meant by Transformation? Give some examples.

328

What is the latest version of spark?

288

Explain how RDDs work with Scala in Spark

355