Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...


When to use coalesce and repartition in spark?



When to use coalesce and repartition in spark?..

Answer / Shakher Chaudhary

Use Coalesce when you want to reduce the number of partitions, especially before writing data to an output format like CSV or Parquet. Use Repartition when you need to change the number of partitions for a specific reason, such as joining data where the join key is evenly distributed across fewer partitions.

Is This Answer Correct ?    0 Yes 0 No

Post New Answer

More Apache Spark Interview Questions

How do I optimize my spark code?

1 Answers  


What is skew data?

1 Answers  


Is it possible to run Spark and Mesos along with Hadoop?

1 Answers  


what do you mean by the worker node?

1 Answers  


Explain Spark Core?

1 Answers  


What is RDD in Apache Spark? How are they computed in Spark? what are the various ways in which it can create?

1 Answers  


What are the actions in spark?

1 Answers  


What are the various storages from which Spark can read data?

1 Answers  


How is dag created in spark?

1 Answers  


What are the transformations in spark?

1 Answers  


What is difference between rdd and dataframe?

1 Answers  


Define Actions.

1 Answers  


Categories