Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...

  1. Categories >> Software >> Big Data >> Hadoop >> Apache Spark
  2. Suggest New Category

How does rdd work in spark?

Question Posted / Ashish Kumar Jaiswal

Answer Posted / Ashish Kumar Jaiswal

An RDD (Resilient Distributed Dataset) is a fundamental data structure in Apache Spark, designed to be highly resilient and fault-tolerant. RDDs are distributed collections of objects that can be processed in parallel across multiple nodes in a cluster. They consist of a logical dataset divided into partitions, each partition being stored on one worker node in the cluster. RDDs can be created from Hadoop Distributed File System (HDFS), local file system, or even by transforming other RDDs. Operations on RDDs are lazily evaluated and transformed into a series of tasks that are executed in parallel.

Is This Answer Correct ?    0 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is meant by Transformation? Give some examples.

328

List the advantage of Parquet file in Apache Spark?

473

Explain how RDDs work with Scala in Spark

355

What is the latest version of spark?

287