Interested to Buy Any Domain ? << Click Here >> for more details...
How to split single hdfs block into partitions rdd?
- 1 Answers
- 62 Views
- I also Faced
- E-Mail Answers
Answer / Ritesh Kumar
"In Apache Spark running on Hadoop, you can split a single HDFS block into partitions using RDD (Resilient Distributed Dataset). Here's a simple example:nn```scalanval hdfsRdd = sc.textFile("hdfs://<hostname>/<path>")nval partitionedRdd = hdfsRdd.repartition(<number_of_partitions>)n```"
| Is This Answer Correct ? | 0 Yes | 0 No |
How to Delete file from HDFS?
Explain NameNode and DataNode in HDFS?
Explain hdfs?
Can you explain about the indexing process in hdfs?
What do you mean by the High Availability of a NameNode in Hadoop HDFS?
On what basis name node distribute blocks across the data nodes in HDFS?
What is a block in HDFS? what is the default size in Hadoop 1 and Hadoop 2? Can we change the block size?
What is the optimal block size in HDFS?
How is indexing done in Hadoop HDFS?
Replication causes data redundancy then why is pursued in hdfs?
Can multiple clients write into an HDFS file concurrently in hadoop?
Does hdfs enable a customer to peruse a record, which is already opened for writing?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
