Interested to Buy Any Domain ? << Click Here >> for more details...
Why is HDFS only suitable for large data sets and not the correct tool to use for many small files?
- 1 Answers
- 79 Views
- I also Faced
- E-Mail Answers
Answer / Rajesh Ram
HDFS (Hadoop Distributed File System) is optimized for handling large data sets due to its distributed architecture, which allows for efficient data storage and processing across multiple nodes. However, when dealing with many small files, HDFS can become less efficient because of the overhead associated with managing a large number of small files, such as the need for multiple blocks per file and increased metadata management.
| Is This Answer Correct ? | 0 Yes | 0 No |
In HDFS, how Name node determines which data node to write on?
Can you explain heartbeat in hdfs?
What is NameNode and DataNode in HDFS?
How hdfs is different from traditional file systems?
How will you perform the inter cluster data copying work in hdfs?
How one can change Replication factor when Data is already stored in HDFS
How is NFS different from HDFS?
Does hdfs enable a customer to peruse a record, which is already opened for writing?
Does the HDFS go wrong? If so, how?
Explain how HDFS communicates with Linux native file system?
On what basis name node distribute blocks across the data nodes in HDFS?
How to copy file from HDFS to local?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
