Apache Hadoop
A software framework for distributed storage that facilitates using a network of many computers to solve problems involving massive amounts of data and computation using MapReduce programming model
A software framework for distributed storage that facilitates using a network of many computers to solve problems involving massive amounts of data and computation using MapReduce programming model
Apache(TM) Hadoop(R) is a library framework that facilitate using a network of many computers to solve problems involving massive amounts of data and computation providing for distributed storage and processing of big data using the MapReduce programming model.
It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.
- Official website
When a node fails, processing is re-directed to the remaining nodes in the cluster and data is automatically re-replicated in preparation for future node failures, making Apache Hadoop resilient.
Blog I News I Mailing lists I Wiki I Documentation I FAQ I IRC
| # | Minimum | Optimal |
|---|---|---|
| 1 | Software: Java 7 for Apache Hadoop v2.7 or later | Java 6 is supported by v2.6 or earlier | Hardware: Intel Core 2 Duo/Quad/hex/Octa or higher end 64 bit processor PC or Laptop (Minimum operating frequency of 2.5GHz) |
| 2 | Software: SSH installed and SSHD running to use the Hadoop scripts that manage remote Hadoop daemons | Hardware: Hard Disk capacity of 1 - 4 TB |
| 3 | Hardware: 64 - 512 GB RAM | |
| 4 | Hardware: 10 Gigabit Ethernet or Bonded Gigabit Ethernet |
Distributed File System
Apache Hadoop