Follow the instructions from Get Docker CE for Ubuntu page.
Follow the instructions from Post-installation steps for Linux page.
- Go to your terminal.
- Clone this repository and go inside it
git clone https://github.com/mjaglan/docker-hadoop-pseudo-distributed-mode.git cd docker-hadoop-pseudo-distributed-mode - Run the following script
. ./restart-all.sh
The scripts/hadoop-services.sh is running following commands after starting Hadoop System -
-
Java Virtual Machine Process Status Tool (jps)
<pid> <process name> 266 org.apache.hadoop.hdfs.server.datanode.DataNode 142 org.apache.hadoop.hdfs.server.namenode.NameNode 428 org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode 678 org.apache.hadoop.yarn.server.nodemanager.NodeManager 579 org.apache.hadoop.yarn.server.resourcemanager.ResourceManager -
Basic Hadoop filesystem information and statistics
Configured Capacity: 37912903680 (35.31 GB) Present Capacity: 8332066816 (7.76 GB) DFS Remaining: 8332042240 (7.76 GB) DFS Used: 24576 (24 KB) DFS Used%: 0.00% Under replicated blocks: 0 Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks (with replication factor 1): 0 ------------------------------------------------- Live datanodes (1): ... -
Hadoop Terasort Benchmark Test
-
(Optional) Hadoop NNBENCH Test
-
(Optional) Hadoop MRBENCH Test
-
NameNode can be accessed on browser at http://CONTAINER-IP:8088/
-
Resource Manager can be accessed on browser at http://CONTAINER-IP:50070/
-
Secondary can be accessed on browser at http://CONTAINER-IP:50090/
Docker version 17.06.0-ce
Ubuntu Trusty 14.04 Host OS
Eclipse IDE for Java EE Developers Oxygen (4.7.0)
Eclipse Docker Tooling 3.1.0