浮雲雅築: [研究] Hadoop 2.5.0 安裝 (CentOS 7.0 x86

2014年8月25日星期一

[研究] Hadoop 2.5.0 安裝 (CentOS 7.0 x86_64)

[研究] Hadoop 2.5.0 安裝 (CentOS 7.0 x86_64)

2014-08-25

The Apache Hadoop project develops open-source software for reliable, scalable, distributed computing.
它參考Google Filesystem，以Java開發，提供HDFS與MapReduce API。

官方網站
http://hadoop.apache.org/

安裝參考
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleNodeSetup.html
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html

下載
http://www.apache.org/dyn/closer.cgi/hadoop/common/

安裝

# 為了省事，避免意外的情況，關閉 SELinux (Security Linux ) 和 iptables

# 立刻關閉 SELinux
setenforce 0

# 設定 reboot 後自動關閉 SELinux
#vi /etc/selinux/config
#找到
#SELINUX=
#設為
#SELINUX=disabled

sed -i -e "s@SELINUX=enforcing@#SELINUX=enforcing@" /etc/selinux/config
sed -i -e "s@SELINUX=permissive@#SELINUX=permissive@" /etc/selinux/config
sed -i -e "/SELINUX=/aSELINUX=disabled" /etc/selinux/config

# 立刻停掉 iptables
#service iptables stop
#service ip6tables stop
systemctl stop firewalld

# 設定 reboot 後自動關閉 iptable
#chkconfig iptables off
#chkconfig ip6tables off
systemctl disable firewalld
systemctl status firewalld

yum -y install java
# or
#yum -y install java-1.7.0-openjdk

yum -y install java-1.7.0-openjdk-devel

echo 'export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65-2.5.1.2.el7_0.x86_64' >> /etc/profile

source /etc/profile

cd /usr/local
wget http://apache.cdpa.nsysu.edu.tw/hadoop/common/hadoop-2.5.0/hadoop-2.5.0.tar.gz
tar zxvf hadoop-2.5.0.tar.gz

echo 'export HADOOP_HOME=/usr/local/hadoop-2.5.0' >> /etc/profile
echo 'export PATH=$PATH:$HADOOP_HOME/bin' >> /etc/profile
echo 'export PATH=$PATH:$HADOOP_HOME/sbin' >> /etc/profile
source /etc/profile

檢視現況

[root@localhost local]# hadoop version
Hadoop 2.5.0
Subversion http://svn.apache.org/repos/asf/hadoop/common -r 1616291
Compiled by jenkins on 2014-08-06T17:31Z
Compiled with protoc 2.5.0
From source with checksum 423dcd5a752eddd8e45ead6fd5ff9a24
This command was run using /usr/local/hadoop-2.5.0/share/hadoop/common/hadoop-common-2.5.0.jar

[root@localhost local]#

[root@localhost local]# hadoop

Usage: hadoop [--config confdir] COMMAND
where COMMAND is one of:
fs run a generic filesystem user client
version print the version
jar <jar> run a jar file
checknative [-a|-h] check native hadoop and compression libraries availability
distcp <srcurl> <desturl> copy file or directories recursively
archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop archive
classpath prints the class path needed to get the
Hadoop jar and the required libraries
daemonlog get/set the log level for each daemon
or
CLASSNAME run the class named CLASSNAME

Most commands print help when invoked w/o parameters.
[root@localhost ~]#

浮雲雅築

2014年8月25日星期一

[研究] Hadoop 2.5.0 安裝 (CentOS 7.0 x86_64)

沒有留言:

張貼留言

2014年8月25日 星期一

[研究] Hadoop 2.5.0 安裝 (CentOS 7.0 x86_64)

沒有留言:

張貼留言

2014年8月25日星期一