浮雲雅築: [研究] Hadoop 2.5.1 安裝 (CentOS 7.0 x86

[研究] Hadoop 2.5.1 安裝 (CentOS 7.0 x86_64)

2014-09-27

The Apache Hadoop project develops open-source software for reliable, scalable, distributed computing.
它參考Google Filesystem，以Java開發，提供HDFS與MapReduce API。

官方網站
http://hadoop.apache.org/

安裝參考
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleNodeSetup.html
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html

下載
http://www.apache.org/dyn/closer.cgi/hadoop/common/

安裝

# 為了省事，避免意外的情況，關閉 SELinux (Security Linux ) 和 iptables

# 立刻關閉 SELinux
setenforce 0

# 設定 reboot 後自動關閉 SELinux
#vi /etc/selinux/config
#找到
#SELINUX=
#設為
#SELINUX=disabled

sed -i -e "s@SELINUX=enforcing@#SELINUX=enforcing@" /etc/selinux/config
sed -i -e "s@SELINUX=permissive@#SELINUX=permissive@" /etc/selinux/config
sed -i -e "/SELINUX=/aSELINUX=disabled" /etc/selinux/config

# 立刻停掉 iptables
#service iptables stop
#service ip6tables stop
systemctl stop firewalld

# 設定 reboot 後自動關閉 iptable
#chkconfig iptables off
#chkconfig ip6tables off
systemctl disable firewalld
systemctl status firewalld

yum -y install java
# or
#yum -y install java-1.7.0-openjdk

yum -y install java-1.7.0-openjdk-devel

#echo 'export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65-2.5.1.2.el7_0.x86_64' >>
/etc/profile
echo 'export JAVA_HOME=/usr/lib/jvm/java' >> /etc/profile

source /etc/profile

cd /usr/local
#wget http://apache.cdpa.nsysu.edu.tw/hadoop/common/hadoop-2.5.1/hadoop-2.5.1.tar.gz
wget http://ftp.mirror.tw/pub/apache/hadoop/common/hadoop-2.5.1/hadoop-2.5.1.tar.gz
tar zxvf hadoop-2.5.1.tar.gz

echo 'export HADOOP_HOME=/usr/local/hadoop-2.5.1' >> /etc/profile
echo 'export PATH=$PATH:$HADOOP_HOME/bin' >> /etc/profile
echo 'export PATH=$PATH:$HADOOP_HOME/sbin' >> /etc/profile
source /etc/profile

檢視現況

[root@localhost local]# hadoop version
Hadoop 2.5.1
Subversion https://git-wip-us.apache.org/repos/asf/hadoop.git -r 2e18d179e4a8065b6a9f29cf2de9451891265cce
Compiled by jenkins on 2014-09-05T23:11Z
Compiled with protoc 2.5.0
From source with checksum 6424fcab95bfff8337780a181ad7c78
This command was run using /usr/local/hadoop-2.5.1/share/hadoop/common/hadoop-common-2.5.1.jar

[root@localhost local]# hadoop
Usage: hadoop [--config confdir] COMMAND
where COMMAND is one of:
fs run a generic filesystem user client
version print the version
jar <jar> run a jar file
checknative [-a|-h] check native hadoop and compression libraries availability
distcp <srcurl> <desturl> copy file or directories recursively
archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop archive
classpath prints the class path needed to get the
Hadoop jar and the required libraries
daemonlog get/set the log level for each daemon
or
CLASSNAME run the class named CLASSNAME

Most commands print help when invoked w/o parameters.
[root@localhost local]#

浮雲雅築

2014年9月27日星期六

[研究] Hadoop 2.5.1 安裝 (CentOS 7.0 x86_64)

沒有留言:

張貼留言

2014年9月27日 星期六

[研究] Hadoop 2.5.1 安裝 (CentOS 7.0 x86_64)

沒有留言:

張貼留言

2014年9月27日星期六