浮雲雅築: [研究] hadoop-2.5.0-src.tar.gz 快速編譯安裝程式(CentOS 7.0 x86

[研究] hadoop-2.5.0-src.tar.gz 快速編譯安裝程式(CentOS 7.0 x86_64)

2014-08-25

下載
http://www.apache.org/dyn/closer.cgi/hadoop/common/
http://apache.stu.edu.tw/hadoop/common/hadoop-2.5.0/hadoop-2.5.0.tar.gz

程式內容如下

#!/bin/bash

echo -e "\033[31m"
echo -e "Program : Hadoop-2.5.0_CentOS-7.0-x86_64-Compile.sh "
echo -e "Hadoop 2.5.0 Compile Shell Script (CentOS 7.0 x86_64) "
echo -e "by Shau-Rong Lu 2014-08-25 "
echo -e "\033[0m"

cd /usr/local/src
#yum -y groupinstall "Development tools"
yum -y install gcc gcc-c++ svn cmake git zlib zlib-devel openssl openssl-devel rsync java-1.7.0-openjdk.x86_64 java-1.7.0-openjdk-devel.x86_64 make wget

# echo "********** Install OpenJDK **********"

yum -y install java
# or
#yum -y install java-1.7.0-openjdk

yum -y install java-1.7.0-openjdk-devel

#export JAVA_HOME=/usr
#echo 'export JAVA_HOME=/usr' >> /etc/profile
#echo 'export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.65-2.5.1.2.el7_0.x86_64' >> /etc/profile
echo 'export JAVA_HOME=/usr/lib/jvm/java' >> /etc/profile
echo 'export PATH=$PATH:$JAVA_HOME/bin' >> /etc/profile
echo 'export CLASSPATH=$JAVA_HOME/jre/lib/ext:$JAVA_HOME/lib/tools.jar' >> /etc/profile

source /etc/profile
java -version
#export | grep JAVA
#export | grep jdk

echo "********** Install Apache Maven 3.0.5 (yum) **********"

yum -y install maven

# mvn -version

echo "********** Install FindBugs 3.0.0 **********"

cd /usr/local/src
if [ ! -s findbugs-3.0.0.tar.gz ]; then
wget http://jaist.dl.sourceforge.net/project/findbugs/findbugs/3.0.0/findbugs-3.0.0.tar.gz
fi
tar zxvf findbugs-3.0.0.tar.gz -C /usr/local/
ln -s /usr/local/findbugs-3.0.0/bin/findbugs /usr/bin/findbugs
echo 'export FINDBUGS_HOME=/usr/local/findbugs-3.0.0' >> /etc/profile
echo 'export PATH=$PATH:$FINDBUGS_HOME/bin' >> /etc/profile
source /etc/profile

#export | grep FINDBUGS_HOME
#export | grep PATH
#read -n 1 -p "Press Enter to continue..."

echo "********** Install Protoc 2.5.0 **********"
# https://code.google.com/p/protobuf/
# https://code.google.com/p/protobuf/downloads/list

cd /usr/local/src
if [ ! -s protobuf-2.5.0.tar.gz ]; then
wget https://protobuf.googlecode.com/files/protobuf-2.5.0.tar.gz
fi
tar zxvf protobuf-2.5.0.tar.gz -C /usr/local/src
cd /usr/local/src/protobuf-2.5.0
./configure
make
make install
ln -s /usr/local/bin/protoc /usr/bin/protoc
echo 'export PROTO_HOME=/usr/local/' >> /etc/profile
echo 'export PATH=$PATH:$PROTO_HOME/bin' >> /etc/profile
source /etc/profile
#read -n 1 -p "Press Enter to continue..."

echo "********** Compile Hadoop **********"

cd /usr/local/src
if [ ! -s hhadoop-2.5.0-src.tar.gz ]; then
wget http://ftp.tc.edu.tw/pub/Apache/hadoop/common/hadoop-2.5.0/hadoop-2.5.0-src.tar.gz
fi
tar zxvf hadoop-2.5.0-src.tar.gz -C /usr/local/src
cd /usr/local/src/hadoop-2.5.0-src/

#mvn clean
mvn package -Pdist,native -DskipTests -Dtar
#read -n 1 -p "Press Enter to continue..."

執行結果

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [1:22.827s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [31.451s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [1:08.120s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.361s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [20.008s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [27.762s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS [5:35.471s]
[INFO] Apache Hadoop Auth ................................ SUCCESS [3:40.768s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [7.497s]
[INFO] Apache Hadoop Common .............................. SUCCESS [8:56.929s]
[INFO] Apache Hadoop NFS ................................. SUCCESS [7.474s]
[INFO] Apache Hadoop Common Project ...................... SUCCESS [0.036s]
[INFO] Apache Hadoop HDFS ................................ SUCCESS [4:39.195s]
[INFO] Apache Hadoop HttpFS .............................. SUCCESS [49.129s]
[INFO] Apache Hadoop HDFS BookKeeper Journal ............. SUCCESS [2:41.863s]
[INFO] Apache Hadoop HDFS-NFS ............................ SUCCESS [4.417s]
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [0.025s]
[INFO] hadoop-yarn ....................................... SUCCESS [0.082s]
[INFO] hadoop-yarn-api ................................... SUCCESS [56.352s]
[INFO] hadoop-yarn-common ................................ SUCCESS [2:13.086s]
[INFO] hadoop-yarn-server ................................ SUCCESS [0.033s]
[INFO] hadoop-yarn-server-common ......................... SUCCESS [18.730s]
[INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [1:07.616s]
[INFO] hadoop-yarn-server-web-proxy ...................... SUCCESS [3.369s]
[INFO] hadoop-yarn-server-applicationhistoryservice ...... SUCCESS [8.325s]
[INFO] hadoop-yarn-server-resourcemanager ................ SUCCESS [15.645s]
[INFO] hadoop-yarn-server-tests .......................... SUCCESS [1.039s]
[INFO] hadoop-yarn-client ................................ SUCCESS [7.058s]
[INFO] hadoop-yarn-applications .......................... SUCCESS [0.035s]
[INFO] hadoop-yarn-applications-distributedshell ......... SUCCESS [2.694s]
[INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SUCCESS [1.824s]
[INFO] hadoop-yarn-site .................................. SUCCESS [0.041s]
[INFO] hadoop-yarn-project ............................... SUCCESS [5.085s]
[INFO] hadoop-mapreduce-client ........................... SUCCESS [0.059s]
[INFO] hadoop-mapreduce-client-core ...................... SUCCESS [22.787s]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [20.851s]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [4.765s]
[INFO] hadoop-mapreduce-client-app ....................... SUCCESS [11.581s]
[INFO] hadoop-mapreduce-client-hs ........................ SUCCESS [9.319s]
[INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS [12.257s]
[INFO] hadoop-mapreduce-client-hs-plugins ................ SUCCESS [1.750s]
[INFO] Apache Hadoop MapReduce Examples .................. SUCCESS [6.832s]
[INFO] hadoop-mapreduce .................................. SUCCESS [5.110s]
[INFO] Apache Hadoop MapReduce Streaming ................. SUCCESS [13.689s]
[INFO] Apache Hadoop Distributed Copy .................... SUCCESS [18.718s]
[INFO] Apache Hadoop Archives ............................ SUCCESS [1.928s]
[INFO] Apache Hadoop Rumen ............................... SUCCESS [8.149s]
[INFO] Apache Hadoop Gridmix ............................. SUCCESS [5.195s]
[INFO] Apache Hadoop Data Join ........................... SUCCESS [3.349s]
[INFO] Apache Hadoop Extras .............................. SUCCESS [3.349s]
[INFO] Apache Hadoop Pipes ............................... SUCCESS [11.121s]
[INFO] Apache Hadoop OpenStack support ................... SUCCESS [6.424s]
[INFO] Apache Hadoop Client .............................. SUCCESS [9.014s]
[INFO] Apache Hadoop Mini-Cluster ........................ SUCCESS [0.103s]
[INFO] Apache Hadoop Scheduler Load Simulator ............ SUCCESS [1:00.964s]
[INFO] Apache Hadoop Tools Dist .......................... SUCCESS [5.597s]
[INFO] Apache Hadoop Tools ............................... SUCCESS [0.029s]
[INFO] Apache Hadoop Distribution ........................ SUCCESS [38.967s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 41:13.828s
[INFO] Finished at: Mon Aug 25 17:14:14 CST 2014
[INFO] Final Memory: 152M/480M
[INFO] ------------------------------------------------------------------------
[root@localhost hadoop-2.5.0-src]#

http://forum.icst.org.tw/phpbb/viewtopic.php?t=17974

浮雲雅築

2014年8月25日星期一

[研究] hadoop-2.5.0-src.tar.gz 快速編譯安裝程式(CentOS 7.0 x86_64)

沒有留言:

張貼留言

2014年8月25日 星期一

[研究] hadoop-2.5.0-src.tar.gz 快速編譯安裝程式(CentOS 7.0 x86_64)

沒有留言:

張貼留言

2014年8月25日星期一