大数据系列9:Mahout – 机器学习
wget http://mirrors.ustc.edu.cn/apache/mahout/0.8/mahout-distribution-0.8.tar.gz
tar -xzvf mahout-distribution-0.8.tar.gz
cd mahout-distribution-0.8
sudo vi /etc/profile
增加:
export PATH=$PATH:/home/ysc/mahout-distribution-0.8/bin
source /etc/profile
数据:hadoop fs -put clustering_material.txt testdata/clustering_material.txt
聚类1:mahoutorg.apache.mahout.clustering.syntheticcontrol.kmeans.Job
分析1:mahout clusterdump --input output/clusters-10-final --pointsDir output/clusteredPoints --output output/clusteranalyze_kmeans.txt
查看:
hadoopfs -lsr output
more output/clusteranalyze_kmeans.txt
VL-19代表这是一个cluster,n=161代表该cluster有161个点,c=[...]代表该cluster的中心向量点,r=[...]代表cluster的半径
聚类2:mahout org.apache.mahout.clustering.syntheticcontrol.canopy.Job
分析2:mahout clusterdump --input output/clusters-0-final --pointsDir output/clusteredPoints --output output/clusteranalyze_canopy.txt
聚类3:mahout org.apache.mahout.clustering.syntheticcontrol.fuzzykmeans.Job
分析3:mahout clusterdump --input output/clusters-6-final --pointsDir output/clusteredPoints --output output/clusteranalyze_fuzzykmeans.txt
聚类4:mahout org.apache.mahout.clustering.syntheticcontrol.dirichlet.Job
分析4:mahout clusterdump --input output/clusters-5-final --pointsDir output/clusteredPoints --output output/clusteranalyze_dirichlet.txt
聚类5:mahout org.apache.mahout.clustering.syntheticcontrol.meanshift.Job
分析5:mahout clusterdump --input output/clusters-3-final --pointsDir output/clusteredPoints --output output/clusteranalyze_meanshift.txt