Flume是一种分布式,可靠且可用的服务,用于有效地收集,聚合和移动大量日志数据
Flume架构和核心组件
Source 收集
Channel 处理
Sink 输出
2.创建文件夹
mkdir -p /usr/local/flume/data
cd /usr/local/flume
3.下载Flume https://archive.cloudera.com/cdh5/cdh/5/
wget https://archive.cloudera.com/cdh5/cdh/5/flume-ng-1.6.0-cdh5.9.0.tar.gz
4.解压
tar -zvxf flume-ng-1.6.0-cdh5.9.0.tar.gz
5.修改配置文件
vim /etc/profile
export FLUME_HOME=/usr/local/flume/apache-flume-1.6.0-cdh5.9.0-bin
export PATH=$FLUME_HOME/bin:$PATH
source /etc/profile
6.修改配置
cd /usr/local/flume/apache-flume-1.6.0-cdh5.9.0-bin/conf
cp flume-env.sh.template flume-env.sh
vim flume-env.sh
export JAVA_HOME=/usr/local/java1.8/jdk1.8.0_241 # 制定java
flume-ng version # 查看flume版本