Flume是一种分布式,可靠且可用的服务,用于有效地收集,聚合和移动大量日志数据
Flume架构和核心组件
Source 收集 Channel 处理 Sink 输出
1.安装java1.8版本 https://www.cnblogs.com/yoyo1216/p/12668926.html
2.创建文件夹
mkdir -p /usr/local/flume/data cd /usr/local/flume
3.下载Flume https://archive.cloudera.com/cdh5/cdh/5/
wget https://archive.cloudera.com/cdh5/cdh/5/flume-ng-1.6.0-cdh5.9.0.tar.gz
4.解压
tar -zvxf flume-ng-1.6.0-cdh5.9.0.tar.gz
5.修改配置文件
vim /etc/profile export FLUME_HOME=/usr/local/flume/apache-flume-1.6.0-cdh5.9.0-bin export PATH=$FLUME_HOME/bin:$PATH source /etc/profile
6.修改配置
cd /usr/local/flume/apache-flume-1.6.0-cdh5.9.0-bin/conf cp flume-env.sh.template flume-env.sh vim flume-env.sh export JAVA_HOME=/usr/local/java1.8/jdk1.8.0_241 # 制定java flume-ng version # 查看flume版本