Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic application.
安装
将下载的flume包解压到你要保存的目录下
修改flume-env.sh(在Flume文件下的conf里)
cp flume-env.sh.template flume-env.sh
解注释JAVAHOME
JAVA_HOME=/usr/lib/jvm/java-XXX
修改配置文件
添加flume以及bin目录到/etc/profile里
使用flume-ng version验证是否安装成功
相关文章
- 07-27Flume参数小结
- 07-27Flume配置
- 07-27Flume实现扇出流动
- 07-27Flume实战值时间戳的拦截器
- 07-27大数据Flume系列之Flume集群搭建
- 07-27Flume数据采集至HDFS的排雷日记
- 07-27Flume的容错性测试和双层Flume架构
- 07-27头条项目推荐的相关技术(二):用户的行为收集(从日志经flume到hadoop再Hive操作)
- 07-27Flume—FLume安装步骤
- 07-27flume到底会丢数据吗?