flume 1.8 安裝部署
環境
centos:7.2
JDK:1.8
Flume:1.8
一、Flume 安裝
1) 下載
wget http://mirrors.tuna.tsinghua.edu.cn/apache/flume/1.8.0/apache-flume-1.8.0-bin.tar.gz
2) 解壓
tar –zxvf apache-flume-1.8.0-bin.tar.gz
mv apache-flume-1.8.0-bin /usr/local/flume
3) 設置環境變數
Vim /etc/profile.d/flume.sh
Source /etc/profile
4) 配置java_home
cp flume-env.sh.template flume-env.sh
vim flume-env.sh
spoolingDirectory Source
a1.sources = r1
a1.sinks = k1 a1.channels = c112345
6789101112131415
16171819202122232425<br><br>a1.sources.r1.type
=
spooldir
#
a1.sources.r1.channels
=
c1
#
a2.sources.r1.spoolDir
=
/opt/apache-flume-1.8.0-bin/logs
#
a1.sources.r1.fileHeader
=
true
#
# # Describe the sink
#
a1.sinks.k1.type
=
logger
#
# # Use a channel which buffers events in memory
#
a1.channels.c1.type
=
memory
#
a1.channels.c1.capacity
=
1000
#
a1.channels.c1.transactionCapacity
=
100
#
# # Bind the source and sink to the channel
#
a1.sources.r1.channels
=
c1
#
a1.sinks.k1.channel
=
c1
啟動 :
../bin/flume-ng agent -c /opt/apache-flume-1.8.0-bin/conf -f /opt/apache-flume-1.8.0-bin/conf/spool1.conf --name a1 -Dflume.root.logger=INFO,console
推薦閱讀:
※數據之路(Hadoop)我該如何打好基礎?
※yarn中的事件驅動模型
※穩定和性能如何兼顧?58大數據平台的技術演進與實踐
※大數據那些事(28):卡夫卡們的故事
※Ubuntu搭建Hadoop的踩坑之旅(三)