flume 1.8 安裝部署

flume 1.8 安裝部署

環境

centos:7.2

JDK:1.8

Flume:1.8

一、Flume 安裝

1) 下載

wget mirrors.tuna.tsinghua.edu.cn

2) 解壓

tar –zxvf apache-flume-1.8.0-bin.tar.gz

mv apache-flume-1.8.0-bin /usr/local/flume

3) 設置環境變數

Vim /etc/profile.d/flume.sh

Source /etc/profile

4) 配置java_home

cp flume-env.sh.template flume-env.sh

vim flume-env.sh

spoolingDirectory Source

  a1.sources = r1

  a1.sinks = k1

  a1.channels = c1

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25<br><br>a1.sources.r1.type = spooldir

#

a1.sources.r1.channels = c1

#

a2.sources.r1.spoolDir = /opt/apache-flume-1.8.0-bin/logs

#

a1.sources.r1.fileHeader = true

#

# # Describe the sink

#

a1.sinks.k1.type = logger

#

# # Use a channel which buffers events in memory

#

a1.channels.c1.type = memory

#

a1.channels.c1.capacity = 1000

#

a1.channels.c1.transactionCapacity = 100

#

# # Bind the source and sink to the channel

#

a1.sources.r1.channels = c1

#

a1.sinks.k1.channel = c1

啟動 :

../bin/flume-ng agent -c /opt/apache-flume-1.8.0-bin/conf -f /opt/apache-flume-1.8.0-bin/conf/spool1.conf --name a1 -Dflume.root.logger=INFO,console

推薦閱讀:

數據之路(Hadoop)我該如何打好基礎?
yarn中的事件驅動模型
穩定和性能如何兼顧?58大數據平台的技術演進與實踐
大數據那些事(28):卡夫卡們的故事
Ubuntu搭建Hadoop的踩坑之旅(三)

TAG:Hadoop | 數據分析 | 大數據 |