Sunday, May 11, 2014

Day 2# Flume hallo world example


1) Download latest Flume binaries from https://flume.apache.org/download.html

$cd $HOME/Downloads
$tar -xvzf apache-flume-1.4.0-bin.tar.gz
$ls -lrt apache-flume-1.4.0-bin













2) Copy binaries into local folder

$sudo  mkdir /usr/local/flume
$sudo
$sudo chown -R butik flume

  







3) Set Flume home and path
  






  

$cd $HOME
$vi .bashrc
$exec bash #commit the changes


4) Say hallo world to flume

$cd $FLUME_PREFIX/conf
$vi hw.conf

agent.sources=s1
agent.channels=c1
agent.sinks=k1
agent.sources.s1.type=netcat
agent.sources.s1.channels=c1
agent.sources.s1.bind=0.0.0.0
agent.sources.s1.port=12345
agent.channels.c1.type=memory
agent.sinks.k1.type=logger
agent.sinks.k1.channel=c1


Start the flume agent

$./bin/flume-ng agent -n agent -c conf -f conf/hw.conf -Dflume.root.logger=INFO,console























From another terminal sends command line feeds and check the agent logs.

$telnet localhost 12345

































No comments:

Post a Comment