Module Name: omhdfs
Available since: 5.7.1
Author:Rainer Gerhards <rgerhards@adiscon.com>
Description:
This module supports writing message into files on Hadoop’s HDFS file system.
Configuration Directives:
The name of the file to which the output data shall be written.
Name or IP address of the HDFS host to connect to.
$OMHDFSPort [name] Port on which to connect to the HDFS host.
$OMHDFSDefaultTemplate [name] Default template to be used when none is specified. This saves the work of specifying the same template ever and ever again. Of course, the default template can be overwritten via the usual method.
Caveats/Known Bugs:
Building omhdfs is a challenge because we could not yet find out how to integrate Java properly into the autotools build process. The issue is that HDFS is written in Java and libhdfs uses JNI to talk to it. That requires that various system-specific environment options and pathes be set correctly. At this point, we leave this to the user. If someone know how to do it better, please drop us a line!
Sample:
$ModLoad omhdfs $OMHDFSFileName /var/log/logfile \*.\* :omhdfs:
This documentation is part of the rsyslog project.
Copyright © 2010-2014 by Rainer Gerhards and Adiscon. Released under the GNU GPL version 3 or higher.