Search Exchange
Search All Sites
Nagios Live Webinars
Let our experts show you how Nagios can help your organization.Login
Directory Tree
check_hadoop_hdfs
Meet The New Nagios Core Services Platform
Built on over 25 years of monitoring experience, the Nagios Core Services Platform provides insightful monitoring dashboards, time-saving monitoring wizards, and unmatched ease of use. Use it for free indefinitely.
Monitoring Made Magically Better
- Nagios Core on Overdrive
- Powerful Monitoring Dashboards
- Time-Saving Configuration Wizards
- Open Source Powered Monitoring On Steroids
- And So Much More!
Checks for dead nodes, unreplicated blocks, full hdfs datastore, and supports performancegraphing of these and several more things
This is a test to check status of hdfs in a hadoop cluster.
The test uses the Hadoop hdfs admin web page, normally found at; http://hdfs-namenode:50070/dfshealth.jsp
I am just parsing output from this webpage using (bad) regexps.
Requires the nagios perl modules, utils.pm
Tested with hadoop 0.20.2
Gives performancedata for unreplicated blocks, data in hdfs, nodes OK/Dead and number of files/directories/blocks in the hdfs.
Usage: check_hadoop.pl -w -c -x -u -H -p [-v version] [-h help]
Checks several Hadoop hdfs-parameters
-H (–Host)
-p (–Port)
-w (–warning) = warning for DFS Usage
-c (–critical) = critical limit for DFS Usage (w < c )
-x (–unreplicatedwarn) = Warning limit for Unreplicated blocks
-u (–unreplicatedcritical) = Error limit for Unreplicated blocks
-h (–help)
-v (–version)
Example Nagios-config
define service{
use generic_service
service_description Hadoop_Extended Check
check_command check_hadoop_extended
hosts namenode.company.com
}
define command{
command_name check_hadoop_extended
command_line $USER1$/check_hadoop.pl -H namenode.company.com -p 50070 -w 5 -c 10 -x 100 -u 1000
}
The test uses the Hadoop hdfs admin web page, normally found at; http://hdfs-namenode:50070/dfshealth.jsp
I am just parsing output from this webpage using (bad) regexps.
Requires the nagios perl modules, utils.pm
Tested with hadoop 0.20.2
Gives performancedata for unreplicated blocks, data in hdfs, nodes OK/Dead and number of files/directories/blocks in the hdfs.
Usage: check_hadoop.pl -w
Checks several Hadoop hdfs-parameters
-H (–Host)
-p (–Port)
-w (–warning) = warning for DFS Usage
-c (–critical) = critical limit for DFS Usage (w < c )
-x (–unreplicatedwarn) = Warning limit for Unreplicated blocks
-u (–unreplicatedcritical) = Error limit for Unreplicated blocks
-h (–help)
-v (–version)
Example Nagios-config
define service{
use generic_service
service_description Hadoop_Extended Check
check_command check_hadoop_extended
hosts namenode.company.com
}
define command{
command_name check_hadoop_extended
command_line $USER1$/check_hadoop.pl -H namenode.company.com -p 50070 -w 5 -c 10 -x 100 -u 1000
}
Reviews (0)
Be the first to review this listing!