Monday, May 25, 2009

Debian 5 (Lenny) - Console and web monitoring

This is work in progress. Do not link to this page, it might change!

Hardware and preparation | OS installation | Console and web monitoring | Network & services | Multimedia | Security



I wish I had a more organized section of monitoring tools (two categories: console and web monitoring tools), but most of these tools are linked and/or dependent one to each other. That's why I include them all here, and have them split up by task.


Hardware

System Tools

[?] PhpSysInfo - monitor system via web interface (Uptime, CPU, Memory, SCSI, IDE, PCI, Ethernet, Floppy and Video Information).
Installation:
# aptitude install phpsysinfo
For some reason, the page at http://domain/phpsysinfo does not start. The server log says:
[error] File does not exist: /var/www/domain.com/phpsysinfo
This has to be investigated, I don't have time right now.
Links: Display Your system Information (Uptime, CPU, Memory, SCSI, IDE, PCI, Ethernet, Floppy and Video) Using Phpsysinfo.
Logs monitoring: Ubuntu Linux + Apache2 + Virtual Hosts + Syslog Server, Centralized Syslog Server Using syslog-NG with web Interface using php-syslog-ng.

[?] sysstat - a collection of performance monitoring tools.
Installation:
# aptitude install sysstat
The program won't start and an error shows up after every reboot:
sadc not enabled in /etc/default/sysstat, not starting. (warning).
Solution: aparently, editing /etc/default/sysstat and change the parameter ENABLED from "false" (default) to "true" will fix the error.
Discussions: I don't know if it has any relevance, but there are a few bugs - #507493 (Debian), #298722 (Debian), #507493 (Debian) etc.
Links: How To Monitor A System With Sysstat (Centos 4.3).
To do: there should be a way to set up sysstat save logs, and then display them as graphs on a webpage.
Follow up: not yet.

[X] vpsinfo - monitoring script, written in PHP, that provides web access to system status information, designed for use on a Linux Virtuozzo or OpenVZ, but working as well on a dedicated server. It's been made to make use of other applications such as: vnstat (Highly recommended!), mytop, mysqlreport.
To do.


Hard disk

[X] hdparm - set and view SATA and IDE hard disk hardware parameters.
Installation:
# aptitude install hdparm
How to use it (replace sdX with your drive):
# hdparm -d1 /dev/sdX {Turn on DMA}
# hdparm -d0 /dev/sdX {Turn off DMA}
# hdparm -T /dev/sdX {Test cache read performance}
# hdparm -t /dev/sdX {Test read performance}
# hdparm -I /dev/sdX

[X] hddtemp - monitoring hdd temperature
Installation:
# aptitude install hddtemp
# hddtemp /dev/sd?
as instructed per this link: Monitoring your hardware's temperature.

[X] smartmontools - monitors and set HDD S.M.A.R.T. parameters (it depends on exim4, a SMTP daemon).
Installation:
# aptitude install smartmontools

The following NEW packages will be installed:
bsd-mailx{a} exim4{a} exim4-base{a} exim4-config{a} exim4-daemon-light{a} mailx{a} psmisc{a} smartmontools
How to use it (replace sdX with your drive):
# smartctl -a /dev/sdX

[-] smartmontools - alternate install
# aptitude install smartmontools
# smartctl -i /dev/sda# smartctl -a /dev/sda
as instructed per this link: Checking Hard Disk Sanity With Smartmontools (Debian & Ubuntu).


Mainboard

[X] lm-sensors - hardware monitoring (motherboard temperatures, cooler speed).
Installation:
# aptitude install lm-sensors
# sensors-detect
# modprobe
# sensors
as instructed per this link: Monitoring your hardware's temperature. It worth checking it out sensord.

[?] mbmon - alternative to lm-sensors
Installation:
# aptitude install mbmon
# mbmon This program did not work for me. An error appear:
No Hardware Monitor found!!
InitMBInfo: Success
Some more investigation needs to be done. Links: mbmon manual.



Network

For traffic (network) monitoring, the most interesting I found are vnstat, iptraf, ntop, darkstat.
Links: OpenSource NetMonitoring, Bandwidth Monitoring Tools for Ubuntu Users, Keeping tabs on your network traffic, Debian Network Tools For Administrators.

[X] vnStat - network monitoring; easy to integrate with vpsinfo (built-in support)
Installation:
# aptitude install vnstat
After installation, I got this error:
Unable to read database "/var/lib/vnstat/eth0". -> A new database has been created.
Solution: create databases for network interfaces in the system:
# vnstat -u -i eth0
# vnstat -u -i eth1
# vnstat -u -i eth2
# vnstat -u -i lo
# vnstat -u -i wlan0/ath0
To do: there should be a way to set up sysstat save logs, and then display them as graphs on a webpage. >> [update: found out vnstat PHP frontend, vnStatSVG, jsvnstat.]
Follow up: not yet.
Alternatives:
- BixData - mixed Virtualization Management; links: Server Monitoring With BixData (can send alerts; community edition up to 30 servers).
- Cacti (Nagios, PHP, RRDtool) - generally used to graph time-series data of metrics such as CPU load, network bandwidth utilization, network traffic via SNMP; links: Cacti On An ISPConfig Server Within 10 Easy Steps, Monitoring Ubuntu Servers and Desktops Using Cacti.
- Centreon (Nagios); links: Configure Centreon setup and database.
- Cricket (RRDtool) - collect SNMP data
- darkstat (packet sniffer, high CPU load); captures network traffic, calculates statistics about usage, and serves reports over HTTP; "efficiency: on my FreeBSD router, ppp takes an order of magnitude more CPU time than darkstat. If your system can keep up with PPPoE, you should have no trouble running darkstat."; links: Darkstat - Nework Traffic Analyzer or Network Monitor.
- GroundWork (Nagios, RRDtool) - Nagios to the next level
- Hyper HQ ; links: Network Management And Monitoring With Hyperic HQ On Ubuntu 7.04.
- MRTG (the original RRDtool package) - monitoring and measuring the traffic load on network links showing graphs;
- MRTNK - a set of scripts to make graphics and html pages similar to MRTG, but these scripts are based on rrd databases and rrdtool graphics, this allows better graphics, and use of negative/non integer data.
- Munin (Perl, RRDtool); links: Monitoring systems with munin, Munin examples, Monitoring Servers and Clients using Munin in Debian Linux, Server Monitoring With munin And monit (can send alerts)
- Nagios - the industry standard in IT infrastracture monitoring; links: Nagios Network Monitoring System Setup in Ubuntu (Nagios APT-watch plugin).
- ntop (RRDtool) - features rich; In interactive mode, it displays the network status on the user's terminal. In Web mode, it acts as a web server (port 3000), creating a HTML dump of the network status. It sports a NetFlow/sFlow emitter/collector, a HTTP-based client interface for creating ntop-centric monitoring applications; links: Network monitoring with ntop (CentOS 4).
- Smokeping/SmokeTrace - An Ajax Traceroute tool; links: Network Latency With Smokeping (Debian Etch).
- SNM - System and Network Monitor (RRDtool) - a tool to monitor, graph and alert the capacity of computing devices and applications.
- Webminstats - a basic system static logging application that graphs the results; it's Webmin's module which display a graphical log of historic information. It's modular in design, as to be able to log everything from CPU usage to email box size.
- Zabbix (PHP + db: MySQL/PostgreSQL/SQLite/Oracle) - monitor and track the status of various network services, servers, and other network hardware; ZABBIX includes support for monitoring via SNMP, TCP and ICMP checks, IPMI and custom parameters. ZABBIX supports a variety of real-time notification mechanisms, including XMPP; links: Installing Zabbix - Server And Agent (Debian Etch), Network Monitoring With Zabbix.
- Zenoss; links: Installing Zenoss Network Monitor on a Ubuntu Server.


SNMP
Links: SNMP + RRDTool + Cacti on Debian Lenny mini-HOWTO, OpenNMS.



Software

MySQL

[?] innotop - a 'top' clone for MySQL with more features and flexibility than similar tools (mytop)
under review

[X] mysqlreport - great tool, from the programmer of maatkit.
under review

[?] mysqlsniffer - great tool, from the programmer of maatkit.
under review

[X] mytop - monitoring the threads and overall performance of a MySQL 3.22.x, 3.23.x, and 4.x server.
Installation:
# aptitude install mytop
# cp /usr/share/doc/mytop/mytop.example ~/.mytop
# vim ~/.mytop
Configuration is explained in the sample file.


Email
- monitoring. Links: Postfix Monitoring With Mailgraph And pflogsumm (Debian Etch), Postfix Monitoring With Mailgraph And pflogsumm (Debian Sarge).


Email

Email

Email

Email

Email

Email

Links: Postfix Monitoring With Mailgraph And pflogsumm (Debian Etch), Postfix Monitoring With Mailgraph And pflogsumm (Debian Sarge).


Links: Projects on Google Code (search query).



About / Despre acest blog
Disclaimer and privacy statement / Confidenţialitate
Updated / Actualizat: 2009-09-15.

___


1 comment:

Ian Lim said...

Valuable info here, thanks for the share. If you want to hide what you are doing online then you should be using a VPN. There are some good ones here http://thebestproxyserver.com/cyberscrub/