What's OpenTSDB?
sponsored the development and open-source release of OpenTSDB and uses it as their main monitoring system.
Thanks to HBase's scalability, OpenTSDB allows you to collect many thousands of metrics from thousands of hosts and applications, at a high rate (every few seconds). OpenTSDB will never delete or downsample data and can easily store billions of data points. As a matter of fact, StumbleUpon uses it to keep track of hundred of thousands of time series and collects over 1 billion data points per day in their main production datacenter.
Imagine having the ability to quickly plot a graph showing the number of
DELETE statements going to your MySQL database along with the
number of slow queries and temporary files created, and correlate this with
the 99th percentile of your service's latency. OpenTSDB makes generating such
graphs on the fly a trivial operation, while manipulating millions of
data point for very fine grained, real-time monitoring.
15464 points retrieved, 932 points plotted in 100ms
Generating custom graphs and correlating events is easy.
At StumbleUpon, we have found this system tremendously helpful to:
- Get real-time state information about our infrastructure and services.
- Understand outages or how complex systems interact together.
- Measure SLAs (availability, latency, etc.)
- Tune our applications and databases for maximum performance.
- Do capacity planning.
OpenTSDB is free software and is available under the LGPLv2.1+ license.
Join the OpenTSDB mailing list: opentsdb@googlegroups.com
If you're coming to HBaseCon on May 22, 2012 in San Francisco, don't miss the talk on Lessons Learned from OpenTSDB.
December 23, 2011: OpenTSDB 1.0.0 has been released!
