What's OpenTSDB?
OpenTSDB is a distributed, scalable Time Series Database (TSDB) written on top of HBase. OpenTSDB was written to address a common need: store, index and serve metrics collected from computer systems (network gear, operating systems, applications) at a large scale, and make this data easily accessible and graphable.
Thanks to HBase's scalability, OpenTSDB allows you to collect many thousands of metrics from thousands of hosts and applications, at a high rate (every few seconds). OpenTSDB will never delete or downsample data and can easily store billions of data points. As a matter of fact, StumbleUpon uses it to keep track of hundred of thousands of time series and collects over 1 billion data points per day in their main production datacenter. Other sites such as Box or Tumblr are pushing tens of billions of data points per day.
Imagine having the ability to quickly plot a graph showing the number of
DELETE statements going to your MySQL database along with the
number of slow queries and temporary files created, and correlate this with
the 99th percentile of your service's latency. OpenTSDB makes generating such
graphs on the fly a trivial operation, while manipulating millions of
data point for very fine grained, real-time monitoring.
15464 points retrieved, 932 points plotted in 100ms
Generating custom graphs and correlating events is easy.
We have found this tremendously helpful to:
- Get real-time state information about our infrastructure and services.
- Understand outages or how complex systems interact together.
- Measure SLAs (availability, latency, etc.)
- Tune our applications and databases for maximum performance.
- Do capacity planning.
OpenTSDB is free software and is available under the LGPLv2.1+ license.
Join the OpenTSDB mailing list: opentsdb@googlegroups.com
2013-11-08: OpenTSDB 2.0.0 RC 2 has been released. Please download it from GitHub and help us find bugs! Checkout the documentation to find out what's new.
2013-08-05: OpenTSDB 2.0.0 RC 1 has been released. Please download it from GitHub and help us find bugs! Checkout the new documentation to find out what's new.
2013-06-19: Thanks to everyone who attended HBaseCon and to Jonathan Creasy and Geoff Anderson of Box for their OpenTSDB @scale presentation! OpenTSDB was everywhere, from the keynote, to graphs showing up in slides during various talks. Visit the HBaseCon site for videos and slides. And thank you to the folks from Turn who dropped by our little meetup with cool updates to the UI.
2013-03-12: We're hard at work on OpenTSDB v2.0. Read the roadmap and contribute your ideas.
2013-03-08: OpenTSDB v1.1.0 has been released. Read the announcement.
2013-02-16: The second release candidate of OpenTSDB v1.1.0 is available. Read the announcement.
2013-02-14: AsyncHBase v1.4.1 was released.
Watch the video of the talk on "OpenTSDB at Box", given at the January SF Metrics Meetup.
2013-01-20: The first release candidate of OpenTSDB v1.1.0 is available. Read the announcement.
Thanks to those who attended the lightening talk and subsequent poster session about OpenTSDB at XLDB, on September 11, 2012 at Stanford University. Watch the talk on YouTube.
Thanks to those who attended HBaseCon on May 22, 2012 in San Francisco, here are the slides of the talk on Lessons Learned from OpenTSDB.
December 23, 2011: OpenTSDB 1.0.0 has been released!
This site isn't very pretty, you can improve it by forking it on GitHub.