Berkeley DB at Yammer

In early 2011 we set out to replace an 11 billion row PostgreSQL message delivery database with something a bit more scale-ready. We reached for several databases with which we were familiar, but none proved to be a fit for various reasons. Following in the footsteps of so few before us, we took the wheel of the SS Berkeley DB Java Edition and piloted it into the uncharted waters of horizontal scalability.

In this talk, Ryan Kennedy (Director of Core Services Engineering) covers Yammer’s journey through log cleaner infested waters, being hijacked on the high seas by the BDB B-tree cache, and our eventual flotilla of a 45 node, 256 partition BDB cluster.