Chris and Martin discuss the challenges of database sharding, scaling and performance with speedb CEO Adi Gelvan.


The post #225 – Accelerating Modern Databases with Speedb appeared first on Storage Unpacked.

In this episode, Chris and Martin discuss storage engine efficiency and performance with Speedb CEO, Adi Gelvan. Storage engines form the core of all databases, providing the translation between the structured form of data the application sees, and the way in which data is written onto physical media like disks or SSDs. The performance and resiliency of a database is directly affected by the performance of the storage engine. Speedb has developed technology that optimises the underlying engine for many applications – RocksDB. Optimisation is more than pure performance. Database scaling involves sharding – splitting a database using some characteristic of the data. The result of sharding is increased costs and complexity, especially in the public cloud. Adi explains how Speedb helps avoid sharding and reduces resource consumption.

You can find out more about speedb at https://www.speedb.io/

Elapsed Time: 00:38:41

Timeline

00:00:00 – Intros00:01:00 – Why Speedb?00:03:15 – What is a database storage engine?00:05:00 – MySQL, MongoDB and other databases have pluggable storage engines00:06:30 – What’s driving a need for better storage engines?00:08:00 – Data is now trillions of files and metadata00:11:00 – Existing storage engines are complex – like real engines00:12:45 – Database performance has lots of “solutions” thrown at it00:13:30 – RocksDB derived from LevelDB00:15:15 – Sharding is a solution for scaling databases00:19:30 – Speedb provides both fast read and fast write performance00:21:15 – Cloud has made sharding easy – with an associated cost!00:23:45 – Speedb maintains API compliance with RocksDB00:26:40 – API compatibility is essential for plug and play components00:32:15 – Is storage “done”?00:35:00 – Speedb will initially work with OEMs and look at Open Source00:38:00 – Wrap Up

Related Podcasts & Blogs

#140 – Introduction to Document-Orientated Databases#180 – SmartNICs – Pliops Storage ProcessorDatabases are the next battleground for Public Cloud

Copyright (c) 2016-2022 Storage Unpacked. No reproduction or re-use without permission. Podcast episode #d17f.


The post #225 – Accelerating Modern Databases with Speedb appeared first on Storage Unpacked.