Infinite cloud storage made practical
MinIO and Humio team up to provide scalable and efficient cloud data storage
March 5th, 2020
At Humio we focus on speed and scalability. Our performance vector is found in our lightning fast ingest and our index-free searches that handle PBs of data in less than a second. Behind that speed is a remarkably efficient software stack that offers infinite retention with minimal hardware requirements.
We actively seek out similar performance at scale in our partners which is why we are excited to announce our partnership with MinIO.
MinIO is a high-performance, Amazon S3 compatible object storage system. Designed from its inception to address data-rich, cloud-native workloads, MinIO has rapidly become the object store of choice for the private cloud amassing more than 318M Docker pulls and over 20K Github stars in just over four years.
Together, Humio and MinIO eliminate the limits commonly associated with what can be stored and, more importantly, what value can be gleaned from that data.
Bucket storage provides these significant features in Humio:
Makes cloud deployments of Humio inexpensive, faster, and easier to run.
Enables recovery from the loss of multiple Humio nodes without any data loss.
Allows keeping more events than the local disks can hold, enabling infinite retention.
Adding new nodes to the cluster only requires configuration, Kafka, and bucket storage.
As a result, bucket storage enhances streaming data performance - initially with the major public cloud providers, and now with on-premises providers like MinIO. With these elastic, scalable solutions, customers can search retained data — even from years ago — achieving results in seconds, without re-ingesting. Bucket storage reduces costs and improves compression, storing more events more efficiently than local disk solutions - thereby enabling infinite retention.
Morten Gram, EVP of Humio noted that, “At Humio, we believe that all data is live data and the amount of data collected should never be limited.” The addition of bucket storage for persistent data, removes the boundaries between live data and archiving data. This sentiment was echoed by MinIO COO and Co-Founder, Garima Kapoor who in turn commented that, “Bucket storage drives efficiency by making deployments significantly less expensive, while eliminating the concerns around storing large volumes of data.”
If your enterprise requires that you examine massive dataflows, and you’re looking for an S3 alternative, consider the pairing of MinIO and Humio as an improvement to your logging needs.
For more technical information about how Humio and MinIO work together, see Humio’s integration docs at https://docs.humio.com/integrations/storage/minio/.