Skip to main content

24 posts tagged with "engineering"

View All Tags

  • How Binance built a 100PB log service with Quickwit

    Binance Scales its Log Service to 100PB and Saves Millions with Quickwit

  • When allocating unused memory boosts performance by 2x

    Term aggregations are one of the key aggregations in our search engine quickwit.

  • Benchmarking Quickwit vs. Loki

    In 2019, Grafana launched Loki, a new log aggregation system, to tackle the challenges commonly faced by teams operating and scaling Elasticsearch:

  • Tantivy 0.22

    Exciting news from the search engine world — Tantivy 0.22 has just been released!

  • A math puzzle and a better algorithm for top-k

    A math brain teaser

  • Grafana Plugin 0.4: QoL features ahead!

    v0.4 has editor completions, improved log context, custom log messages, adhoc filters and many other improvements!

  • Quickwit 0.8: Indexing and Search at Petabyte Scale

    Quickwit 0.8 brings indexing and search at an unprecedented scale, indexing at 1PB/day and searching through 50 PB is a reality.

  • Grafana Plugin 0.3: Towards Application Performance Monitoring

    Grafana Plugin 0.3 brings Application Performance Monitoring, Trace Views, correlation between your datasources, and more!

  • Quickwit 0.7: Elasticsearch API compatibility and 30% performance gains

    Quickwit 0.7 brings Elasticsearch API compatibility, increased performance, Grafana and Jaeger UX improvements, and many other features.

  • Tantivy 0.21

    Oh my, what's that on the horizon? It's a new tantivy release!

  • Tantivy 0.20: Schemaless

    People rejoice! A new tantivy release. And it's packed with new features:

  • Quickwit 0.6: Elasticsearch compatibility, Grafana support, and more...

    This is with pride and delight that we are today releasing Quickwit 0.6!

  • Efficient indexing with Quickwit Rust actor framework

    At Quickwit, we are building the most cost-efficient search engine for logs and traces. Such an engine typically ingests massive amounts of data while serving a comparatively low number of search queries. Under this workload, most of your CPU is spent on indexing, making our indexing pipeline a crucial component.

  • The Organic Software Manifesto

    Reader of the future, this blog post was our 2023 April Fool. The blog post was 85% generated by ChatGPT, and the illustration is the fruit of Stable diffusion.

  • Quickwit 0.5: Distributed tracing with Open Telemetry and Jaeger, VRL, Pulsar support, and more...

    Today, we are thrilled to announce the release of Quickwit 0.5.0!

  • Tantivy 0.19 is out

    Tantivy 0.19 is an exciting release packed with new features! In this blog post, we will explore the most important updates and how they open up new possibilities for using Tantivy.

  • Quickwit 0.4: Distributed indexing with Kafka, K8s-native, and more!

    Today, we are proud to announce the release of Quickwit 0.4. More than 600 pull requests have been merged into the project since our last release six months ago. Notably, some significant contributions have come from the community. This version includes the following new features:

  • Filtering a Vector with SIMD Instructions (AVX-2 and AVX-512)

    This blog post will show how one can use SIMD instructions to optimize the code and highlight differences between AVX2 and AVX512.

  • Quickwit 0.3: schemaless indexing, aggregations, and more!

    Five months have passed since our last release, and our team has been working hard to deliver the next version of Quickwit. Today, we are proud to announce the release of Quickwit 0.3. This new feature-rich version introduces:

  • How to investigate memory usage of your rust program

    At Quickwit we have a mindset to create memory efficient and fast software, something that resonates with me personally. I love to create fast software and optimize it, since

  • Tantivy 0.17 is out

    Tantivy 0.17 is a great update that packs a lot of exciting features. We will describe the main ones in this blog post and open up the possibilities of using Tantivy:

  • Quickwit 0.2 brings full-text search to ClickHouse and Kafka!

    Quickwit wishes you a happy new year 2022!

  • A cool Rust optimization story

    I will be your rabbit guide

  • Quickwit: A highly cost-efficient search engine in Rust

    Meet Quickwit 0.1! A super cost-efficient search engine is born!