Rewrite Kafka in Rust? I've developed a faster message queue, StoneMQ.

74 points jonefeewang 9 comments

TL;DR:

  1. Codebase: https://github.com/jonefeewang/stonemq
  2. Current Features (v0.1.0):
    • Supports single-node message sending and receiving.
    • Implements group consumption functionality.
  3. Goal:
    • Aims to replace Kafka's server-side functionality in massive-scale queue cluster.
    • Focused on reducing operational costs while improving efficiency.
    • Fully compatible with Kafka's client-server communication protocol, enabling seamless client-side migration without requiring modifications.
  4. Technology:
    • Entirely developed in Rust.
    • Utilizes Rust Async and Tokio to achieve high performance, concurrency, and scalability.

Feel free to check it out: Announcing StoneMQ: A High-Performance and Efficient Message Queue Developed in Rust.