Engineering Blog

An in-depth breakdown of how we architected and built a native MySQL CDC source

Learn how we built an in-browser SQL shell that empowers Materialize users to interact with their databases

Recently, I've felt the pain of long Rust compile times at Materialize, and so was motived to improve them a bit. Here's how I did it.

Let's build (in Python) the Differential Dataflow framework at the heart of Materialize, and explain what it's doing along the way.

Materialize is written in Rust. Why did we make that decision and how has it turned out for the project?

Comprehensive guide on using PostgreSQL's write-ahead log as a data source for Materialize, with technical insights & benefits.

In this article, we will talk about one of the ways we approach the testing of the SQL engine of the product at Materialize. We hope to cover other modules and interesting angles in the future.

Differential dataflow uses simple linear operators: map, filter, flat_map and complex: explode and temporal filter operators. But, with some thinking, we can generalize them all to a restricted form of join.

Let's use Conway's Game of Life to illustrate how to write algorithms in differential dataflow.

Real-time data streaming directly to your browser with Materialize's latest one-day project; understand the technical journey & outcomes.

Harness the power of Rust for data-intensive tasks with Materialize, offering real-time insights & performance benefits.