Articles by Shiv Iyer

About Shiv Iyer
Open Source Database Systems Engineer with a deep understanding of Optimizer Internals, Performance Engineering, Scalability and Data SRE. Shiv currently is the Founder, Investor, Board Member and CEO of multiple Database Systems Infrastructure Operations companies in the Transaction Processing Computing and ColumnStores ecosystem. He is also a frequent speaker in open source software conferences globally.
Website Facebook Twitter LinkedIn
How data compression is implemented in ClickHouse?
ClickHouse Compression

ClickHouse Data Compression Algorithms Explained

Shiv Iyer
Introduction ClickHouse implements data compression in several ways to reduce storage space and improve query performance. Here are a few examples of how data compression is implemented in ClickHouse: (1) Dictionary encoding ClickHouse uses dictionary […]
How to Ingest Data from a Kafka topic in ClickHouse
ClickHouse Kafka

How to use Kafka with ClickHouse?

Shiv Iyer
Introduction Kafka is a distributed streaming platform that can be used to collect, store, and process large streams of data in real-time. ClickHouse is a columnar database that can be used to perform real-time analytical […]
What Are Working Datasets in ClickHouse
ClickHouse Internals

What are Working Datasets in ClickHouse?

Shiv Iyer
Introduction In ClickHouse, a working dataset refers to a set of data that is stored in memory and used to perform operations such as sorting and aggregation. Working Dataset Types in ClickHouse ClickHouse has several […]
Memory Management work in ClickHouse
ClickHouse Memory

How does Memory Management work in ClickHouse?

Shiv Iyer
Introduction In ClickHouse, memory management is handled by the MemoryTracker class, which is responsible for allocating and deallocating memory to different parts of the system. The MemoryTracker class uses a hierarchical approach to manage memory, […]