Articles by Shiv Iyer

About Shiv Iyer

Open Source Database Systems Engineer with a deep understanding of Optimizer Internals, Performance Engineering, Scalability and Data SRE. Shiv currently is the Founder, Investor, Board Member and CEO of multiple Database Systems Infrastructure Operations companies in the Transaction Processing Computing and ColumnStores ecosystem. He is also a frequent speaker in open source software conferences globally.

How to Avoid Mutations in ClickHouse?

Shiv Iyer

Introduction In ClickHouse, a mutation refers to any operation that modifies the data in the database, including insert, update and delete operations. These operations can affect the integrity of the data and the accuracy of […]

ClickHouse Proxy Server for Read-Write Splitting with Connection Pooling & Query Cache

Shiv Iyer

Introduction I have been a full-time Database Infrastructure Production Engineer for several years, working on MySQL, PostgreSQL and ClickHouse majorly with a deep passion for performance, scalability and Database Reliability Engineering. Most of my work […]

Configuring Asynchronous Inserts in ClickHouse

How to use Asynchronous Inserts in ClickHouse for High Performance Data Loading

Shiv Iyer

Introduction Asynchronous inserts in ClickHouse can be useful in situations where you need to insert a large amount of data into a table and you don’t want to wait for the data to be written […]

Algorithm of Log Structure Merge Tree (LSM-Tree)

Shiv Iyer

How does the Log Structure Merge Tree (LSM-Tree) work? Log Structured Merge Tree (LSM-Tree) is a data structure that is used to implement high-performance, disk-based storage systems such as RocksDB. The algorithm of LSM-Tree is […]

How Query Cache is Implemented in Database Systems?

How is Query Cache implemented in Database Systems like ClickHouse?

Shiv Iyer

Introduction In database systems, a query cache, also known as a result cache, is implemented by storing the result set of a query along with the query itself in a cache, so that if the […]

Monitoring ClickHouse Server Load

Shiv Iyer

Introduction What is the Data Load distribution happening to ClickHouse Server? I ask this question often to ClickHouse infrastructure owners. This matrix is used for trending the load and throughput. This will help me identify […]

Autonomous ClickHouse Infrastructure with ChistaDATA Cloud

Shiv Iyer

Introduction I have been a Database Systems Production Engineer/Site Reliability Engineer for almost two decades, with core interests in Performance, Scalability, High Availability and Data Security across MySQL and PostgreSQL infrastructure operations. I have been […]

ClickHouse MergeTree - Storage Infrastructure & Indexing

ClickHouse MergeTree: Configuring Storage Infrastructure & Indexes for Performance

Shiv Iyer

Introduction The heart of ClickHouse storage infrastructure is the MergeTree storage engine. They are 100% columnar data stores built for performance and resilience supporting customized partitioning, sparse primary key index, secondary data skipping indexes, […]

ChistaDATA Real-time Analytics

Building Real-time Analytics Infrastructure with ChistaDATA’s ClickHouse

Shiv Iyer

Introduction I have been a full-time Open Source Database Systems Performance Engineer for the last two decades with deep interests in Database Systems Internals, Database Systems (Transaction Processing and ColumnStores) Operations Performance Troubleshooting/Optimization and Unix/Linux […]

ClickHouse Performance Benchmarking – Brown University

Shiv Iyer

Introduction At ChistaDATA, We work for some of the largest ClickHouse installation worldwide and performance is very critical for our customers and ChistaDATA is committed to delivering optimal ClickHouse operations to the clients globally. ChistaDATA […]

ChistaDATA Inc.

Enterprise-class 24*7 ClickHouse Consultative Support and Managed Services

Articles by Shiv Iyer

How to Avoid Mutations in ClickHouse?

ClickHouse Proxy Server for Read-Write Splitting with Connection Pooling & Query Cache

How to use Asynchronous Inserts in ClickHouse for High Performance Data Loading

Algorithm of Log Structure Merge Tree (LSM-Tree)

How is Query Cache implemented in Database Systems like ClickHouse?

Monitoring ClickHouse Server Load

Autonomous ClickHouse Infrastructure with ChistaDATA Cloud

ClickHouse MergeTree: Configuring Storage Infrastructure & Indexes for Performance

Building Real-time Analytics Infrastructure with ChistaDATA’s ClickHouse

ClickHouse Performance Benchmarking – Brown University