Articles by Shiv Iyer

About Shiv Iyer

Open Source Database Systems Engineer with a deep understanding of Optimizer Internals, Performance Engineering, Scalability and Data SRE. Shiv currently is the Founder, Investor, Board Member and CEO of multiple Database Systems Infrastructure Operations companies in the Transaction Processing Computing and ColumnStores ecosystem. He is also a frequent speaker in open source software conferences globally.

ClickHouse Performance: Disabling Transparent Huge Pages (THP) in Linux

Shiv Iyer

Introduction Transparent Huge Pages (THP) is a memory management feature in the Linux kernel that allows the operating system to manage memory pages more efficiently. It works by grouping smaller memory pages into larger pages, […]

Tuning Linux for ClickHouse Performance

Shiv Iyer

Introduction Tuning the Linux kernel can significantly improve the performance of ClickHouse, a popular open-source columnar database management system. Here are some of the Linux kernel parameters that can be tuned to optimize ClickHouse performance: […]

ClickHouse Troubleshooting: Avoiding Excessive Disk Swaps

Shiv Iyer

Introduction Disk swapping is a technique used by operating systems to manage memory usage when the amount of available physical memory is limited. When the operating system runs out of available physical memory, it uses […]

Implementing Chebyshev's Inequality in ClickHouse

Data Science in ClickHouse: How to implement Chebyshev’s Inequality?

Shiv Iyer

Introduction Chebyshev’s inequality is a statistical theorem that provides a bound on the probability that a random variable deviates from its mean by more than a certain number of standard deviations. Specifically, it states that […]

Runbook for Zero Downtime ClickHouse Upgrades

Shiv Iyer

Introduction In the world of data analytics and high-performance databases, ClickHouse stands out for its speed, efficiency, and scalability. As organizations increasingly rely on real-time data processing and analytics, the need for maintaining continuous availability […]

Data Science in ClickHouse: Skewed Q-Q Plots

Shiv Iyer

How to Configure Global Process Area Parameters in ClickHouse

ClickHouse Memory: How to Configure Global Process Area Parameters

Shiv Iyer

Introduction In ClickHouse, the global process area is implemented as a shared-memory segment that is shared between all instances of the ClickHouse server running on the same machine. This shared-memory segment is used to store […]

Using EXPLAIN to Determine JOIN Order in ClickHouse Query Execution Plan

ClickHouse EXPLAIN: Determine JOIN Order in Query Execution Plan

Shiv Iyer

Introduction In ClickHouse, the join order in an execution plan is determined by the query optimizer, which analyzes the query and generates an optimal plan for executing the query. The optimizer uses statistics about the […]

Using TOP Command to Measure ClickHouse Server Load & Queue Length

Shiv Iyer

Introduction Measuring load and queue length of ClickHouse Server is important for troubleshooting performance bottleneck. The load is a measure of the amount of work that ClickHouse is currently doing or is capable of doing. […]

How to Monitor & Troubleshoot Log Contention in ClickHouse

Shiv Iyer

Introduction Log contention in ClickHouse occurs when multiple write operations compete for the same log file, causing performance issues and potentially leading to data corruption. Here are some steps you can take to troubleshoot and […]

ChistaDATA Inc.

Enterprise-class 24*7 ClickHouse Consultative Support and Managed Services

Articles by Shiv Iyer

ClickHouse Performance: Disabling Transparent Huge Pages (THP) in Linux

Tuning Linux for ClickHouse Performance

ClickHouse Troubleshooting: Avoiding Excessive Disk Swaps

Data Science in ClickHouse: How to implement Chebyshev’s Inequality?

Runbook for Zero Downtime ClickHouse Upgrades

Data Science in ClickHouse: Skewed Q-Q Plots

ClickHouse Memory: How to Configure Global Process Area Parameters

ClickHouse EXPLAIN: Determine JOIN Order in Query Execution Plan

Using TOP Command to Measure ClickHouse Server Load & Queue Length

How to Monitor & Troubleshoot Log Contention in ClickHouse