Explore ClickHouse Insights on ChistaDATA's Blog

ClickHouse Monitoring: Python Script to Monitor Linux Process Memory Matrix

Introduction Optimizing and monitoring the performance of your Linux kernel is absolutely key to achieving the highest performance from your ClickHouse cluster. In this article we explore how to use a simple python script to […]

Runbook for Troubleshooting ClickHouse Replication

Shiv Iyer

Introduction Replication is a critical part of horizontally scaling ClickHouse to meet growing user traffic and data size. Issues in replication are critical to resolve to maintain data integrity and ensure system scalability. In this […]

Runbook for Troubleshooting Excessive Logical IOs in ClickHouse

Monitoring and Troubleshooting Excessive Logical I/Os in ClickHouse

Shiv Iyer

Introduction Excessive logical I/Os in ClickHouse is a key reason for slow, sub-optimal, and expensive query performance and compromised scalability. In this detailed guide, we share tips & tricks to monitor and troubleshoot logical I/Os […]

How to implement Real-time Stream Processing in ClickHouse with Kafka

Shiv Iyer

Introduction Kafka is the ideal open source platform to implement real-time stream processing in ClickHouse for real-time analytics. At ChistaDATA Inc., we have extensive experience in working with Kafka in the context of ClickHouse for […]

How data compression is implemented in ClickHouse?

How are Data Compression Algorithms implemented in ClickHouse?

Shiv Iyer

Introduction ClickHouse implements data compression in several ways to reduce storage space and improve query performance. Here are a few examples of how data compression is implemented in ClickHouse: (1) Dictionary encoding ClickHouse uses dictionary […]

Python Script to monitor Kafka Producer Memory Leak in ClickHouse

Shiv Iyer

Introduction A memory leak in a Kafka producer can occur when the producer is unable to release memory that is no longer needed. This can lead to poor performance and, in extreme cases, cause the […]

How to Ingest Data from a Kafka topic in ClickHouse

How to use Kafka with ClickHouse?

Shiv Iyer

Introduction Kafka is a distributed streaming platform that can be used to collect, store, and process large streams of data in real-time. ClickHouse is a columnar database that can be used to perform real-time analytical […]

How ClickHouse Wire Protocol Is Implemented?

How is ClickHouse Wire Protocol implemented?

Shiv Iyer

Introduction The ClickHouse wire protocol is a binary protocol that is used to communicate between a client and a ClickHouse server. The protocol is implemented in the ClickHouse server and client libraries, and it uses […]

Real-Time Performance Monitoring for ClickHouse Cluster Using Python Script

Shiv Iyer

Introduction There are several ways to monitor the performance of a ClickHouse cluster: Using built-in system tables: ClickHouse has several built-in system tables, such as system.metrics, system.metrics_events, and system.query_log, that provide detailed information about the […]

What are Working Datasets in ClickHouse?

Shiv Iyer

Introduction In ClickHouse, a working dataset refers to a set of data that is stored in memory and used to perform operations such as sorting and aggregation. Working Dataset Types in ClickHouse ClickHouse has several […]