Articles by Shiv Iyer

About Shiv Iyer

Open Source Database Systems Engineer with a deep understanding of Optimizer Internals, Performance Engineering, Scalability and Data SRE. Shiv currently is the Founder, Investor, Board Member and CEO of multiple Database Systems Infrastructure Operations companies in the Transaction Processing Computing and ColumnStores ecosystem. He is also a frequent speaker in open source software conferences globally.

How NULL Values affect ClickHouse Query Performance

Optimizing High-Velocity, High-Volume ETL Operations with Data Skipping Indexes in ClickHouse

Shiv Iyer

ClickHouse ETL Optimization Data Skipping Indexes in ClickHouse are an effective optimization tool for enhancing query performance in high-velocity, high-volume ETL operations. These indexes help by allowing the database to skip over blocks of data […]

Strategic Considerations for Integrating ClickHouse with Row-based Systems: Balancing Performance and Architecture

Shiv Iyer

Switching from a row-based to a column-based database system like ClickHouse involves significant architectural changes and strategic planning. This transition can offer substantial performance benefits, especially for analytics and read-heavy operations, but it also presents […]

How do we implement intelligent Caching on ClickHouse with machine learning?

Shiv Iyer

Implementing intelligent caching with machine learning in a ClickHouse environment involves predicting data access patterns and optimizing cache usage based on these predictions. This approach helps to ensure that the most frequently accessed or soon-to-be-accessed […]

Effective Strategies for Deleting Old Records in ClickHouse: Methods and Best Practices

Shiv Iyer

Deleting old records in ClickHouse requires careful consideration due to its append-only and columnar nature, which does not inherently support row-level deletions as efficiently as traditional relational databases. ClickHouse is designed for high-speed data writes […]

Unlocking High-Speed Analytics: Why ClickHouse Is Ideal for High-Velocity, High-Volume Data Ingestion

Shiv Iyer

ClickHouse is particularly well-suited for projects that require high-velocity, high-volume data ingestion and real-time analytics, primarily due to its specialized architecture and distinct features. Its columnar storage model plays a pivotal role, optimizing the processing […]

Enhancing ClickHouse Performance: Strategic Insights on Partitioning, Indexing, and Monitoring

Shiv Iyer

ClickHouse Performance tuning Optimizing ClickHouse performance involves a multi-faceted approach that includes effective partitioning, strategic indexing, and diligent system monitoring. Each of these areas plays a crucial role in enhancing the efficiency and speed of […]

Optimizing Query Performance: Understanding Criterion Indexability in ClickHouse

Shiv Iyer

Criterion indexability in ClickHouse refers to the database’s ability to efficiently utilize indexes for filtering data based on query conditions. ClickHouse, designed for fast analytical queries over large datasets, employs various indexing strategies to speed […]

Finding Missing Values in ClickHouse: Efficient Techniques for Data Comparison

Shiv Iyer

Finding Missing Values in ClickHouse Finding missing values in datasets is a common task in data analysis, especially when comparing two lists or tables to identify discrepancies. In ClickHouse, while there’s no built-in EXCEPT or […]

Enhancing GROUP BY Query Performance in ClickHouse: A Comprehensive Optimization Guide

Shiv Iyer

Mastering the art of crafting optimal GROUP BY queries in ClickHouse is essential for leveraging its robust analytical capabilities, especially when dealing with voluminous datasets. ClickHouse, renowned for its remarkable speed and scalability for OLAP […]

Mastering Performance Tuning in ClickHouse: Tips for Inspecting Statistics Objects

Shiv Iyer

Mastering ClickHouse performance tuning Inspecting statistics objects in ClickHouse is a pivotal activity for database administrators and data engineers aiming to optimise performance and troubleshoot issues. ClickHouse, renowned for its speed and efficiency in processing […]

ChistaDATA Inc.

Enterprise-class 24*7 ClickHouse Consultative Support and Managed Services

Articles by Shiv Iyer

Optimizing High-Velocity, High-Volume ETL Operations with Data Skipping Indexes in ClickHouse

Strategic Considerations for Integrating ClickHouse with Row-based Systems: Balancing Performance and Architecture

How do we implement intelligent Caching on ClickHouse with machine learning?

Effective Strategies for Deleting Old Records in ClickHouse: Methods and Best Practices

Unlocking High-Speed Analytics: Why ClickHouse Is Ideal for High-Velocity, High-Volume Data Ingestion

Enhancing ClickHouse Performance: Strategic Insights on Partitioning, Indexing, and Monitoring

Optimizing Query Performance: Understanding Criterion Indexability in ClickHouse

Finding Missing Values in ClickHouse: Efficient Techniques for Data Comparison

Enhancing GROUP BY Query Performance in ClickHouse: A Comprehensive Optimization Guide

Mastering Performance Tuning in ClickHouse: Tips for Inspecting Statistics Objects