ChistaDATA Inc.

Enterprise-class 24*7 ClickHouse Consultative Support and Managed Services

  • ChistaDATA
    • Columnar Stores vs. ROW-Based Databases
      • Vectorized Query
    • High Performance Analytics
    • Digital Transformation
  • ChistaDATA Server
    • Real-Time Analytics
      • Hadoop to ClickHouse
      • Amazon RedShift to ClickHouse
    • Data Archiving
    • ClickHouse Unveiled
    • ClickHouse Consulting
      • ClickHouse Performance Audit
        • Pre- Engagement Questionnaire
    • Online Ticketing System
  • Support
    • Data Analytics
    • Online Ticketing System
  • Managed Services
    • Why engage ChistaDATA?
    • ClickHouse Managed Services
    • ClickHouse Performance Tuning
    • DBaaS Optimization
    • Data SRE
    • Online Ticketing System
  • Data Science
  • ChistaDATA Fabric
    • Data Archiving
    • ChistaDATA ColumnStore
  • Blog
    • Shiv Iyer Talks
    • ChistaDATA Blog
  • Careers
  • Contact
  • Twitter
  • Facebook
  • LinkedIn
    • Shiv Iyer
  • GitHub
    • @ShivIyer
  • Medium
HomeAuthorsShiv Iyer

Articles by Shiv Iyer

About Shiv Iyer
Open Source Database Systems Engineer with a deep understanding of Optimizer Internals, Performance Engineering, Scalability and Data SRE. Shiv currently is the Founder, Investor, Board Member and CEO of multiple Database Systems Infrastructure Operations companies in the Transaction Processing Computing and ColumnStores ecosystem. He is also a frequent speaker in open source software conferences globally.
Website Facebook Twitter LinkedIn
Tuning ClickHouse for High-Velocity Data Ingestion in Distributed Tables
ClickHouse Performance

Implementing Tiered Storage in ClickHouse: Leveraging S3 for Efficient Data Archival and Compliance

Shiv Iyer

Using tiered storage like S3 for archiving data in ClickHouse is a common strategy for handling large volumes of data efficiently, particularly for compliance purposes where data must be retained but is queried infrequently. Here […]

When to Avoid Indexing in ClickHouse for Optimal Performance
ClickHouse Security

Implementing Custom Access Policies in ClickHouse: A Comprehensive Guide

Shiv Iyer

Implementing access policies in ClickHouse similar to SQL Server’s Purview Access Policies requires combining ClickHouse’s built-in access control mechanisms with additional scripting and possibly external tools. ClickHouse does not have a direct equivalent to SQL […]

ClickHouse Backup & DR

Implementing an Oracle RMAN-Like Backup and Recovery Toolkit for ClickHouse

Shiv Iyer

Implementing a comprehensive backup and recovery toolkit for ClickHouse is essential to ensure data integrity, consistency, and reliability, forming the core of ClickHouse Data Reliability Engineering. While ClickHouse lacks a built-in tool as comprehensive as […]

ClickHouse Redo Operations for Data Reliability
ClickHouse Performance

Efficient Strategies for Purging Data in ClickHouse: Real-Life Use Cases and Detailed Implementation

Shiv Iyer

Efficiently purging data from ClickHouse is crucial for maintaining performance and managing storage costs, especially when dealing with large, real-life datasets. Here are some detailed strategies, complete with real-life data sets and use cases: 1. […]

Troubleshooting High CPU Usage in ClickHouse
ClickHouse Security

Securing ClickHouse Data at Rest: A Guide to Implementing Filesystem-Level Encryption

Shiv Iyer

ClickHouse does not directly support Transparent Data Encryption (TDE) in the same way that some other database systems do, such as Oracle or SQL Server, which provide built-in TDE capabilities to automatically encrypt database files. […]

Mastering Chained Joins In Clickhouse
ClickHouse Performance

Enhancing Data Processing Workflows with Chained Materialized Views in ClickHouse

Shiv Iyer

Chaining materialized views in ClickHouse is a powerful feature that can significantly enhance data processing workflows by creating layers of data transformation and aggregation. This technique involves creating a series of materialized views where each […]

How NULL Values affect ClickHouse Query Performance
ClickHouse Performance

Optimizing High-Velocity, High-Volume ETL Operations with Data Skipping Indexes in ClickHouse

Shiv Iyer

Data Skipping Indexes in ClickHouse are an effective optimization tool for enhancing query performance in high-velocity, high-volume ETL operations. These indexes help by allowing the database to skip over blocks of data that do not […]

ClickHouse Performance

Strategic Considerations for Integrating ClickHouse with Row-based Systems: Balancing Performance and Architecture

Shiv Iyer

Switching from a row-based to a column-based database system like ClickHouse involves significant architectural changes and strategic planning. This transition can offer substantial performance benefits, especially for analytics and read-heavy operations, but it also presents […]

ClickHouse Performance

How do we implement intelligent Caching on ClickHouse with machine learning?

Shiv Iyer

Implementing intelligent caching with machine learning in a ClickHouse environment involves predicting data access patterns and optimizing cache usage based on these predictions. This approach helps to ensure that the most frequently accessed or soon-to-be-accessed […]

ClickHouse Performance

Effective Strategies for Deleting Old Records in ClickHouse: Methods and Best Practices

Shiv Iyer

Deleting old records in ClickHouse requires careful consideration due to its append-only and columnar nature, which does not inherently support row-level deletions as efficiently as traditional relational databases. ClickHouse is designed for high-speed data writes […]

Posts pagination

« 1 … 3 4 5 … 26 »

ChistaDATA is committed to open source software and building high performance ColumnStores

In the spirit of freedom, independence and innovation. ChistaDATA Corporation is not affiliated with ClickHouse Corporation 

Tell us how we can help!

Loading

Search ChistaDATA Website

★READ THIS WARNING★

* Everything changes over time – Our blogs/posts and comments changes over time, That’s how it should be! Whatever we comment from ChistaDATA Inc. Teams (including Shiv Iyer) and other stakeholders or guest bloggers posted here are never permanent, These things worked for us. But, there is no guarantee they will work for you too, When using the recommendations from ChistaDATA or MinervaDB or MinervaSQL or any other online resources / Google,  You must test the advice before applying them to your production systems, and always invest for a robust Database DR solution, Thank you for understanding. 

Recent Posts from ChistaDATA

  • Data Compression in ClickHouse for Performance and Scalability
  • Troubleshooting Conflicting Configuration Variables
  • Inverted Indexes in ClickHouse
  • Building Multi-Tenant ClickHouse Clusters
  • Eliminating Expensive JOINs in ClickHouse

☎ TOLL FREE PHONE (24*7)

(844)395-5717

🚩 ChistaDATA Inc. FAX

+1 (209) 314-2364

CORPORATE ADDRESS: HOUSTON

ChistaDATA Inc.,
1321 Upland Dr. PMB 19322, Houston,
TX, 77043, US

CORPORATE ADDRESS: CALIFORNIA

ChistaDATA Inc.
440 N BARRANCA AVE #9718 COVINA,
CA 91723

CORPORATE ADDRESS: NEW CASTLE, DELAWARE

ChistaDATA Inc.,
256 Chapman Road STE 105-4,
Newark, New Castle 19702,
Delaware

CORPORATE ADDRESS: DELAWARE

ChistaDATA Inc.,
PO Box 2093 PHILADELPHIA PIKE #3339
CLAYMONT, DE 19703

HOW CAN WE HELP?

We are committed to building Optimal, Scalable, Highly Available, Reliable, Fault-Tolerant and Secured Database Infrastructure Operations for WebScale to our customers globally

PostgreSQL is a registered trademark of the PostgreSQL Community Association. ClickHouse is a registered trademark of ClickHouse, Inc. MongoDB is a registered trademark of MongoDB, Inc. Couchbase is a registered trademark of Couchbase, Inc. Redis is a registered trademark of Redis Ltd. Apache Cassandra is a registered trademark of the Apache Software Foundation. Milvus is a registered trademark of Zilliz. MinIO is a registered trademark of MinIO, Inc. Amazon Redshift and Amazon Aurora are registered trademarks of Amazon.com, Inc. Google Cloud is a registered trademark of Google LLC. Snowflake is a registered trademark of Snowflake Inc. Databricks is a registered trademark of Databricks, Inc. MySQL and InnoDB are registered trademarks of Oracle Corporation. Oracle is a registered trademark of Oracle Corporation. MariaDB is a trademark of MariaDB Corporation Ab. All other trademarks are property of their respective owners. Other product or company names mentioned may be trademarks or trade names of their respective owner. Copyrights © 2010-2025. All Rights Reserved by ChistaDATA®.