DWHPro Insights

Columnar Storage

Understanding Skew in Teradata and Snowflake Popular

Icon of a chrome hammer inside an orange circle over a brick pattern

Performance degradation caused by uneven workload distribution is one of the oldest and most persistent challenges in parallel data warehouse systems. Both Teradata and Snowflake can experience this imbalance, commonly known as skew. Although the term is shared, the mechanics differ fundamentally: Teradata can suffer from both persistent and runtime skew, whereas Snowflake’s skew occurs …

Read more

Migrating Bulk Loads from Teradata to Snowflake

Icon of a chrome hammer inside an orange circle over a brick pattern

Big files, real risks, and how not to overspend Snowflake load parallelism depends on format and file options as well as file count. Qualifying large uncompressed CSV files support parallel scanning. Multiple moderately sized files can help, but one file is not universally one thread. Start with roughly 100–250 MB compressed parts as a guideline …

Read more

Negative Impact of Applying Functions to Join Columns in Teradata Joins: Performance Implications and Solutions Widely read

Illustration of a stopwatch dial on an orange paint-splash background

Functions on Join Columns and Their Impact on Teradata Performance In many Teradata systems, developers apply functions directly in join conditions to work around data-model inconsistencies.While this approach might seem harmless, it can dramatically affect optimizer decisions and query performance — and often reveals deeper data-model issues. 🎓 Prefer video? Lecture 12 of my Udemy …

Read more

How the Number of Rows per Data Block Affects Teradata NUSI Selectivity: A Case Study

Illustration of a stopwatch dial on an orange paint-splash background

The historical threshold and performance results below have not been reproduced on the current release. A 20,000-row functional check confirmed that the former decimal literals 19.332 and 19.333 both selected only integer keys through 19, while 19332 selected keys through 19,332. The SQL cutoffs have been corrected. Teradata NUSI Selectivity and Data-Block Density The goal …

Read more

Teradata Set Operators: Understanding UNION vs. UNION ALL for Peak Performance Optimization Most read

Illustration of a glossy orange database cylinder with data fragments across its surface

In this article, we will delve into the world of Teradata set operators, exploring their functionality, applications for attaining peak performance, and the optimization techniques employed by Teradata. 🎓 Prefer video? Lecture 17 of my Udemy course Teradata Performance Tuning in Practice, “GROUP BY vs DISTINCT, UNION vs UNION ALL”, covers this topic. See the …

Read more

Teradata vs. Redshift: A Comparison of Join Strategies and Architecture

Illustration of three stacked database units of differing heights inside a circle

Teradata and Redshift share similar architectures and data distribution methods. Teradata’s AMPs store portions of table data, while Redshift utilizes slices. There are notable differences in the way data is stored on file systems. Row/column storage and join-maintenance trade-offs are workload- and deployment-dependent. This article does not establish universal row-store superiority or lower operating effort. …

Read more

Teradata Columnar Compression Methods: Run-Length, Dictionary, and Delta Compression Popular

Illustration of a stopwatch dial on an orange paint-splash background

Learn about the benefits of compression in Teradata Columnar, including a reduction in permanent space and disk IOs. Different compression methods are used, including run-length, dictionary, and delta compression. This article explains how each method works and the advantages of using them.

Teradata Columnar Solution: Advantages and Disadvantages Popular

Illustration of three stacked database units of differing heights inside a circle

How Advanced Is The Teradata Columnar Solution? A Column Store is defined by three distinct properties: Why Is The Teradata Solution Great Even Though It Does Not Offer Columnar Processing? Assuming a standard query, a date range selection is frequently made with a WHERE condition imposing a date restriction. However, only a portion of the …

Read more

Understanding Teradata’s Primary AMP Index for Improved Performance Popular

Illustration of a stopwatch dial on an orange paint-splash background

Experienced Teradata users are familiar with the concept of a primary index. However, a new term has surfaced with the introduction of Teradata Release 15: Primary AMP Index. This blog post will demonstrate a Primary AMP Index’s benefits and optimal usage for improving load and query performance. First, let us examine Teradata’s approaches over the …

Read more

Protected by Security by CleanTalk and CleanTalk Anti-Spam