DWHPro Insights

data warehouse

You Migrated From Teradata to Spark and Threw Away the One Thing That Made It Fast Popular

Illustration of three stacked database units of differing heights inside a circle

If you have spent any amount of time working with Teradata, you know that the Primary Index is one of the most important design decisions you make. It determines how data is distributed across AMPs and whether your joins are fast or slow. Choosing the wrong Primary Index is one of the most common causes …

Read more

Data Warehouse of Horrors: 20 Years of Watching Smart People Build Stupid Things

In the projects I remember, a small team—sometimes five or six people—covered the whole warehouse. These staffing numbers and recalled conversations are personal observations, not an industry benchmark. This was the late 1990s. Data warehousing was young. Teradata was the dominant platform. And the people who built these systems understood, from end to end, what …

Read more

The 15-Year Detour: How the Data Industry Spent Billions Reinventing SQL

Illustration of three stacked database storage units of differing heights against abstract chart shapes

Somewhere around 2020, the data world quietly arrived at a conclusion that Teradata engineers could have told you in 1984: SQL on a massively parallel architecture is a pretty good way to process large volumes of data. The path to get there was anything but quiet. It involved billions in capital, an entire generation of …

Read more

Why Two Identical Teradata Migrations Produce Wildly Different Snowflake Costs

Illustration of three stacked database storage units of differing heights against abstract chart shapes

Migration success stories are everywhere. A quick search reveals case studies of companies that moved from Teradata to Snowflake and achieved faster queries, lower total cost of ownership, and happier analysts. Vendors publish them. Consultants reference them. Conference speakers present them as evidence that the migration path is well-trodden and safe. These stories are not …

Read more

The Medallion Architecture Is Not New. We Just Called It Something Else. Widely read

Illustration of a person in a suit standing beside a database cylinder

Why data warehouse professionals have been doing “bronze, silver, gold” for over 20 years. If you have been working in data warehousing for any length of time, the first time you heard about the “medallion architecture” you probably had one reaction: We already do this. You were right. The medallion architecture, popularized by Databricks as …

Read more

Coming soon: A Modern Web-Based Alternative to Teradata Studio Popular

Illustration of a person in a suit standing beside a database cylinder

Introducing DWHPro Query Master: A Modern Web-Based Alternative to Teradata Studio As Teradata professionals, we’ve all been there: waiting for Teradata Studio to launch, dealing with Java updates, or struggling with its dated interface when all we want to do is run a quick query. That’s why I’m excited to introduce DWHPro Query Master – …

Read more

Understanding Skew in Teradata and Snowflake Popular

Icon of a chrome hammer inside an orange circle over a brick pattern

Performance degradation caused by uneven workload distribution is one of the oldest and most persistent challenges in parallel data warehouse systems. Both Teradata and Snowflake can experience this imbalance, commonly known as skew. Although the term is shared, the mechanics differ fundamentally: Teradata can suffer from both persistent and runtime skew, whereas Snowflake’s skew occurs …

Read more

Why the Same UPDATE Means Something Entirely Different in Teradata and Snowflake Popular

Illustration of a glossy orange database cylinder with data fragments across its surface

At first glance, an UPDATE looks universal.In reality, it’s one of the most misleading similarities between Teradata and Snowflake.The SQL is the same, but the storage, logging, recovery, and performance mechanics are completely different. If you’re migrating from Teradata to Snowflake (or running both), understanding these differences prevents slow jobs, unnecessary costs, and avoidable outages. …

Read more

A Beginner’s Guide to Teradata Multiload and Fastload Most read

Icon of a chrome hammer inside an orange circle over a brick pattern

Introduction to Teradata Multiload and Fastload MultiLoad does not run in isolation: how the utilities are throttled as a workload of their own and the smaller-volume alternative in BTEQ. Next steps Next: query logging Review: SET and MULTISET tables Return to the Teradata learning path

Protected by Security by CleanTalk and CleanTalk Anti-Spam