DWHPro Insights

databricks

You Migrated From Teradata to Spark and Threw Away the One Thing That Made It Fast Popular

Illustration of three stacked database units of differing heights inside a circle

If you have spent any amount of time working with Teradata, you know that the Primary Index is one of the most important design decisions you make. It determines how data is distributed across AMPs and whether your joins are fast or slow. Choosing the wrong Primary Index is one of the most common causes …

Read more

Data Warehouse of Horrors: 20 Years of Watching Smart People Build Stupid Things

In the projects I remember, a small team—sometimes five or six people—covered the whole warehouse. These staffing numbers and recalled conversations are personal observations, not an industry benchmark. This was the late 1990s. Data warehousing was young. Teradata was the dominant platform. And the people who built these systems understood, from end to end, what …

Read more

The 15-Year Detour: How the Data Industry Spent Billions Reinventing SQL

Illustration of three stacked database storage units of differing heights against abstract chart shapes

Somewhere around 2020, the data world quietly arrived at a conclusion that Teradata engineers could have told you in 1984: SQL on a massively parallel architecture is a pretty good way to process large volumes of data. The path to get there was anything but quiet. It involved billions in capital, an entire generation of …

Read more

The Medallion Architecture Is Not New. We Just Called It Something Else. Widely read

Illustration of a person in a suit standing beside a database cylinder

Why data warehouse professionals have been doing “bronze, silver, gold” for over 20 years. If you have been working in data warehousing for any length of time, the first time you heard about the “medallion architecture” you probably had one reaction: We already do this. You were right. The medallion architecture, popularized by Databricks as …

Read more

Teradata Hybrid: Bridge or Destination?

Icon of a chrome hammer inside an orange circle over a brick pattern

For many years, Teradata was the undisputed leader in large-scale data warehousing. Banks, insurers, and telcos built their most critical systems on it. Today, the market is very different. Cloud-native databases such as Snowflake, BigQuery, and Databricks have set new standards in elasticity and simplicity. The question is: what role will Teradata play in this …

Read more

Protected by Security by CleanTalk and CleanTalk Anti-Spam