Insights - Page 4 Of 33

Negative Impact of Applying Functions to Join Columns in Teradata Joins: Performance Implications and Solutions

03/08/202605/05/2023 by Roland Wenzlofsky

Functions on Join Columns and Their Impact on Teradata Performance In many Teradata systems, developers apply functions directly in join conditions to work around data-model inconsistencies.While this approach might seem harmless, it can dramatically affect optimizer decisions and query performance — and often reveals deeper data-model issues. Example of a Problematic Join Applying functions to …

Introduction to Apache Spark: A Powerful Solution for Big Data Processing and Analytics

03/08/202605/05/2023 by Roland Wenzlofsky

Introduction Processing and analyzing large volumes of data quickly and efficiently is essential in today’s data-driven world. Apache Spark, an open-source big data processing engine, is a leading solution for handling massive datasets that offers a fast and flexible alternative to traditional data processing frameworks like Hadoop’s MapReduce. This article introduces Apache Spark, explores its …

Filter efficiently with Teradata NOS

03/08/202605/05/2023 by Roland Wenzlofsky

Teradata NOS facilitates querying data in an S3 object store with ease. To attain maximum performance, partitioning external data is crucial for efficient reading. This article outlines the key considerations for optimal efficiency when reading data from the object store. To begin, we must establish S3 access by obtaining an AUTHORIZATION object. In this instance, …

Teradata TD_WhichMax and TD_WhichMin Functions: A SQL Solution for Finding Min/Max Value of a Column with Low Resource Consumption

03/08/202605/05/2023 by Roland Wenzlofsky

What is the Teradata TD_WhichMax Function? Teradata releases new SQL features with each update, providing enhanced functionality and improved performance with reduced resource usage. We will examine the Teradata TD_WhichMax and TD_WhichMin functions and explore their potential benefits. These functions retrieve the minimum or maximum value of a column and are commonly utilized in SQL …

Dates ranges and business calendars beyond recursion and Teradata SYS_CALENDAR

03/08/202605/05/2023 by Roland Wenzlofsky

In a previous article, Roland explained how to use recursion to build a data range without touching a physical table. This time, we explore an alternative approach that avoids recursion at the expense of single-AMP, single-row access. We can use this approach to build both a wide date range as well as a narrow one. We …

Maximizing Performance and Space Savings: Teradata Compression Techniques

03/08/202605/05/2023 by Roland Wenzlofsky

Introduction to Teradata Compression Note: Teradata Block Level Compression is now permanently enabled and cannot be turned off. Nonetheless, this article remains useful for current Teradata systems utilizing block-level compression. It demonstrates the continued advantages of multi-value compression (Teradata MVC). With Teradata’s introduction of block-level compression, the utilization of multi-value compression at various Teradata sites …

Teradata strtok_split_to_table, CSVLD, Unpack: Column Splitting in Teradata

03/08/202605/05/2023 by Roland Wenzlofsky

Splitting column content can be a challenging task. Teradata provides multiple methods to achieve this, each with unique pros and cons. In this article, we will examine these techniques in detail. To begin, we will generate a table containing sufficient random data to assess every option’s efficiency and resource utilization. The Teradata “CSVLD” Function This …

Comparing Index Types of SQL Server and Teradata: Clustered vs Row Partitioning, Non-clustered vs NUSI, USI, Join Index, and More

03/08/202605/05/2023 by Roland Wenzlofsky

This article compares the index types in SQL Server and Teradata. It can benefit those transitioning between the two platforms to understand their distinctions and overlaps, despite their disparate architectures. Clustered Index vs Teradata Row Partitioning The SQL Server’s clustered index arranges table rows in a specific physical order, making it ideal for range-based queries. …

A Beginner’s Guide to Teradata Multiload and Fastload

03/08/202605/05/2023 by Roland Wenzlofsky

Introduction to Teradata Multiload and Fastload

How the Number of Rows per Data Block Affects Teradata NUSI Selectivity: A Case Study

03/08/202605/05/2023 by Roland Wenzlofsky

Teradata NUSI Selectivity and Data-Block Density The goal of this article is to show how the number of rows per base-table data block impacts the selectivity threshold for Non-Unique Secondary Indexes (NUSI) in Teradata. Understanding this correlation is critical when analyzing query plans and tuning indexing strategies.The number of qualifying rows that make a NUSI …