big data Archives

Hadoop and Teradata Data Warehousing: A Comparison and Integration Perspective

04/11/202605/05/2023 by Roland Wenzlofsky

Illustration of three stacked database storage units of differing heights against abstract chart shapes

Hadoop is a buzzword in the world of big data, but its actual value can be concealed by the hype. This article compares Teradata and Hadoop Data Warehousing, highlighting the advantages of leveraging Hadoop’s scalability and preprocessing capabilities to improve Teradata’s performance. However, the implementation of Hadoop by big database vendors may not be fully functional, and companies should proceed with caution before adopting new technologies.

Real-World Map-Reduce Implementations: Design and Fault Tolerance

08/22/202605/03/2023 by Roland Wenzlofsky

Illustration of a network graph with circular nodes joined by lines

Here is an illustration depicting the design of real-world map-reduce implementations, such as Hadoop: How the Components Fit Together The input files reside in a distributed file system, such as HDFS for Hadoop, or GFS as Google calls it. Worker processes handle mapper or reducer tasks. Mappers read data from HDFS, apply the mapping function, …

A Brief History of Parallel Database Architectures and Their Limitations

04/11/202604/21/2023 by Roland Wenzlofsky

Discover the history of parallel database architectures – from shared memory to shared disk and shared-nothing. Learn about the advantages and limitations of each architecture and how fault tolerance is handled. Explore the shift towards big data and the trend of “Hadoop over SQL.”