3 Steps to Set up Automatic WLM with Query Priority in Amazon Redshift December 06, 2021 by Donal Tobin Introduction With the release of Query Priorities and Automatic WLM, the AWS team has given Amazon Redshift administrators a powerful new way to define and prioritize data workloads. Without using...
How Yelp Built Their Data Pipeline with Amazon Redshift December 06, 2021 by Donal Tobin Yelp The tech world has changed dramatically since Yelp was launched back in 2004. Eight years later and Yelp started its change. It transformed from running a huge monolithic application...
What is the worst part of data engineering? December 06, 2021 by Abe Dearmer Table of Contents Drivers of change The Challenge of Data Engineering The worst part of data engineering Summary In data engineering teams the list is long and depends on your...
Customer Success Story: Fuze improves query performance by 10x December 06, 2021 by Abe Dearmer Fuze is a cloud-based communications and collaboration platform provider. Fuze drives workplace transformation for its customers with data from 2.5 million meetings, 20 million calls, and 33 million messages each...
Don’t Use Redshift as an OLTP Database December 06, 2021 by Donal Tobin It is common to connect an application framework like Django to Amazon Redshift. This is useful when using Redshift data in your application, i.e. in an OLTP scenario. Since Amazon...
Redshift’s Automatic WLM with Query Priority: A First Look at Performance December 06, 2021 by Abe Dearmer Introduction The AWS team recently released a new feature of their Automatic WLM that we’re really excited about: Query Priorities. This feature aims to address the main limitation of Auto...
Use Routine Vacuuming to Reclaim Unused Space December 06, 2021 by Abe Dearmer Amazon Redshift databases require periodic maintenance known as vacuuming. Amazon Redshift is based on PostgreSQL, but unlike PostgreSQL, Redshift doesn’t offer autovacuum. So when a row is deleted from a...
Use Column Encoding December 06, 2021 by Donal Tobin Adding compression to large, uncompressed columns will have a big impact on cluster performance. Compression accomplishes two things: Reduce storage utilization . Because file compression reduces the size footprint of...
Top 14 ETL Tools (Updated November 2024) June 04, 2024 by Abe Dearmer Integrate.io lists the 14 best ETL software tools for 2024 based on features, user review scores, and more. Which ETL tool should you choose?
MuleSoft vs. Integrate.io: Comparison and Review May 06, 2024 by Abe Dearmer When it comes to ETL solutions, Mulesoft ETL is like a Swiss Army Knife. But if all you need to do is open boxes, do you really need a corkscrew?
17 Best Data Integration Platforms May 13, 2024 by Abe Dearmer You have access to a wide range of data – make sure your organization can use it. Explore these seventeen data integration tools and platforms.