[CLSTR]
< Back to situations

Monitor this situation.

[SITUATION] · [QUIET] · [TECHNOLOGY]

2 clusters · 5 sources · 28 days · First seen · Last updated

AWS Apache Iceberg v3 integration

Overview

Amazon Web Services (AWS) has expanded its support for the Apache Iceberg v3 data specification across its data services.

Initially, Amazon Redshift introduced support for reading and writing Apache Iceberg v3 tables via Redshift Serverless and new single-node RG instances. This integration enables the use of features such as row lineage, delete vectors, and default column values through SQL. The RG instances, powered by AWS Graviton processors, are designed to provide faster performance for data warehouse and data lake workloads at a lower cost per vCPU.

Subsequently, AWS announced full native support for the Apache Iceberg V3 specification within Amazon S3 Tables. This update allows data engineers to use advanced data types, including geometry, geography, and nanosecond-precision timestamps, directly within the storage layer. The V3 specification also introduces binary deletion vectors to improve efficiency during compliance-related deletions by writing compact files rather than numerous small delete files.

Entities

Amazon Web Services · Apache Iceberg · Amazon Redshift · Amazon S3 Tables · AWS Glue Data Catalog

Timeline

  1. [TECHNOLOGY] 3 sources
    Amazon S3 Tables adds support for Apache Iceberg V3

    AWS has expanded Amazon S3 Tables to support the Apache Iceberg V3 specification, introducing native support for advanced data types like nanosecond timestamps and binary deletion vectors.

  2. [TECHNOLOGY] 3 sources
    Amazon Redshift adds single-node clusters and Apache Iceberg v3 support

    Amazon Redshift now supports single-node rg. large clusters using AWS Graviton and has added read/write support for Apache Iceberg v3 tables.

Sources

aws.com · dev.classmethod.jp · elemental.com · kerryconsulting.com · world-today-journal.com