Amazon Kinesis Data Streams adds dry run and streaming tables

Amazon Web Services has introduced two new capabilities for Amazon Kinesis Data Streams. The service now includes a ‘DryRun’ parameter for five specific APIs: PutRecord, PutRecords, GetRecords, GetShardIterator, and SubscribeToShard. This feature allows users to validate permissions and request inputs without executing the operation, preventing unintended data writes to production streams.

Additionally, AWS announced streaming tables, a serverless capability that continuously delivers data from Kinesis streams to Amazon S3 Tables in Apache Iceberg format. This feature is designed to automate data delivery pipelines, potentially reducing delivery costs by up to 50%. It includes intelligent inline compaction to address the ‘small file problem,’ which helps maintain predictable query performance and reduces downstream costs.