Incremental Snapshots in Debezium

Streaming New Tables with Debezium on AWS MSK Connect Introduction If you’re working with Debezium on MSK Connect and continuously evolving your database schema, you’ve probably faced the challenge of adding new tables to an already running pipeline. In my current setup, I stream data from MySQL tables into Amazon Redshift using Debezium CDC running on […]

Real-Time Data Streaming at Scale

A Practical Guide to AWS Kinesis Data Streams Enterprise applications have shifted from batch processing to real-time demands. Some must detect fraud in milliseconds, serve instant recommendations, or even trigger live monitoring alerts. Traditional message queues handle simple decoupling but fall short on throughput, ordering, and replay capabilities that streaming workloads require. AWS Kinesis Data Streams fills […]