Streaming data: the hard bits
Modern Data Pipeline Approaches

"Streaming Data, the Hard Bits" will focus on building data pipelines in AWS with a streaming-first approach. It will cover the challenges and complexities involved in transitioning from traditional batch processing to real-time data streaming. Key topics will include architectural considerations, managing latency, scaling data streams, handling event ordering, and ensuring data consistency. The talk will also delve into specific AWS services, such as Redshift and EMR and strategies for optimizing cost and performance in a streaming environment.