Dealing with Data Pipeline Failures — Head in the clouds


In my previous post on migrating a large amount of data I walked through the challenges faced when using AWS Data Pipeline. Now that we have our Data Pipeline job running weekly, we decided to copy related data tables to Redshift as well. This came with it’s own challenges. We use the Incremental copy of RDS […]

via Dealing with Data Pipeline Failures — Head in the clouds

Advertisements