Complex DynamoDB data into Redshift made easy

How to ingest DynamoDB Map / List types into Redshift

String vs DynamoDB Map

Ingesting DynamoDB data into Redshift

Redshift Copy Command

copy favoritemovies 
from 'dynamodb://ProductCatalog'
iam_role <insert iam role>
readratio 50;

DynamoDB to S3 Export using Data Pipeline

Image for post
Image for post
Image for post
Image for post
Datapipeline — Dynamo to S3: Source

DynamoDB to Flat File using AWS CLI

aws dynamodb scan --table-name 'myDynamoTable' --filter-expressions "<my filter expressions>"
aws dynamodb scan --table-name 'myDynamoTable' --filter-expressions "<my filter expressions>" | jq -r -c '.Items[]' --sort-keys -

What do you think?

Written by

Data and Productivity Writer — Data Architect at easyfundraising.org.uk

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store