Skip to content
loading...
Cover image for S3 CSV File to DynamoDB using EventBridge, AWS Lambda, Fargate and SQS

S3 CSV File to DynamoDB using EventBridge, AWS Lambda, Fargate and SQS

nideveloper profile image Matt Coulter twitter logo github logo ・1 min read  

cdkpatterns (16 Part Series)

1) What is CDKPatterns.com? 2) Deploy "The EventBridge Circuit Breaker" pattern today (AWS API Gateway, Lambda, EventBridge, DynamoDB) 3 ... 14 3) Deploy “The Big Fan” Serverless Pattern Today (AWS API Gateway, SNS, SQS and Lambda) 4) Deploy "The Simple GraphQL Service" Serverless Pattern Today (AWS Appsync, DynamoDB, Lambda, GraphQL) 5) Deploy Any cdkpatterns.com Serverless Pattern to AWS in 3 Commands 6) Learn GraphQL and AWS AppSync By Running One Command 7) S3 CSV File to DynamoDB using EventBridge, AWS Lambda, Fargate and SQS 8) Learn Lambda Destinations combined with Amazon EventBridge using AWS CDK for truly decoupled Event Driven Architecture 9) Watch Deconstructing The Destined Lambda on Youtube today! AWS Lambda, API Gateway, Destinations and EventBridge 10) Learn the 3 AWS Lambda states today (the single purpose function, the fat lambda and the lambda-lith). 11) Watch me deploy a React and an Angular website to AWS using AWS CDK with one command 12) Watch me deconstruct "The EventBridge ETL" Serverless Architecture Pattern 13) Learn "the saga stepfunction" pattern today - Single Table DynamoDB, Lambdas, Step Function and API Gateway 14) Watch me deconstruct "The Scalable Webhook" AWS Serverless Pattern - Lambda, API GW, SQS 15) Learn Serverless Tracability with "The X-Ray Tracer" CDK Pattern - Lambda, SNS, SQS, DynamoDB 16) Tune your AWS Lambdas for best cost vs performance with "The Lambda Power Tuner" serverless pattern

Setup a pipeline to take a csv file and transform it, then insert all the records into dynamodb using a fully serverless stack!

Alt Text

Just run the following command to get the code:

npx cdkp init the-eventbridge-etl

Then cd into the folder and if you have your aws local creds setup you can just run:

npm run deploy

Don’t fancy cloning the repo but want to read more?

https://github.com/cdk-patterns/serverless/blob/master/the-eventbridge-etl/README.md

twitter logo DISCUSS
Discussion
markdown guide
Classic DEV Post from Jul 30 '19

PublishTo.Dev: Scheduling article publishing on dev.to

Matt Coulter profile image
Software Architect working for @Liberty_IT in Belfast. Passionate about #Serverless, #AWS, @cdkpatterns, #TCO, and CI/CD