DEV Community

Cover image for A simple serverless architecture on AWS ecosystem for data ETL and visualization
metacollective
metacollective

Posted on

A simple serverless architecture on AWS ecosystem for data ETL and visualization

Serverless architecture
A simple step by step architecture for building an ETL process and then displaying that data back to the enduser by only using serverless service from AWS.

  • End user uploads data file into the S3 (This can be done manually by logging onto the console or via an API accessible through a frontend application)

  • S3 triggers a Lambda function on receiving a create object event

  • Lambda function receives S3 event object and processes the data from file into a relational database on AWS's Aurora database (ETL)

  • End user can now access this data from database by accessing the web application statically hosted on S3 & served via the Cloudfront

  • This web application will make relevant API calls via ApiGateway (attached to Lambda functions) to fetch data

Discussion (0)