Preview

Welcome to my blog on data engineering!

I will be participating in a 12-week data engineering mentoring program run by Data Science East Africa and Lux Academy, and I will be blogging about my learning progress here.

Week 1: Introduction to Data Engineering.

Data Engineering is the design and development of systems for collecting, storing and analyzing data at scale.

Week 1 was all about familiriazing ourselves with DE concepts and setting up the environments.

Technologies used and software requirements.

• Google Cloud Platform (GCP) a cloud-based auto-scaling platform by Google or AWS.

• Python language for coding, a python IDE and a text editor. I prefered anaconda.

• SQL server, MYSQL Workbench, DBeaver AND DBVisualizer.

• Git and version control system.

Week 1 was all about basic introduction and getting started.

Can't wait to document what I learn in week 2 and hopefully get a project to work on.