Pizofreude

CAE Engineer & Data Cruncher, Tech Stack Enthusiast, FOSS Advocate, and Avid Cyclist.

Die Erde Joined on Nov 12, 2022 https://pizofreude.medium.com

Education

University of Applied Sciences Heilbronn | HAW Hamburg | HOOU | MOOC

Pronouns

https://pizofreude.hashnode.dev/

Work

CAE Engineer

Pizofreude

May 2

Peer Review 3: France Data Engineering Job Market Transformations, Visualization, and Feedback (Part 2)

#dezoomcamp #dataengineering #cloud #learning

3 min read

Want to connect with Pizofreude?

Create an account to connect with Pizofreude. You can also sign in below to proceed if you already have an account.

Create Account

Already have an account? Sign in

Pizofreude

May 2

Peer Review 3: France Data Engineering Job Market Analysis Pipeline Infra (Part 1)

#dezoomcamp #dataengineering #learning #cloud

4 min read

Pizofreude

May 1

Peer Review 2: Data Warehousing, Transformation, and Reproducibility in tfl-data-visualization (Part 2)

#dezooomcamp #dataengineering #bigquery #dbt

3 min read

Pizofreude

May 1

Peer Review 2: TfL Station Footfall Data Analysis Pipeline (Part 1)

#dezoomcamp #dataengineering #dbt #kestra

3 min read

Pizofreude

Apr 30

Peer Review 1: Poland's Real Estate Market Dashboards and Insights with Streamlit (Part 2)

#dezoomcamp #dataengineering #streamlit #datascience

3 min read

Pizofreude

Apr 30

Peer Review 1: Analyzing Poland's Real Estate Market (Part 1)

#dezoomcamp #dataengineering #dbt #kestra

3 min read

Pizofreude

Apr 29

InsightFlow Part 9: Workflow Orchestration with Kestra

#dezoomcamp #dataengineering #orchestration #kestra

4 min read

Pizofreude

Apr 29

InsightFlow Part 8: Setting Up AWS Athena for Data Analysis in InsightFlow

#dezoomcamp #dataengineering #aws #analytics

3 min read

Pizofreude

Apr 29

InsightFlow Part 7: Data Quality Implementation & Best Practices for InsightFlow

#dezoomcamp #dataengineering #python #dbt

3 min read

Pizofreude

Apr 29

InsightFlow Part 6: Implementing ETL Processes with AWS Glue for InsightFlow

#dezoomcamp #dataengineering #etl #aws

3 min read

Pizofreude

Apr 29

InsightFlow Part 5: Designing the Data Model & Schema with dbt for InsightFlow

#dezoomcamp #dataengineering #dbt #datastructures

3 min read

Pizofreude

Apr 29

InsightFlow Part 4: Data Exploration & Understanding the Datasets

#dezoomcamp #dataengineering #datascience #analytics

3 min read

Pizofreude

Apr 29

InsightFlow Part 3: Building the Data Ingestion Layer with AWS Batch

#dezoomcamp #dataengineering #batchprocessing #aws

4 min read

Pizofreude

Apr 28

InsightFlow Part 2: Setting Up the Cloud Infrastructure with Terraform

#dezoomcamp #dataengineering #terraform #aws

3 min read

Pizofreude

Apr 9

InsightFlow Part 1: Building an Integrated Retail & Economic Data Pipeline - Project Introduction

#dezoomcamp #dataengineering #sideprojects #devjournal

4 min read

Pizofreude

Mar 18

Study Notes 6.15: Kafka & Flink Streaming

#dataengineering #dezoomcamp #kafka #pyflink

5 min read

Pizofreude

Mar 18

Study Notes 6.13-14: Kafka Streaming with Python & PySpark Structured Streaming with Kafka

#dataengineering #dezoomcamp #kafka #pyspark

7 min read

Pizofreude

Mar 18

Study Notes 6.11-12: Kafka ksqlDB, Connect & Schema Registry

#dataengineering #dezoomcamp #kafka #sql

7 min read

Pizofreude

Mar 18

Study Notes 6.7-10: Kafka Stream Basics, JOIN, Testing & Windowing

#dataengineering #dezoomcamp #streaming #kafka

13 min read

Pizofreude

Mar 18

Study Notes 6.5-6: Kafka Producer, Consumer & Configuration

#dataengineering #dezoomcamp #kafka #streaming

7 min read

Pizofreude

Mar 18

Study Notes 6.3-4: What is Kafka & Confluent Cloud

#dataengineering #dezoomcamp #kafka #cloud

6 min read

Pizofreude

Mar 18

Study Notes 6.1-2: Introduction to Stream Processing

#dataengineering #dezoomcamp #streamprocessing #kafka

3 min read

Pizofreude

Mar 4

Study Notes 5.6.3-4 Setting up a Dataproc Cluster & Connecting Spark to Big Query

#dataengineering #dezoomcamp #spark #bigquery

8 min read

Pizofreude

Mar 4

Study Notes 5.6.1-2 Spark on cloud & local

#dataengineering #dezoomcamp #spark #cloud

7 min read

Pizofreude

Mar 4

Study Notes 5.5.1-2 Operations on Spark RDDs & Spark RDD mapPartition

#dataengineering #dezoomcamp #spark #rdd

9 min read

Pizofreude

Mar 4

Study Notes 5.4.1-3 Anatomy of a Spark Cluster GroupBy & Joins in Spark

#dataengineering #dezoomcamp #sql #spark

11 min read

Pizofreude

Mar 4

Study Notes 5.3.3-4 Data Processing & SQL with Spark

#dataengineering #dezoomcamp #sql #spark

9 min read

Pizofreude

Mar 4

Study Notes 5.3.1-2 First Look at Spark/PySpark & Spark Dataframes

#dataengineering #dezoomcamp #pyspark #sparkdataframe

9 min read

Pizofreude

Mar 4

Study Notes 5.1.1-2 Introduction to Batch Processing & spark

#dataengineering #dezoomcamp #batchprocessing #spark

6 min read

Pizofreude

Feb 25

Study Notes 4.5.2: Visualizing Data with Metabase (Alternative B)

#dataengineering #dezoomcamp #dbt #metabase

4 min read

Pizofreude

Feb 25

Study Notes 4.4.1 | 4.4.2 : Deployment Using dbt Cloud and Locally

#dataengineering #dezoomcamp #dbtcore #dbtcloud

3 min read

Pizofreude

Feb 25

Study Notes 4.3.2 - Testing and Documenting the Project

#dataengineering #dezoomcamp #dbt #documentation

3 min read

Pizofreude

Feb 25

Study Notes 4.3.1 - Build the First dbt Models

#dataengineering #dezoomcamp #dbt #datamodeling

4 min read

Pizofreude

Feb 25

Study Notes 4.2.1 | 4.2.2: DBT Project Setup

#dataengineering #dezoomcamp #dbt #analyticsengineering

2 min read

Pizofreude

Feb 25

Study Notes 4.1.2: What is dbt?

#dataengineering #dezoomcamp #dbt #analyticsengineering

3 min read

Pizofreude

Feb 25

Study Notes 4.1.1 - Analytics Engineering Basics

#dataengineering #dezoomcamp #dbt #analyticsengineering

4 min read

Pizofreude

Feb 17

Study Notes dlt Workshop: API, Warehouses, Data Lakes

#dataengineering #dezoomcamp #dlt #beginners

5 min read

Pizofreude

Feb 17

Study Notes dlt Fundamentals Course: Lesson 8 Understanding Pipeline Metadata and State

#dataengineering #dezoomcamp #dlt #beginners

4 min read

Pizofreude

Feb 17

Study Notes dlt Fundamentals Course: Lesson 7 Inspecting & Adjusting Schema

#dataengineering #dezoomcamp #dlt #beginners

4 min read

Pizofreude

Feb 17

Study Notes dlt Fundamentals Course: Lesson 5 & 6 - Write Disposition, Incremental Loading, How dlt works

#dataengineering #dezoomcamp #dlt #beginners

5 min read

Pizofreude

Feb 17

Study Notes dlt Fundamentals Course: Lesson 3 & 4 - Pagination, Authentication, dlt Configuration, Sources & Destinations

#dataengineering #dezoomcamp #dlt #beginners

3 min read

Pizofreude

Feb 17

Study Note dlt Fundamentals Course - Lesson 2: dlt Sources and Resources, Create First dlt Pipeline

#dataengineering #dezoomcamp #dlt #beginners

2 min read

Pizofreude

Feb 17

Study Note dlt Fundamentals Course - Lesson 1 Quick Start

#dataengineering #dezoomcamp #dlt #beginners

2 min read

Pizofreude

Feb 11

Study Notes: Data Query on S3 Bucket Using Athena

#dataengineering #dezoomcamp #athena #aws

3 min read

Pizofreude

Feb 11

Study Note 3.3.2: BigQuery Machine Learning Model Deployment using Docker

#dataengineering #dezoomcamp #machinelearning #docker

4 min read

Pizofreude

Feb 11

Study Notes 3.3.1: BigQuery Machine Learning (BQML)

#dataengineering #dezoomcamp #bigquery #machinelearning

4 min read

Pizofreude

Feb 11

Study Notes 3.2.2: BigQuery Internal Architecture

#dataengineering #dezoomcamp #bigquery #architecture

2 min read

Pizofreude

Feb 11

Study Note 3.2.1: BigQuery Best Practices

#dataengineering #dezoomcamp #bigquery #beginners

3 min read

Pizofreude

Feb 11

Study Notes 3.1.2: Partitioning and Clustering in BigQuery

#dataengineering #dezoomcamp #clustering #bigquery

3 min read

Pizofreude

Feb 11

Study Note DE Zoomcamp 3.1.1 - Data Warehouse and BigQuery

#dataengineering #dezoomcamp #bigquery #datawarehouse

3 min read

Pizofreude

Feb 11

Efficiently Handling AWS Credentials: Best Practices and Techniques

#todayilearned #aws #beginners #tutorial

2 min read

Pizofreude

Feb 4

Study Notes 2.2.7: Managing Schedules and Backfills with BigQuery in Kestra

#dataengineering #dezoomcamp #bigquery #kestra

2 min read

Pizofreude

Feb 4

Study Note 2.2.6: ETL Pipelines in Kestra on Google Cloud Platform

#dataengineering #dezoomcamp #kestra #cloud

2 min read

Pizofreude

Feb 4

Study Note 2.2.5: Orchestrate dbt Models with Postgres in Kestra

#dataengineering #dezoomcamp #dbt #kestra

2 min read

Pizofreude

Feb 4

Study Notes 2.2.4: Managing Scheduling and Backfills with Postgres in Kestra

#dataengineering #dezoomcamp #postgres #kestra

2 min read

Pizofreude

Feb 4

Study Notes 2.2.3: Setting Up an ETL Pipeline with Kestra and Postgres

#dataengineering #dezoomcamp #kestra #postgres

2 min read

Pizofreude

Feb 4

Study Notes 2.2.2: Learning Kestra

#dataengineering #dezoomcamp #kestra #workfloworchestration

2 min read

Pizofreude

Feb 4

Study Notes 2.2.1: Workflow Orchestration with Kestra

#dataengineering #dezoomcamp #kestra #orchestration

2 min read

Pizofreude

Feb 4

Study Notes 1.3.3: Terraform Variables

#dataengineering #dezoomcamp #terraform #beginners

2 min read

Pizofreude

Feb 4

Study Notes 1.3.2: Terraform Basics with GCP

#dataengineering #dezoomcamp #terraform #beginners

2 min read