DEV Community

James profile picture

James

Data engineer

Location Kenya Joined Joined on  github website twitter website
Running Transformations on BigQuery using dbt Cloud: step by step

Running Transformations on BigQuery using dbt Cloud: step by step

1
Comments
6 min read
Debugging Python Data Pipelines

Debugging Python Data Pipelines

Comments
3 min read
Using pyspark to stream data from coingecko API and visualise using dash

Using pyspark to stream data from coingecko API and visualise using dash

2
Comments
6 min read
kafka: event driven microservices

kafka: event driven microservices

3
Comments
6 min read
kafka: distributed task queue

kafka: distributed task queue

4
Comments
6 min read
Building a Weather Data Pipeline with PySpark, Prefect, and Google Cloud

Building a Weather Data Pipeline with PySpark, Prefect, and Google Cloud

10
Comments
5 min read
prefect vs apache airflow

prefect vs apache airflow

4
Comments
4 min read
BigQuery: Creating a pipeline between MySql and BigQuery using airflow

BigQuery: Creating a pipeline between MySql and BigQuery using airflow

2
Comments
4 min read
Airflow : create your first airflow DAG using tweepy

Airflow : create your first airflow DAG using tweepy

3
Comments
6 min read
Python ETL: Creating and automating a pipeline from Mysql to postgresql

Python ETL: Creating and automating a pipeline from Mysql to postgresql

17
Comments
5 min read
Python-tweepy: automating a follow back task using windows scheduler

Python-tweepy: automating a follow back task using windows scheduler

7
Comments
3 min read
Python: Using Spark-SQL

Python: Using Spark-SQL

3
Comments
2 min read
loading...