DEV Community

Jader Lima profile picture

Jader Lima

With over 10 years of experience in Data Engineering, Business Intelligence, and Development. I have a solid track record in developing Batch and Streaming data pipelines using Azure technologies such

Joined Joined on 
Using Google Cloud Functions for Three-Tier Data Processing with Google Composer and Automated Deployments via GitHub Actions
jader_lima_b72a63be5bbddc profile

Using Google Cloud Functions for Three-Tier Data Processing with Google Composer and Automated Deployments via GitHub Actions

#gcp #python #airflow #serverless
Comments
11 min read

Want to connect with Jader Lima?

Create an account to connect with Jader Lima. You can also sign in below to proceed if you already have an account.

Create Account
Already have an account? Sign in
Using Cloud Functions and Cloud Schedule to process data with Google Dataflow
jader_lima_b72a63be5bbddc profile

Using Cloud Functions and Cloud Schedule to process data with Google Dataflow

#gcp #dataflow #cloudfunctions #cloudscheduler
Comments
7 min read
Loading data to Google Big Query using Dataproc workflow templates and cloud Schedule
jader_lima_b72a63be5bbddc profile

Loading data to Google Big Query using Dataproc workflow templates and cloud Schedule

#gcp #dataproc #bigquery #bigdata
2
Comments
12 min read
Creating a data pipeline using Dataproc workflow templates and cloud Schedule
jader_lima_b72a63be5bbddc profile

Creating a data pipeline using Dataproc workflow templates and cloud Schedule

#pyspark #gcp #dataproc #pipelines
Comments
12 min read
Running pyspark jobs on Google Cloud Dataproc
jader_lima_b72a63be5bbddc profile

Running pyspark jobs on Google Cloud Dataproc

#pyspark #gcp #dataproc #pipeline
4
Comments
7 min read
loading...