DEV Community

Mage profile picture

Mage

🧙 The modern replacement for Airflow. Mage is an open-source data pipeline tool for transforming and integrating data.

Location Santa Clara, CA Joined Joined on  Personal website https://github.com/mage-ai/mage-ai twitter website
How to build a data pipeline using Delta Lake

How to build a data pipeline using Delta Lake

4
Comments 1
9 min read

Want to connect with Mage?

Create an account to connect with Mage. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Getting started with Apache Flink: A guide to stream processing

Getting started with Apache Flink: A guide to stream processing

1
Comments
8 min read
Apache Flink vs Apache Spark: A detailed comparison for data processing

Apache Flink vs Apache Spark: A detailed comparison for data processing

2
Comments
5 min read
Apache Flink episode 1: A comprehensive introduction

Apache Flink episode 1: A comprehensive introduction

1
Comments
6 min read
Data sources episode 2: AWS S3 to Postgres Data Sync using Singer

Data sources episode 2: AWS S3 to Postgres Data Sync using Singer

2
Comments
4 min read
Data sources episode 1: Common data sources in modern pipelines

Data sources episode 1: Common data sources in modern pipelines

1
Comments
6 min read
Mage Battlegrounds: Craft insights from real-time customer behavior analysis

Mage Battlegrounds: Craft insights from real-time customer behavior analysis

2
Comments
2 min read
What is data integration?

What is data integration?

10
Comments 2
4 min read
Data pipelines for data scientists - looking for contributors for new open-source notebook

Data pipelines for data scientists - looking for contributors for new open-source notebook

8
Comments
1 min read
New release: Open source code editor for data pipelines

New release: Open source code editor for data pipelines

7
Comments
1 min read
So Fresh and So Data Clean - Event

So Fresh and So Data Clean - Event

12
Comments
1 min read
A Visualizer for PyTorch Image Transformations

A Visualizer for PyTorch Image Transformations

11
Comments
2 min read
Explorations in Knowledge Distillation

Explorations in Knowledge Distillation

10
Comments
7 min read
Model Improvement - Data leakage

Model Improvement - Data leakage

8
Comments
6 min read
Model evaluation - MAP@K

Model evaluation - MAP@K

11
Comments 1
7 min read
Music genre classification part 2

Music genre classification part 2

8
Comments
11 min read
Using machine learning (ML) to generate the ultimate Taylor Swift playlist

Using machine learning (ML) to generate the ultimate Taylor Swift playlist

14
Comments 1
9 min read
Loan prediction

Loan prediction

15
Comments 4
9 min read
Youtube's Machine learning (ML) algorithm

Youtube's Machine learning (ML) algorithm

23
Comments
5 min read
League of Legends rank(ing) guide

League of Legends rank(ing) guide

18
Comments 1
16 min read
Music genre classification

Music genre classification

20
Comments 1
19 min read
Data Cleaning - Filter

Data Cleaning - Filter

11
Comments 1
5 min read
Building your first machine learning model

Building your first machine learning model

15
Comments
8 min read
Machine learning (ML) applications: customer churn prediction

Machine learning (ML) applications: customer churn prediction

10
Comments 1
4 min read
Feature Engineering - Extract column from JSON

Feature Engineering - Extract column from JSON

17
Comments
5 min read
Feature Engineering - Expand category column

Feature Engineering - Expand category column

11
Comments 1
6 min read
Machine learning (ML) applications: ranking

Machine learning (ML) applications: ranking

15
Comments 1
5 min read
Feature Engineering - Add with conditional

Feature Engineering - Add with conditional

11
Comments
6 min read
How does Pinterest use machine learning (ML)?

How does Pinterest use machine learning (ML)?

11
Comments
4 min read
Data Cleaning - Sort Values

Data Cleaning - Sort Values

8
Comments
5 min read
Feature Engineering - Min/Max Aggregate

Feature Engineering - Min/Max Aggregate

4
Comments
4 min read
How is Artificial Intelligence (AI) being used to predict fashion trends?

How is Artificial Intelligence (AI) being used to predict fashion trends?

24
Comments 5
5 min read
Model Training - K Fold Cross Validation

Model Training - K Fold Cross Validation

6
Comments
5 min read
Mage now spreading more AI magic with their General Availability

Mage now spreading more AI magic with their General Availability

8
Comments
2 min read
How does Starbucks use machine learning (ML)?

How does Starbucks use machine learning (ML)?

15
Comments
3 min read
How does Airbnb use machine learning (ML)?

How does Airbnb use machine learning (ML)?

14
Comments
4 min read
How does TikTok use machine learning?

How does TikTok use machine learning?

21
Comments
4 min read
Teaching AI to Generate New Pokemon

Teaching AI to Generate New Pokemon

219
Comments 11
7 min read
How does Spotify use Machine Learning?

How does Spotify use Machine Learning?

17
Comments
3 min read
Guide to Churn Prediction : Part 5— Graphical analysis

Guide to Churn Prediction : Part 5— Graphical analysis

17
Comments 2
7 min read
How did Netflix use ML to become the world’s streaming leader?

How did Netflix use ML to become the world’s streaming leader?

17
Comments
4 min read
How is AI used for business optimization?

How is AI used for business optimization?

11
Comments 1
4 min read
Software as a Story: API

Software as a Story: API

7
Comments
5 min read
Is the Metaverse the future of technology?

Is the Metaverse the future of technology?

42
Comments 24
7 min read
Guide to Churn Prediction : Part 4 — Graphical analysis

Guide to Churn Prediction : Part 4 — Graphical analysis

14
Comments 4
6 min read
How is AI being used to fight against cyber attacks?

How is AI being used to fight against cyber attacks?

15
Comments 1
3 min read
How is AI used to generate music?

How is AI used to generate music?

41
Comments 8
4 min read
How AI is used for mental health therapy

How AI is used for mental health therapy

18
Comments 4
8 min read
How is AI being used in space exploration?

How is AI being used in space exploration?

11
Comments 1
4 min read
Guide to Model Metrics - Part 1: Matrix performance

Guide to Model Metrics - Part 1: Matrix performance

14
Comments 1
4 min read
Guide to Churn Prediction: Part 3 — Descriptive statistical analysis

Guide to Churn Prediction: Part 3 — Descriptive statistical analysis

16
Comments 6
6 min read
What is Text Mining, NLP Analysis and the N-gram model?

What is Text Mining, NLP Analysis and the N-gram model?

11
Comments 1
7 min read
Guide to model training — Part 6: Save & Load

Guide to model training — Part 6: Save & Load

13
Comments
4 min read
How does AI impact self-driving cars?

How does AI impact self-driving cars?

14
Comments 2
4 min read
Guide to Churn Prediction : Part 1 — Gather & Clean

Guide to Churn Prediction : Part 1 — Gather & Clean

9
Comments 1
7 min read
How has COVID accelerated use of AI for mental health?

How has COVID accelerated use of AI for mental health?

13
Comments 2
5 min read
10 steps to build and optimize a ML model

10 steps to build and optimize a ML model

17
Comments 2
9 min read
How do we integrate responsible AI?

How do we integrate responsible AI?

10
Comments
5 min read
Guide to model training: Part 5 - Reliable Remarketing

Guide to model training: Part 5 - Reliable Remarketing

10
Comments
4 min read
Why does AI responsibility matter

Why does AI responsibility matter

14
Comments
4 min read
loading...