DEV Community

Cover image for [Apache Superset] Topic #2, Superset ARCHITECTURE
Duc Nguyen Thanh
Duc Nguyen Thanh

Posted on

[Apache Superset] Topic #2, Superset ARCHITECTURE

Hello, it's me again - Duc Nguyen (Duke)
In the previous part, we talked about the concept, how to install and launch Superset, if you haven't seen it, click here

Today, let's talk about the most important topic to mastering Supersets - ARCHITECTURE!

Superset 4.0.2 has the following main modules:

1.Superset application
2.Metadata database
3.Worker
4.Beat
5.Caching
Enter fullscreen mode Exit fullscreen mode

First, so what's the purpose of Superset application?

Superset application is a core component, included the Python (Flask) (backend), API layer and React (frontend)

How about the Metadata database?
It uses for store chart definitions, dashboards, user information, logs, etc with the PostgreSQL and MySQL supported

How about the Worker?

  • Execute asynchronous tasks
  • Run asynchronous queries
  • Send emails

How about the Beat?

  • Acts as a scheduler
  • Specifies the time for workers to perform their tasks

In short, Worker and Beat work together with the caching layer, using it as a message broker to coordinate tasks.

How about the Caching?

  • Cache query results to speed up and reduce load on the data warehouse
  • Act as a message broker for workers
  • Usually uses Redis

Do you have any questions? Let's wait for the next topic to guide you on how to explore and visualization data.

Top comments (0)