DEV Community


How to handle Kafka schema management among many developers?

・1 min read

On a project with many developers and different environments (local, develop, qa, production), what kind of processes/tools need to be implemented in order to avoid compatibility issues either during CI or later when making release?

I can't seem to find any guidelines/best practices about this on the web.

I am leaning towards a solution where developers validate and register new schemas against production Schema Registry. Maybe even creating some web application using Schema Registry REST API to show all schema versions and having ability to edit schema, validate changes (syntax and compatibility) and register new version. Then somehow replicate all new schema versions to other qa and develop environments.

There are other approaches like keeping schemas inside git repository.

What do you think?

Discussion (0)