π Hey there, I am Waylon Walker
I am a Husband, Father of two beautiful children, Senior Python Developer currently working in the Data Engineering platform space. I am a continuous learner, and sha
a kedro hook to protect against breaking changes to data
π₯Ύ Steel Toes
a kedro hook to protect against breaking changes to data
steel-toes is a kedro hook designed to prevent stepping on your teammates toes. It will branch your data automatically based on your git branch, or manually by passing the branch name into the hook.
Motivation
kedro is a β¨ fantastic project that allows for super-fast prototyping of data pipelines, while yielding production-ready pipelines. kedro promotes collaborative projects by giving each team member access to the exact same data. Team members will often make their own branch of the project and begin work. Sometimes these changes will break existing functionality. Sometimes we make mistakes as we develop, and fix them before merging in. Either case can be detrimental to a teammate working downstream of your changes if not careful.
π₯Ό Wear the proper PPE during feature development
steel-toes hooks into your catalog to prevent changing downstream data onβ¦
Released a new kedro plugin on pypi.
WaylonWalker / steel-toes
a kedro hook to protect against breaking changes to data
a kedro hook to protect against breaking changes to data
steel-toes
is a kedro hook designed to prevent stepping on your teammates toes. It will branch your data automatically based on your git branch, or manually by passing the branch name into the hook.Motivation
kedro
is akedro
promotes collaborative projects by giving each team member access to the exact same data. Team members will often make their own branch of the project and begin work. Sometimes these changes will break existing functionality. Sometimes we make mistakes as we develop, and fix them before merging in. Either case can be detrimental to a teammate working downstream of your changes if not careful.steel-toes
hooks into your catalog to prevent changing downstream data onβ¦