Create account

DEV Community

Mritunjay Sharma

Posted on Sep 17, 2020

Using GitHub Actions to Automate Image Classification with Microsoft Azure Custom Vision Services

#actionshackathon #azure #python #github

My Workflow

I created this new GitHub Action available here with which we can automate the entire process of image classification with Azure Custom Vision.
With this - all a user needs to do is:

Add the 4 SECRETS which are basically Azure Custom Vision Services Credentials. The process is explained in the README
Upload Image Dataset in the GitHub Repo and modify the tags, tagsVar and trainSize accordingly in the below yml file.

Here's a sample workflow YML file using this Action:

name: Auto Custom Vision Classifier
on:
  push:
    paths:
    - '**.yml'
jobs:
  build_model:
    runs-on: ubuntu-latest
    steps:
    - name: Automating Image Classification with Microsoft Azure Custom Vision Training and Prediction
      uses: mritunjaysharma394/autoCustomVision@v1.0
      with:
        tags: "[Hemlock,Japanese Cherry]" # Rename it according to the folder name under images/ which will also be our name to the tags
        tagsVar: "[hemlock_,japanese_cherry_]" # Rename it according to the symmetry of file names under images/tag/ 
        trainSize: "10" # Train Size of Each Tag
        endpoint: ${{ secrets.AZURE_ENDPOINT }}
        trainingKey: ${{ secrets.AZURE_TRAINING_KEY }}
        predictionKey: ${{ secrets.AZURE_PREDICTION_KEY }}
        predictionResourceid: ${{ secrets.AZURE_PREDICTION_RESOURCE_ID }}

Submission Category:

DIY Deployments

Yaml File or Link to Code

Link to GitHub Repo of the Action and the Workflow:

mritunjaysharma394 / autoCustomVision

GitHub Action automating the entire process of image classification with Microsoft Azure Custom Vision Service

Automating Image Classification with Microsoft Azure Custom Vision Training and Prediction

This GitHub Action automates the entire process of image classification with Microsoft Azure Custom Vision Service.

How to use

Step 1:

To use the Custom Vision Service you will need to create Custom Vision Training and Prediction resources in Azure. To do so in the Azure portal, fill out the dialog window on the Create Custom Vision page to create both a Training and Prediction resource.

Step 2:

Get the Endpoint, Training Key, Prediction Key and Prediction Resource ID credentials andd save it as Secrets in your GitHub repository settings. You can find the items at the Custom Vision website . Sign in with the account associated with the Azure account you used to create your Custom Vision resources. On the home page (the page with the option to add a new project), select the gear icon in the…

View on GitHub

Additional Resources / Info

Working Video Example:

Mritunjay Sharma

@mritunjay394

So submitted my second GitHub Actions and it’s workflow for the #ActionsHackathon 🥳💃

What it does is absolutely magic by Automating the entire Image Classification process with #Azure Custom Vision.

All you need is a 'push'🤓

PS:Thank you so much @HaimantikaM for the video

19:22 PM - 17 Sep 2020

2 7