DEV Community

loading...
Cover image for Migrating SharePoint Files to Azure Data Lakes Storage

Migrating SharePoint Files to Azure Data Lakes Storage

chixcancode profile image LaBrina Loving ・3 min read

So I recently had a customer that had several terrabytes of data in SharePoint that wanted to move to Azure Data Lakes Storage in order to start doing transformations for some Machine Learning experiments. Typically when migrating data to ADLS I would use something like Azure Data Factory Copy Activity, however SharePoint is not currently supported. However we can copy over these items easily using the Mover Migration Tool. The Mover Migration tool allows you to migrate docs from users or just SharePoint document libraries to Azure Data Lakes Storage. For the purposes of this, we are going to migrate a SharePoint Document library to ADLS. When copy over the documents, it will maintain the folder structure as well.

Prerequisites

Steps

  1. Go to https://mover.io/ and login with an account that is the SharePoint Admin and also AAD Admin that can create Enterprise Applications.
  2. Once you login, a new Enterprise Application is created. You can verify by going to your AAD tenant and going to Enterprise Applications. You should see Office 365 Mover listed as an Enterprise Application.
  3. In Enterprise Applications, click on the Office 365 Mover application, and then select Permissions on the left. Click Grant admin consent for tenant-name.
  4. Go back to Mover, click Authorize New Connector on Source side. Select Office 365(OneDrive/SharePoint Admin) from list and click Authorize button.
  5. Now on destination side, click Authorize New Connector and select Azure Blob Storage. Enter name of Blob storage and key.
  6. Once the Source and Destination has been configured, you can move onto Step 3: Start Transferring. Click Continue Migration. Mover Migration Tool Setup
  7. The Mover Migration tool migrates data using mapping CSV files as discussed in Prerequisite sections. Click on Add Users button and upload CSV file you created. You should now see mapping uploaded. Mapping
  8. If you are migrating a lot of data, I would suggest doing a Scan first. This will allow you to see how many files/folders will be migrated.
  9. Once you are ready, you can click Start Migrating User to copy data from SharePoint to ADLS. Select Right Now, agree to terms, and click Start Migration. Once complete, it will show a report of files/folders copied. ADLS Image

Et Voilá c'est fini

Discussion (0)

pic
Editor guide