How to download models from CivitAI (including behind a login) and Hugging Face (including private repos) into cloud services such as Google Colab, Kaggle, RunPod, Massed Compute and upload models / files to your Hugging Face repo full Tutorial
How to Download (wget) Models from CivitAI & Hugging Face (HF) & upload into HF including privates
Hugging Face Download / Upload Notebook File (fully shown in the video) ⤵
https://www.patreon.com/posts/hugging-face-and-104672510
-
If you are having trouble to download models onto your cloud platforms such as RunPod, Google Colab, Kaggle, Massed Compute or anywhere, this tutorial is made for you. Moreover, you can upload your files / models into your private Hugging Face repository and save them permanently privately and download them super fast. By following this tutorial, you will be able to download CivitAI models that requires login. So with this tutorial you will be able to download and upload even private models from and to Hugging Face and also download models from CivitAI whether public or behind login by using wget command and a specially crafted JupteryLab notebook.
The logic explained in this video works for every kind of files that you can download via a URL onto any cloud platform that supports wget command.
Hugging Face Download / Upload Notebook File (fully shown in the video) ⤵
https://www.patreon.com/posts/hugging-face-and-104672510
0:00 Introduction to the ultimate model download / upload tutorial to the cloud services
0:32 How to download public model from CivitAI onto cloud services e.g. RunPod
0:50 How to understand if a CivitAI model requires login and thus API token
1:03 Download a public model onto RunPod
1:20 How to use wget command to download models / files
2:03 How to download a public model onto Massed Compute
2:30 How to download a public model into desired folder in Google Colab
2:43 How to compose a directory / folder on Google Colab
2:51 The Google Colab’s pathing directory / folder logic
3:03 How to navigate between folders / directories of Google Colab
3:13 Start download on Google Colab with wget in desired directory
3:31 How to compose a directory / folder on a Kaggle notebook
3:41 The Kaggle’s pathing directory / folder logic
3:51 How to navigate between folders / directories of Google Colab
4:01 Start download on Google Colab with wget in desired directory
4:17 How to utilize / use Kaggle’s temporary disk space
5:24 How to download files / models from a public Hugging Face repository into the cloud services such as Google Colab
7:00 How to download models / files on Windows
7:18 How to download models from CivitAI that requires login into cloud services such as Kaggle
7:42 How to get your CivitAI API key for free to download models
8:02 How to format wget download link with API Key to download models behind a login on CivitAI
8:55 How to download models / files from Hugging Face private repositories easy way
10:04 How to download models / files from Hugging Face private repositories by using HF API with a very advanced Jupyter notebook
10:29 How to use HF notebook file on RunPod
10:44 How to understand if Jupyter notebook cell execution completed or still running
10:59 How to get your Hugging Face API token key and login in the Jupyter notebook
11:27 How to download entire private repository via the Jupyter notebook on RunPod
12:06 How to upload files or folders to your Hugging Face repository — can be both private or public
12:43 How to use Hugging Face uploader / downloader notebook on Massed Compute
13:17 How to use Hugging Face uploader / downloader notebook on Kaggle
14:45 How to upload a file / folder in Kaggle to the Hugging Face — you can use this to save your trained models as well
15:19 Importance of repository type on Hugging Face
16:15 How to use Hugging Face uploader / downloader notebook on Google Colab
16:25 Install cell is mandatory on all platforms
16:55 How to select / set download folder path on Google Colab
17:25 How to use Hugging Face uploader / downloader notebook on Windows PC locally
17:35 How to install JupyterLab on Windows to be able to use notebooks
17:50 How to open Jupyter notebook on JupteryLab interface
18:10 How to set folder paths on Windows in Hugging Face uploader / downloader notebook
18:42 Why put “r” letter to the front of folder paths on Windows
Title: How to Download Models from CivitAI and Hugging Face onto Cloud Services and Personal Computers
Summary:
This comprehensive video tutorial demonstrates how to download machine learning models from CivitAI and Hugging Face onto various cloud computing platforms such as RunPod, Massed Compute, Kaggle, and Google Colab, as well as personal computers. It covers downloading both public and login-protected models from CivitAI, and models from public and private repositories on Hugging Face. The tutorial also shows how to upload models to Hugging Face.
Key Steps:
Downloading public models from CivitAI:
Right-click the download link and copy the URL
Use the wget command in the terminal with the URL in double quotes
Optionally specify a custom file name using the -O flag
Paste the command and execute it to start the download
Downloading login-protected models from CivitAI:
Generate an API token in your CivitAI account settings
Append ?token=your_API_token to the model download URL
Use the modified URL with the wget command to download the model
Downloading models from public Hugging Face repositories:
Top comments (0)