FastGPU

Storage

FastGPU provides users with the ability to store data within their pods. The storage within the pod by default is meant to be ephemeral and will be deleted once the pod is deleted or restarted. To apply persistent storage, you can leverage the file system and mount it as a folder within the pod.

Upload files

To upload files, you can use Web UI, CLI, or Upload from Cloud to do so. Here are the details for each method.

Upload files with Web UI

You can upload files to the storage via the web UI. On the File System page under storage tab, click Upload File then choose From local will open a file picker for you to select the file you want to upload.

Upload files with CLI

$ lep storage upload /local/path/to/a.txt /a.txt

If you are uploading a folder or large files(over 1 GBs), you need to use --rsync flag to do so. rsync is only available for Standard and Enterprise workspace plans. Here is an example:

# upload a folder
$ lep storage upload -r /local/path/to/folder /folder --rsync
# upload a large file, such as a model checkpoint, add --progress to show the progress
$ lep storage upload /local/path/to/a.safetensors /a.safetensors --rsync --progress

For more details, check out the [CLI documentation on storage](LINK TO CLI REFERENCE).

Upload files from Cloud

You can also upload files from cloud storage services such as AWS S3 and Cloudflare R2. On the File System page, click Upload File then choose From Cloud will open a dialog for you to select the cloud storage service and fill in the required information.

For AWS S3, you need to provide the following information:

  • Bucket Name : The name of the bucket you want to upload from.
  • Access Key ID : The access key of the AWS account.
  • Secret Access Key : The secret access key of the AWS account.
  • Destination Path : The path in the file system you want to upload to.

For Cloudflare R2, you need to provide the following information:

  • Endpoint URL : The S3 API URL of the Cloudflare R2 bucket. It can be found in the bucket's settings page uder Bucket Details. Do not include the bucket name in the URL. It should look like https://xxxxxxxxx.r2.cloudflarestorage.com.
  • Bucket Name : The name of the bucket you want to upload from.
  • Access Key ID : The access key of the Cloudflare R2 API Token. You can manage and create R2 tokens by clickin the Manage R2 API Tokens button in the bucket's settings page.
  • Secret Access Key : The secret access key of the Cloudflare R2 API Token.
  • Destination Path : The path in the file system you want to upload to.