S3 OBJECT STORAGE
- How to Delete Large S3 Bucket on CODE-DE
- How to Mount Object Storage Container as a File System in Linux Using s3fs on CODE-DE
- How to use Object Storage on CODE-DE
- How to access private object storage using S3cmd or boto3 on CODE-DE
- S3FS Cache on CODE-DE
- How to install boto3 in Windows on CODE-DE
- How to mount object storage container from CODE-DE as file system on local Windows computer
- Prerequisites
- What We Are Going To Cover
- Software tools used in this article: Rclone, WinFSP, and NSSM
- How to use the Rclone configuration file
- Step 1 Download and install the appropriate software
- Step 2: Enter the connection data
- Step 3: Perform a test mount
- Step 4: Tweak the –dir-cache-time option
- Step 5: Configure automatic mounting of your container
- Removing software responsible for automatic mounting of eodata
- Bucket sharing using s3 bucket policy on CODE-DE
- How to install s3cmd on Linux on CODE-DE
- Configuration files for s3cmd command on CODE-DE
- How to access object storage from CODE-DE using boto3
- Prerequisites
- Terminology: containers vs. buckets
- How to use the examples provided
- Running Python code
- Listing buckets
- Choosing a bucket for the examples
- Creating a bucket, if needed
- Checking when a bucket was created
- Listing files in a bucket
- Listing files from a particular path in a bucket
- Uploading file to a bucket
- Downloading file from a bucket
- Removing file from a bucket
- Removing a bucket
- General troubleshooting
- What to do next
- How to access object storage from CODE-DE using s3cmd
- What we are going to cover
- Prerequisites
- Object storage and standard file systems
- Terminology: containers and buckets
- Configuring s3cmd
- S3 paths in s3cmd
- Listing buckets
- Choosing a bucket for the examples
- Creating a bucket, if needed
- Uploading a file to a bucket
- Listing files and folders in the root of a bucket
- Listing files and folders below a prefix
- Removing a file from a bucket
- Downloading a file from a bucket
- Checking how much storage is used by a bucket
- Removing a bucket
- What to do next
- S3 bucket object versioning on CODE-DE
- Prerequisites
- What we are going to cover
- Configuring and testing AWS CLI
- Choosing bucket names
- Creating a bucket, if needed
- Enabling versioning on a bucket
- Uploading the first version of a file
- S3 paths
- Uploading another version of a file
- Listing available versions of a file
- Downloading a chosen version of a file
- Deleting objects on version-enabled buckets
- Using lifecycle policy to configure automatic deletion of previous versions
- Suspending versioning
- What to do next