S3 OBJECT STORAGE

• How to Delete Large S3 Bucket on CODE-DE
• How to Mount Object Storage Container as a File System in Linux Using s3fs on CODE-DE
• How to use Object Storage on CODE-DE
• How to access private object storage using S3cmd or boto3 on CODE-DE
• S3FS Cache on CODE-DE
• How to Install Boto3 in Windows on CODE-DE
  • Step 1 Ensure That Python3 is Preinstalled
  • Step 2 Install boto3 on Windows
• How to mount object storage container from CODE-DE as file system on local Windows computer
  • Prerequisites
  • What We Are Going To Cover
  • Software tools used in this article: Rclone, WinFSP, and NSSM
  • How to use the Rclone configuration file
  • Step 1 Download and install the appropriate software
  • Step 2: Enter the connection data
  • Step 3: Perform a test mount
  • Step 4: Tweak the –dir-cache-time option
  • Step 5: Configure automatic mounting of your container
  • Removing software responsible for automatic mounting of eodata
• Bucket sharing using s3 bucket policy on CODE-DE
  • S3 bucket policy
  • Naming conventions used in this document
  • Limitations
  • S3cmd CONFIGURATION
  • Declaring bucket policy
  • SETTING A POLICY ON THE BUCKET
  • Sample scenarios
• How to install s3cmd on Linux on CODE-DE
  • What We Are Going To Cover
  • Prerequisites
  • Installing s3cmd using apt
  • Uninstalling s3cmd using apt
  • What To Do Next
• Configuration files for s3cmd command on CODE-DE
  • Prerequisites
  • What We Are Going To Cover
  • Initializing the configuration process - creating a configuration file
  • Using –configure on an existing file
  • Executing S3 commands
  • What To Do Next
• How to access object storage from CODE-DE using boto3
  • What We Are Going To Cover
  • Prerequisites
  • Terminology: container and bucket
  • Preparing the environment
  • How to use the examples provided?
  • IMPORTANT
  • Creating a container
  • Listing buckets
  • Checking when a bucket was created
  • Listing files in a bucket
  • Listing files from particular path in a bucket
  • Uploading file to a bucket
  • Downloading file from a bucket
  • Removing file from a bucket
  • Removing a bucket
  • General troubleshooting
  • What To Do Next
• How to access object storage from CODE-DE using s3cmd
  • What We Are Going To Cover
  • Prerequisites
  • Object storage vs. standard file system
  • Terminology: container and bucket
  • Configuring s3cmd
  • S3 paths in s3cmd
  • Listing containers
  • Creating a container
  • Uploading a file to a container
  • Listing files and folders of the root directory of a container
  • Listing files and folders not in the root directory of a container
  • Removing a file from a container
  • Downloading a file from a container
  • Checking how much storage is being used on a container
  • Removing the entire container
  • What To Do Next