File and Object Storage

 View Only

New: IBM Storage Scale CES S3 Technical Preview for S3 access for AI, data and analytics workloads

By Madhu Punjabi posted 15 days ago

  

IBM Storage Scale 5.2.0 supports technology preview for the CES S3 (Simple Storage Service) access protocol. CES S3 provides high-performant and scalable S3 object access to data, which is stored in IBM Storage Scale file systems. It is integrated with Cluster Export Services (CES) to provide highly available S3 access service in an IBM Storage Scale cluster. 

 

The Cluster Export Services (CES) S3 provides the following features:

  • High-performant, highly available and scalable S3 object access to data which is stored in Storage Scale filesystems.

  • Support for S3 API calls which are required to process data which is stored in Storage Scale filesystems.

  • Files and directories in Storage Scale filesystems are represented 1:1 as S3 objects and S3 buckets.

  • Installation and deployment support with Storage Scale installation toolkit.

  • Support for S3 service management with the existing CES commands.

  • Allow administrators to manage S3 configuration, S3 accounts and S3 buckets using the new CES S3 command.

  • Backup and restore of S3 configuration data.

  • Health monitoring of S3 protocol stack.

Figure: IBM Storage Scale CES S3 Architecture

The performance of IBM Storage Scale CES S3 is highly dependent on your underlying infrastructure and your workload. IBM publishes the following performance benchmark results for CES S3:

  • COSBench using large size (1GB) and small size objects against a 3-node Storage Scale CES cluster running S3 services and using IBM Elastic Storage System 3200 as back-end storage, achieving:

    • 63 GB/s aggregated throughput for read workloads for 1GB objects

    • 24 GB/s aggregated throughput for write workloads for 1GB objects

    • 56K ops/s for read workloads for 4K objects

    • 4.4K ops/s for write workloads for 4K objects

For more information on IBM Storage Scale CES S3 performance evaluation, see the blog at https://community.ibm.com/community/user/storage/blogs/rogelio-rivera-gutierrez/2024/04/25/ibm-storage-scale-performance-ces-s3-tech-preview 

For instructions on enabling and using CES S3, please sign up for the Technical preview by contacting scale@us.ibm.com.

References

[1] IBM Spectrum Scale

[2] IBM Elastic Storage System (ESS)

[3] IBM Storage Scale CES S3 (Tech preview) Performance evaluation of large and small objects using COSBench


#ibmtechxchange-ai


#Highlights
#Highlights-home
0 comments
35 views

Permalink