IBM Spectrum Scale offers flexible and scalable software-defined file storage for analytics workloads. Enterprises around the globe have deployed IBM Spectrum Scale to build large data lakes for running data intensive workloads, including AI, high-performance computing (HPC) and analytics. IBM...
We are excited to announce IBM Spectrum Scale support for Hortonworks Data Platform (HDP) 3.0 . IBM Storage first announced its partnership with Hortonworks for IBM Spectrum Scale storage in Feb, 2017 . Since then, we have continued our joint engineering efforts to certify all releases of IBM...
Decisions about storage are a key element to the success of any artificial intelligence (AI) or deep learning (DL) project, as demands on storage keep growing. For the past few years there has been a huge growth of data โ the โBig Dataโ phenomenon. Now, there are new requirements to support...
Performance and Scalability are the top two challenges for AI storage Nowadays organizations are using AI for digital transformation, such as leveraging deep learning to detect problematic products in manufacture to reduce the need for manual efforts for improved production, or leveraging...
Over time, many organizations tend to acquire collections of multi-vendor #storage systems, due to application requirements, multiple buyers, mergers, and even staff turnover. Add in the adoption of #cloud and #softwaredefinedstorage products, like IBM Spectrum Virtualize โข , and that...
In this blog, we are going to briefly discuss the enhancements made in the IBM Spectrum Scale installation toolkit over the releases since its introduction in IBM Spectrum Scale 4.1.1. The installation toolkit is a Chef-based automation tool that can be used for quick installation, deployment,...
At the AI Summit New York, December 5-6, IBM disclosed a technology preview and demonstration with the integration of IBM POWER9 Systems and IBM FlashSystem 900 using NVMe-over-Fabrics InfiniBand. This combination of technologies is ideally suited to run cognitive solutions such as IBM PowerAI...
The ever expanding and accelerating generation of Big data has made mandatory the usage of more efficient and robust storage filesystems. The data migration across multiple storage mediums is proving to be expensive. There is an inevitable and urgent need to perform inplace data analytics and to...
IBM Spectrum Scale Sharing Nothing Cluster performance tuning guide has been posted and please refer to link before you doing the below change. If the cluster is focused on database workloads such as SAP HANA/DB2 DPF/DashDB or DIO/AIO, the following configuration options must be tuned: ...
IBM Spectrum Scale Sharing Nothing Cluster performance tuning guide has been posted and please refer to link before you doing the below change. Here is the tuning steps. Step1: Configure spark.shuffle.file.buffer By default, this must be configured on $SPARK HOME/conf/spark-defaults.conf...