Hello Jorge,
first I did not want to answer because there is so much information that would still be important to make an appropriate statement.
But then a certain interest arose and I am curious what others write about it.
Information that would be important among others:
* How is the storage system equipped and installed?
* What media is used and how many, what raid size? SCMs, SSDs, FCMs; 9+2P+S...
* Expansions?
* How much memory? 64, 256, 512GB - Write Cache is always 12GB
* Which firmware?
* If different media, is EasyTier used.....
* Which pools? Standard or DataReduction?
* How full is the storage system?
* How many physical connections from storage to switch and from switch to server? Max 1.75 gigabytes per second per physical connection.
* How many servers are connected to the storage
* How many volumes are presented to the server?
* What is the multipath configuration? multipath -ll
* How is the LVM configured?
* What does the zoning look like and how is the switch configured?
* Switch information like congestions or port errors
* What does the workload look like? What you are showing us is a single thread throughput test and probably does not reflect what Informix is doing on the storage system. Better use fio or DB specific tool
* Is it monitored? Maybe Spectrum Control
, Storage Insight Pro, Stor2rrd? Is there any data from the Informix workload like IO Size, Read/Write Ratio, Write Cache problems?
There is a sizer from IBM that always assumes an optimal environment and you can fill it with many parameters.
Simply said 100% write IO without caching, and streaming effects at 12 FCMs and 16Gb/s, I think 3GB/s should be the best you can expect.
According to the data sheet, IBM specifies 21GB/s in a fully expanded cluster, which is a quarter for a single system. Therefore 5.25GB/s
https://www.ibm.com/downloads/cas/VXDNQQELBest practices are relatively simple:
* Standard pools
* As many media in storage as possible (12)
* Many volumes to the server (number of cores of the storage system) >= 16
* Max 80% fill level for flash storage
* Automatic distribution of volumes to nodes
* Min 4 physical paths to SAN and min 2 paths from server to SAN
* Fixed speeds in SAN - no autonegotiation
* For LVM - check multipath and connect volumes from storage via LVM, pay attention to striping, single stripe size and round robin
* Same applies if database internal functions can be used
* For experienced users adjust the queue depth (max queue depth / volumes) (consider server and storage)
It was fun to write this together and as mentioned above, I'm curious what others contribute.
Greetings Patrik
------------------------------
Patrik Groß
------------------------------
Original Message:
Sent: Wed December 07, 2022 08:04 PM
From: Jorge Eduardo Barriga Rios
Subject: Informix and FS5200
In a new installation there is a Lenovo server connected to a FS5200 through a SAN24B-6 switch (both 16G), which will replace a server that is in production.
RedHat 9.0 and INFORMIX are installed on the server, the monthly closing was carried out as a test before going into production, but it took 3 hours more than the current server in production that has SSD disks.
Disk write tests were also performed
The results:
New Lenovo server connected to the FS5200:
[root@dbssrv02 backup]# dd if=/dev/zero of=/backup/test1.img bs=1G count=1 oflag=dsync
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.22652 s, 875 MB/s
[root@dbssrv02 backup]# dd if=/dev/zero of=/backup/test2.img bs=512 count=1000 oflag=dsync
1000+0 records in
1000+0 records out
512000 bytes (512 kB, 500 KiB) copied, 0.469169 s, 1.1 MB/s
Current production server with SDD drives (the one to be replaced)
[root@dbssrv02 /]# dd if=/dev/zero of=/test1.img bs=1G count=1 oflag=dsync
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.06968 s, 1.0 GB/s
[root@dbssrv02 /]# dd if=/dev/zero of=/test2.img bs=512 count=1000 oflag=dsync
1000+0 records in
1000+0 records out
512000 bytes (512 kB, 500 KiB) copied, 0.0892114 s, 5.7 MB/s
Do you have a graph or link showing storage performance (FS5200), transfer rate in MB/s vs file block size, or Informix best practices with FS5200?
------------------------------
Jorge Eduardo Barriga Rios
------------------------------
#PrimaryStorage
#StorageAreaNetworks
#Storage