IBM FlashSystem

IBM FlashSystem

Find answers and share expertise on IBM FlashSystem

 View Only
  • 1.  Storage Insights Overhead Capacity

    Posted 22 days ago

    Hi All,

    Storage Insights allows you to view the capacity figures for an FS7x00.
    I can't quite place one number: "Overhead Capacity".
    The description is: "The amount of usable capacity occupied by metadata in a pool or system and other data used for system operation."

    I'm struck by the large number, larger than, for example, "Usable Capacity." The Flashsystem is virtualized by an SVC.
    What does this number represent? And where can I find more details about it?

    Flashsystem Capacity
    Thanks.


    ------------------------------
    TMasteen
    ------------------------------


  • 2.  RE: Storage Insights Overhead Capacity

    Posted 16 days ago

    Hi T.

    what is the unmap settings on SVC and on 7x00? 



    ------------------------------
    Nezih Boyacioglu
    ------------------------------



  • 3.  RE: Storage Insights Overhead Capacity

    Posted 15 days ago

    Hello Nezih,

    On SVC we have host_unmap off and backend_unmap on. On FS both are on

    In Storage Insights I can match the number of the overhead capacity with the number of Total savings. this makes it even more confusing for me.



    ------------------------------
    TMasteen
    ------------------------------



  • 4.  RE: Storage Insights Overhead Capacity

    Posted 15 days ago

    It's really strange!

    I checked a few FlashSystems and I can't see any value under "Overhead Capacity." 



    ------------------------------
    Nezih Boyacioglu
    ------------------------------



  • 5.  RE: Storage Insights Overhead Capacity

    Posted 11 days ago
    Edited by Lorraine Rizzuto 10 days ago

    Hi,

    I was following this post as I am also curious about the actual meaning and calculation details for this overhead capacity.

    While trying to further explore the meaning of the term for myself, I got the impression that the term "overhead capacity" is perhaps being interpreted/used in different ways and contexts. So I wanted to participate in this discussion with the goal to get to a common understanding and conclusion. 

    Here are my considerations and the findings from my research on this topic: 

    As far as I can recall from my historical knowledge, the term "overhead capacity" was already used in the context of space-efficient vdisks to express the space that is required for each grain of a vdisk to maintain e.g. the allocation info or log files of the space-efficient vdisk(-copy) in a "traditional" storage pool. 

    With the introduction of data-reduction pools I guess that this concept has been adapted accordingly and hence the overhead capacity is nowadays mainly being referred as the space that is required for tracking unmap and reclaim operations within in the pool, see e.g. Redbook "Implementation Guide for IBM Storage FlashSystem and IBM SAN Volume Controller Updated for IBM Storage Virtualize Version 8.6"  chapter 2.12 "Storage pool configuration".
    Based on the description in that Redbook (or alternatively also on knowledgecenter ) this would basically go in line with the description in the tooltip you posted. 

    What confuses me in that context though, is that your screenshot shows such a huge amount, as I would expect in that context also a smaller number than usable capacity. Especially now that you identified that the number is matching the number of total savings. 
    I checked a few FlashSystems in our lab too. Interestingly I found one FlashSystem where overhead capacity and total savings are a perfect match, while I also saw another FlashSystem where these numbers did not match, e.g.:

     

     

    now look at the "Total Provisioned" numbers. While the first one only has 5.73% provisioned, the second one shows a huge overallocation of 895.02%. So my working theory is that the "Overhead Capacity" field mainly provides meaningful or relevant information when an overallocation actually exists.

    For completeness (as the screenshots do not cover that):

    • the first FlashSystem reports a total provisioned capacity of 4,020.00 GiB
    • the second FlashSystem reports a total provisioned capacity of 196,073.13 GiB

    A potential interpretation especially based on the second example could (imho) be that even though the total savings are ~187 TiB (out of 196 TiB provisioned capacity ("artifically" calculated by compression and dedup factors etc)), in fact ~93 TiB out of these are actually occupied by metadata and may have to be substracted from those savings, as they actually still occupy space.

    But this is only a guess, as I must admit I am totally lost meanwhile when it comes to all those "artificial" capacities due to the combination of compressed FCMs, DRPs, Thin-provisioning last but not least backend storage virtualization behind SVC. I think many people meanwhile get nuts when they try to understand the actual figures on a SVC that uses a (data-reduction) Pool provided by FlashSystem which in turn itself also uses inline compression.

    So thats just my two cents.

    Is there anyone of the IBMers in this forum who has a comprehensive understanding of all those capacity figures and can shed some more light into this?

    Cheers

    Philipp



    ------------------------------
    Philipp Wachtler
    ------------------------------



  • 6.  RE: Storage Insights Overhead Capacity

    Posted 10 days ago

    Hi T,

    The overhead capacity reported by SI is supposed to be the overhead_capacity reported by the device. This capacity should indicate the additional capacity which is allocated by the pool for metadata stored by every pool. This is termed as overhead capacity. 
    For reference We can also refer to any Flash/SVC documentation about CLI's lssystem and lsmdiskgrp, they both have overhead_capacity defined.  (https://www.ibm.com/docs/en/flashsystem-5x00/8.7.0?topic=commands-lssystem)
    At System level it must be aggregation of all overhead capacity of storage pools (mdiskgrps).  I feel the view you see could be a bug in Storage Insights reporting the value. Can you share the tenant details and we can cross check this. 

    Regards,

    Sushil Sharma



    ------------------------------
    Sushil Sharma
    ------------------------------



  • 7.  RE: Storage Insights Overhead Capacity

    Posted 10 days ago

    Hello Sushil,

    Thank you for your reply. We do have multiple tenants where we see the same behaviour.

    Please provide me a email-address where I can send one of them.



    ------------------------------
    TMasteen
    ------------------------------



  • 8.  RE: Storage Insights Overhead Capacity

    Posted 10 days ago

    Hi T,

    Please share the tenant details where you see the discrepancy on my email.

    sushil.sharma@in.ibm.com 

    Regards,

    Sushil Sharma



    ------------------------------
    Sushil Sharma
    ------------------------------



  • 9.  RE: Storage Insights Overhead Capacity

    Posted 4 days ago

    Hi,

    can you share your final findings to this? Is it indeed a bug after all?
    I meanwhile also noticed that the overhead capacity reported in FlashSystem CLI output does not match the numbers in SI, hence I assume the numbers reported in the SI summary to be incorrect?

    Thanks



    ------------------------------
    Philipp Wachtler
    ------------------------------



  • 10.  RE: Storage Insights Overhead Capacity

    Posted 4 days ago

    Hi Philipp,

     

    Yes this indeed is a bug in Storage Insights, I have been working with team to have this addressed in upcoming release. Please allow me a day more to give you detail analysis and available fix for the issue.

     

    Regards,

    Sushil Sharma

     






  • 11.  RE: Storage Insights Overhead Capacity

    Posted 2 days ago

    Philipp,

    The answer I got:  We are planning to fix this defect as part of 3Q release vehicle.



    ------------------------------
    TMasteen
    ------------------------------