API Connect

 View Only

  • 1.  How to estimate the disk size of API Manager

    Posted Mon August 05, 2024 04:11 PM
    I am estimating the disk size of "API Manager".
    I found a site that describes the default size of the database.
     
    [Product Site]
    Represents the size of the Database volume. Defaults to ～ 180G for n3xc4.m16 installation profile.
    ※The system we will be introducing will be configured with "n3xc4.m16".
     
    The number and size of APIs we will develop are as follows.
    If you know a website that describes the formula for estimating the database size, please let me know.
    If you know how to calculate it, please let me know.
     
    [Number of APIs to be developed]
    Catarog                     : 3
    products and APIs : 200
    Average API Size    : 100KByte
    -----------------------------------------
    Total number of products and APIs  : 3×200=600
    Total size of product and API              : 600×100=60000KByte (60MByte)
     
    I think I need to estimate the disk size other than the database.
    If you know of a site that describes the disk size other than the database, please let me know.



    ------------------------------
    TAKAHIRO OGITA
    ------------------------------



  • 2.  RE: How to estimate the disk size of API Manager

    Posted Wed August 07, 2024 04:58 AM

    Hi there...

    I cannot answer you directly, so you will get an indirect answer..
    We initially back with v2018 has the same question. Took the strategy that we started with the default values and test it out..

    We are running 10.0.5.7 now, and the usage is basically the same as it has been since the old v2018 days..

    We have 3 organisations with 2 catalogs in each. In total we have around 120 products, 150 APIs, 120 consumer applications in 25 consumer organisations, with let's say 400 subscriptions give and take..

    The total disk usage per PVC us under 200Mb. We tried publishing 1000 random generated APIs and 250 consumers applications, all subscribed to all.. Disk usage was still low, under 300Mb.. 

    I not it is not a definitive answer.. There is of course database overhead and such - but the amount of disk usage is quite low compared to the default values setup in for example the "n3xc4.m16" profile.. We have not lowered it YET - but it is one of the things we are looking into soon, as storage also costs money, he he :)

    But do some testing and estimate based on that. I think that is your best bet.



    ------------------------------
    Team API
    ------------------------------

    Original Message


  • 3.  RE: How to estimate the disk size of API Manager

    Posted Thu August 08, 2024 12:01 AM

    Hi! Team API

    Thanks for your reply!

    ・In the environment you tested, the disk usage was less than 1GB, so I think that our environment will have the same size usage.
    　In other words, if we size it at 180GB as written on the product site, can we assume that the disk will hardly run out if we use it in the same way?

    ・Thank you for the information that the usage is not very different between v10 and v2018.
    　We are currently using v2018, so we would like to check the usage.

    　I couldn't figure out which PVC is being used by APIManager.
    　There is the following PVC in the apiconnect namespace, but could you tell me which PVC is being used by APIManager?

    [PVC name]
    admin-rc4ea5d1d3e-apic-portal-www-X
    backup-rc4ea5d1d3e-apic-portal-www-X
    data-r1a68a36b02-analytics-storage-data-X
    data-r1a68a36b02-analytics-storage-master-X
    db-rc4ea5d1d3e-apic-portal-db-X
    dblogs-rc4ea5d1d3e-apic-portal-db-X
    pv-claim-r31f4a26f5e-apiconnect-cc-X
    tms-r554d996560-dynamic-gateway-service-X
    web-rc4ea5d1d3e-apic-portal-www-X

    ・I plan to actually test it when I build the development machine.



    ------------------------------
    TAKAHIRO OGITA
    ------------------------------

    Original Message


  • 4.  RE: How to estimate the disk size of API Manager

    Posted Thu August 08, 2024 02:31 AM

    I haven't received an answer to question no. 3, but I'd like to ask an additional question.

    I think APIMamanger also stores backup files.
    My question is assuming there are 30 backup generations.
    Would it be okay to estimate the maximum backup file size as follows?
    (In other words, if I estimate the 180GB listed on the site, I think the backup requirements will be met.)

    Size of one generation: 300MB
    Number of generations: 30
    ----------------------------------------
    Backup size: 9GB



    ------------------------------
    TAKAHIRO OGITA
    ------------------------------

    Original Message


  • 5.  RE: How to estimate the disk size of API Manager

    Posted Thu August 08, 2024 07:25 AM

    Hi again..

    (sorry for our generic name, we use a common IBM account to access these sites, he he - company policy).

    In our installation we have split up all the API Connect components into individual namespaces - so it is easy for us to see which PVC's are used where..

    Here is a list of PVC's in our pre-production setup from the API manager namespace:

    management-8fd7c9e-08fd7c9e-postgres
    management-8fd7c9e-08fd7c9e-postgres-pgbr-repo
    management-8fd7c9e-08fd7c9e-postgres-swlp
    management-8fd7c9e-08fd7c9e-postgres-swlp-wal
    management-8fd7c9e-08fd7c9e-postgres-vafk
    management-8fd7c9e-08fd7c9e-postgres-vafk-wal
    management-8fd7c9e-08fd7c9e-postgres-wal

    All the PVC's you listed are not used by the manager, but by the portal, gateway and analytics :)

    We run with the 180Gb default - and expect it to never run out of diskspace, he he.. been running v10 now for >1 year.. And no issues yet.. But we have alerts on it :)

    On v2018, we used to use the backup functionality, but we are not anymore (simply because restoring takes too long for us, so we extract the data our selves and can recreate everything using apic).. BUT - when we did, the back size as I remember it (for the API manager!) was around the 4-6 GB size.. But again - we have not tried it on v10, as we are not using it.



    ------------------------------
    Team API
    ------------------------------

    Original Message


  • 6.  RE: How to estimate the disk size of API Manager

    Posted Tue August 13, 2024 04:32 AM

    Hi Takahiro,

    For the V10 management subsystem the default sizes are sufficient. With 600Mb of management data you do not need to increase the space, but don't set it lower than the defaults either. The management database and how data is stored in v10 is significantly different to the v2018 database, so they cannot be compared.

    Where you do need to make storage estimates in v10 is for analytics: https://www.ibm.com/docs/en/api-connect/10.0.8?topic=planning-estimating-storage-requirements.



    ------------------------------
    Iain Soedring
    ------------------------------

    Original Message


  • 7.  RE: How to estimate the disk size of API Manager

    Posted Tue August 20, 2024 04:51 AM

    Hi! Iain

    Thanks for your answer!
    I understand that if it's around 600MB, the default of 180GB should be fine.
    I'll make an estimate based on the answers you gave me in this QA. I plan to verify the actual data size used when I build the development environment!

    Thanks everyone!



    ------------------------------
    TAKAHIRO OGITA
    ------------------------------

    Original Message