Aspera

 View Only
Expand all | Collapse all

Aspera HSTS with timeouts, high memory usage

  • 1.  Aspera HSTS with timeouts, high memory usage

    Posted Thu February 24, 2022 03:11 PM

    Hi all,

    I recently discovered some timeouts in our file transfers and also have high memory usage.

    Im currently using the 3.8.x version, i checked the logs and i observed that there is an "Connection refused" error for Redis DB.

    it could be due to server is running out of necessary resources.

    ...ascp[29410]: ERR ana_db_lib: could not connect to DB with ...errno=5, err='Connection refused' ...asperanoded[25102]: ERR ana_db_lib: encountered connection error, must reconnect, errno=5, err='Connection reset by peer' ...ascp[28537]: ERR ana_db_lib: encountered connection error, must reconnect, errno=5, err='Connection reset by peer' ...asperanoded[25102]: ERR ana_db_lib: could not ping DB, errno=5 ...ascp[28537]: ERR ana_db_lib: could not ping DB, errno=5

    I also added more physical memory but it doesnt solve the problem, i tried to modify the aspera.conf file to check the memory parameters.

    I could not find the line where it is configured the memory on aspera.conf

    does anyone have encountered to this problem?

    I am also planning to upgrade to the newest version 4.3.1 in order to solve this problem but im a bit confudes with the steps, it is neccesary to uninstall the server before upgrading

    can somebody help me with the upgrade steps or the parameters to increase memory usage on redis?

    Regards

    Brandon



    #Aspera
    #Support
    #SupportMigration


  • 2.  RE: Aspera HSTS with timeouts, high memory usage

    Posted Fri February 25, 2022 01:08 AM

    HHSTS 3.8.x is quite old. Upgrading to HSTS 4.3.1 is on the right path as there have been a multitude of improvements made since then. Upgrading should be straightforward. You shouldn't have to uninstall HSTS beforehand. You should be able to install with dpkg or rpm. There will be some schema migrations that will take place during the upgrade process. We should make a copy of the rdb file in /opt/aspera/var/redis.31415.rdb so that you can restore from it if need be.

    Redis is an in-memory database. It can only work by loading up /opt/aspera/var/redis.31415.rdb entirely into memory. There's not really a way to increase memory usage. It will use what it needs, and if it can't get what it needs, it won't work. You should be able to use top to check which process is actually using up the most memory. Beyond redis, the most memory intensive service is usually asperatrapd + ascp. trapd is only used for transfers to object storage and needs to be explicitly enabled. It works with ascp using shared memory. trapd's memory's usage is configured in /opt/aspera/etc/trapd/trap.properties. There are some kernel settings you can fiddle with to configure the amount of shared memory it has access to.



    #Aspera
    #Support
    #SupportMigration


  • 3.  RE: Aspera HSTS with timeouts, high memory usage

    Posted Tue March 01, 2022 09:12 AM

    Hi!,

    Thank you for the info and recommendations

    Kinds Regards

    Brandon



    #Aspera
    #Support
    #SupportMigration