Informix

Informix

Connect with Db2, Informix, Netezza, open source, and other data experts to gain value from your data, share insights, and solve problems.

 View Only
Expand all | Collapse all

Créer une sauvegarde ontape en multifichiers

  • 1.  Créer une sauvegarde ontape en multifichiers

    Posted Wed July 31, 2024 01:01 PM

    Bonjour,

    La sauvegarde actuelle par ontape -s -L 0 > toto -t STDIO me donne un fichier proche de la taille limite de la partition et donc un probleme en vue. Il ne m'est pas possible de modifier la taille de la partition sur ce serveur, seulement utiliser une autre partition en complément.

    Je pensais modifier LTAPESIZE et le mettre à la valeur proche de la partition et aimerais obtenir un message pour préciser la 2eme partition. Je pourrais ainsi gérer les partitions par un script.

    Apparemment, mes essais n'ont pas donné le résultat escompté.

    Suis je sur la bonne piste pour les parametrages de ONTAPE ?

    Bien cordialement

    Gérard Kuczynski



    ------------------------------
    Gerard Kuczynski
    Développeur
    ------------------------------


  • 2.  RE: Créer une sauvegarde ontape en multifichiers

    Posted Thu August 01, 2024 02:26 AM
    Edited by Doug Lawry Thu August 01, 2024 03:06 AM
    Bonjour Gerard.
     
    I am working from this Google Translate result:
     
    "The current backup by ontape -s -L 0 > foo -t STDIO gives me a file close to the partition size limit and therefore a problem in sight. It is not possible for me to modify the size of the partition on this server, only use another partition in addition.
     
    I was thinking of modifying LTAPESIZE and setting it to the value close to the partition and would like to get a message to specify the 2nd partition. I could thus manage the partitions by a script.
     
    Apparently my attempts did not produce the expected result. Am I on the right track for the ONTAPE settings?"
     
    What Informix and operating system versions do you have? Is the limit in Informix, operating system, or file system? I will assume there is no simple fix like increasing "ulimit" or changing file system type.
     
    You need to change TAPESIZE (archives) not LTAPESIZE (logical log backups).
     
    Try piping to "split". Otherwise, you might need "expect" to answer prompts.
     
    My reply via Google Translate:
     
    "De quelles versions d'Informix et du système d'exploitation disposez-vous ? La limite est-elle dans Informix, le système d'exploitation ou le système de fichiers ? Je suppose qu'il n'existe pas de solution simple comme augmenter "ulimit" ou changer le type de système de fichiers.
     
    Vous devez modifier TAPESIZE (archives) et non LTAPESIZE (sauvegardes de journaux logiques).
     
    Essayez de canaliser pour "split". Sinon, vous devrez peut-être "expect" pour répondre aux invites."





  • 3.  RE: Créer une sauvegarde ontape en multifichiers

    Posted Thu August 01, 2024 03:02 AM
    Edited by Doug Lawry Thu August 01, 2024 03:06 AM

    Unlike emails, I see that the web site is translating everything into English for me anyway. I hope it's using French for you!

    Bonne journée!

    ------------------------------
    Doug Lawry
    Oninit Consulting
    ------------------------------



  • 4.  RE: Créer une sauvegarde ontape en multifichiers

    Posted Thu August 01, 2024 03:10 AM
    Bonjour,

    ontape via STDOUT can be compressed with a pipe, maybe this would be an easy solution in your case,
    just pipe through gzip or something, just remember you need to to this for a restore as well (gunzip in this case).
    If your you are on recent version, (which I assume since ontape to STDOUT is not present in very old versions)  backup_filter / restore_filter should be supported, so should be able to
    use a compressing filter such as pigz/unpigz or gzip/gunzip, resulting in smaller backup files (using that approach, you cannot forget about it when restoring). (gzip is slower as pigz, which runs multi-core)

    Otherwise, perform a backup to a remote machine (which does not have the file size limitations,
    I suppose you are on a very old machine with a 2GB limit for the filesize or something) 
    either by a pipe redirecting to ssh or by not performing a STDOUT backup but using the hostname:path syntax in TAPEDEV and call ontape without redirect.

    Use the TAPEDEV configuration parameter to specify the device or directory file system to which the ontape utility backs up storage spaces.
    help.hcl-software.com
    First case:
    ontape -s -L 0 -t STDIO | gzip > toto.gz

    Second case:
    ontape -s -L 0 -t STDIO | ssh host "cat > /path/toto"
    (you need to make sure machine can be accessed without password, if you are doing the backup
    with a cron job, so a ssh setup with certificates is needed)

    Third case:
    TAPEDEV hostname:/path/toto
    export DBREMOTECMD=ssh (requires working ssh access without password, by trusted certificates)
    ontape -s -L 0
    • should result in a remote backup, maybe to a Linux box which does not have the file size limitations
    • you can add the filters as well as described above in order to result in a smaller file size
    BACKUP_FILTER   /usr/bin/pigz
    RESTORE_FILTER  /usr/bin/unpigz



    MARCUS HAARMANN






  • 5.  RE: Créer une sauvegarde ontape en multifichiers

    Posted Thu August 01, 2024 03:24 AM
    Edited by Doug Lawry Thu August 01, 2024 03:24 AM

    I agree: compression is also a good idea. I believe that ontape to STDIO was in IDS 10 but BACKUP_FILTER wasn't until IDS 11. We really need to know the version!

    ------------------------------
    Doug Lawry
    Oninit Consulting
    ------------------------------



  • 6.  RE: Créer une sauvegarde ontape en multifichiers

    Posted Thu August 01, 2024 05:25 AM

    Hello,

    Thanks to everybody.

    Informix version is 12.10.FC11WE on a linux suze 12.

    The partition becoming full cannot be increased as linked to a physical device.

    I will try a compression and let you know. The BACKUP_FILTER is included in ids 12. I will set it.

    The backup file is stored on the same server (the organization is defined by customer and cannot be changed now, and your idea to send directly to n other server can be heard in some months by customer!!

    Thanks for all,

    Gerard 



    ------------------------------
    gerard kuczynski
    ------------------------------



  • 7.  RE: Créer une sauvegarde ontape en multifichiers

    Posted Fri August 02, 2024 05:42 AM

    hello,

    i tried compression with gzip and obtained 8 times smaller file

    . So i will set backup and restore parameters in onconfig on the customer site.

    the previous dba has tried gzip but stoppedusing it. why? i dont find anything about that.

    Il will also discuss with customer to be able to send directly the backup on the other server.

    Thanks for all to every body.

    Best regards

    Gerard



    ------------------------------
    gerard kuczynski
    ------------------------------



  • 8.  RE: Créer une sauvegarde ontape en multifichiers

    Posted Fri August 02, 2024 05:57 AM

    Usually the reason for giving up on using compression with the archives is the CPU overhead during the run. 

    Art



    ------------------------------
    Art S. Kagel, President and Principal Consultant
    ASK Database Management Corp.
    www.askdbmgt.com
    ------------------------------



  • 9.  RE: Créer une sauvegarde ontape en multifichiers

    Posted Fri August 02, 2024 06:49 AM

    If you are using pigz, and you have enough CPU power, you can use multithreaded option (compression should be faster)

    HTH

    Hrvoje



    ------------------------------
    Hrvoje Zokovic
    ------------------------------



  • 10.  RE: Créer une sauvegarde ontape en multifichiers

    Posted Sat August 03, 2024 06:54 AM

    HI,

    Rather than pigz try zstd,  could be 4x less cpu time!


    Regards,
    David.



    ------------------------------
    David Williams
    ------------------------------