B2B Integration

 View Only
  • 1.  Sterling File System: Files are not being purged from FS

    Posted Tue November 07, 2023 04:05 AM

    Hi,

    The files are not being purged consistently from the FS, below are the parameters used in customer_overrrides.properties properties.

    jdbcService.defaultDocumentStorageType=FS
    jdbcService.document_dir=/nfs_new/nfs/documents
    jdbcService.document_dir_extension=yyyy/MM/dd/HH
    archivethread.PURGE_DOCDISK_LIST_FILENAME=/nfs_new/nfs/documents/purge_dod_list.txt
    jdbcService.RESTORE_DOCUMENT_DIR=/nfs_new/nfs/restore_documents

    Can someone please help understanding why purge is not removing the files?



    ------------------------------
    Shankar Somatkar
    ------------------------------


  • 2.  RE: Sterling File System: Files are not being purged from FS

    Posted Wed November 08, 2023 06:30 AM

    Shankar, are you saying the files are not being purged, or the directories are not being purged?  I had a similar case with IBM/Precisely in the past and they said:

    "The PayloadPurgeJob will delete the payload files but not the actual directories. You would have to create a script to cleanup the old directories. If there are old files that are consuming space and should have been purged already, you may have to manually delete those too. There could be several explanations for that such as the purge queue is behind, the associated messages were never deleted so the payload was not orphaned, a product defect in an earlier version or other configuration or environment issue."

    So I updated the crontab to run deletes against the file system to ensure old data was properly cleaned up.  If you're not seeing any actual files be purged, you may need to open a case to determine root cause, due to the possibility of multiple causes.

    This is what I currently have scripted in cron:

    01 04 * * * find /apps/ibmshared/sample_var00/expiration/* -mtime +60 -exec rm -rf {} \;
    01 03 * * * find /apps/ibmshared/documents/* -mtime +60 -exec rm -rf {} \;



    ------------------------------
    Peter Milakovich
    ------------------------------



  • 3.  RE: Sterling File System: Files are not being purged from FS

    Posted Thu November 09, 2023 01:32 AM

    Thank you Peter for your response, it's the files which are not being purged from the documents directory. Also,  I could see that multiple files are being generated for purge_dod_list.txt e.g; purge_dod_list.txt-timestamp. I am not sure if it's normal behavior.

    Also, jdbcService.RESTORE_DOCUMENT_DIR=/nfs_new/nfs/restore_documents for this, I do not see any restore_documents directory created. not sure if this has any significance as well.

    Can you please advise if you have more insights?

    Thank you for your help



    ------------------------------
    Shankar Somatkar
    ------------------------------



  • 4.  RE: Sterling File System: Files are not being purged from FS

    Posted Thu November 09, 2023 02:30 PM

    hi Shankar,

    purge_dod_list.txt* are file generated by internal purge/indexing process.

    If you are using the external purge, it will list all files to be deleted by the external purge.

    If you are using the internal purge, it will list all error detected by the internal purge (like document not found on disk).

    example : 

    Unable to get Document On Disk file name from Database for DOC_ID = 56775118a7ea03f53node2



    ------------------------------
    Vincent Lahousse
    ------------------------------