InfoSphere Optim

 View Only
  • 1.  Calculating Size at source

    Posted Tue April 21, 2020 04:04 PM
    ​I am looking to find the size of data at source and not sure how to do it. One way I could think of is by looking at the 'Archive Process Report. Below is a report generated when archive job is run successfully

    Request Name                                        CLAIM

    Server Name                                           SERVERNAME

    Archive File                                              \\server\ARCHIVE\FILE_NAME.AF

    Access Definition                                     DB.CLAIM_AD

    Storage profile                                         (None)

    File Access Definition                               (None)

    File Attachments                                      Processed

    Client User ID                                          XXXX

    Server User ID                                         YYYY

    Time Started                                            4/21/2020 12:41:53

    Time Finished                                          4/13/2020 12:55:21

    Elapsed Time                                         00:13:28

    Archive File Data Byte Count                    205479580 Bytes (0.191 GB)

    Process Status                                        no errors, no warnings

    Backup Created for Archive File                No

     

    Process Summary

          Tables Processed                              8

          Rows Archived                                  2260822

          Rows with Errors                                0

          First Pass Table Rows                       46878

     

    Row Details:

     Table Name            Archived                           Failed                Data Byte Count            

    TABLE 1                     46878                             0                        26659533                      
    TABLE 2                     469286                           0                        148527555
    TABLE 3                     277335                           0                         5545665
    TABLE 4                     1108620                         0                        16629300
    TABLE 5                     168879                           0                         3715338
    TABLE 6                     46593                             0                        1537569
    TABLE 7                     47602                             0                        952040
    TABLE 8                     95629                             0                        1912580
                                                                                                     ------------------------------  
                                                                                                       205479580      --> Total Data Byte Count

    Q1) Can I simply take this total Data Byte Count and divide it by 1024 to get the MB and further divide it by 1024 to get the size in GB? 
     
    i.e. 205479580 / 1024 = 200663.65 MB
          200663.65 / 1024 = 195.96 GB?

    Is this the right way to calculate the size at source?

    Q2) I noticed that the initial section of the archive report mentions the Archive File Data Byte Count (mentioned in initial section of this post. Also see below).

    Archive File Data Byte Count                    205479580 Bytes (0.191 GB)

    What is this size in GB, is this after the data is archived? and how is it calculated?



    Appreciate any inputs on how I can calculate the size at source?


    ------------------------------
    Optim Learner
    ------------------------------

    #InfoSphereOptim
    #Optim


  • 2.  RE: Calculating Size at source

    Posted Wed April 22, 2020 12:53 AM
    Gigabyte is 1 billion bytes. (1024³ bytes)

    205479580/1024/1024/1024 = 0.191 (GB)

    ------------------------------
    SangGyu Jeong
    Software Engineer
    Infrasoft
    Seoul Korea, Republic of
    ------------------------------



  • 3.  RE: Calculating Size at source

    Posted Wed April 22, 2020 02:31 AM
    Thank you SangGyu. My bad, I kind of overlooked that​ - very silly.

    Is this 0.191(GB) the size of data at source or is this the size after archiving(compressed?)

    ------------------------------
    Optim Learner
    ------------------------------



  • 4.  RE: Calculating Size at source

    Posted Wed April 22, 2020 02:47 AM
    There is a 'compression options' button in the Archive Request Editor.
    If the option checkbox is selected, archive file is compressed.
    Even if the compression option is not checked, the size of the archive file does not perfectly match the data size.
    I think you need to multiply your database's row size by the number of archived records to accurately calculate the data size.
    Or, if you use the compression feature, the report shows the compression rate, so you can estimate the size of the original data.

    Compression Options panel, described following
    https://www.ibm.com/support/knowledgecenter/search/table%20size?scope=SSMLNW_11.3.0

    ------------------------------
    SangGyu Jeong
    Software Engineer
    Infrasoft
    Seoul Korea, Republic of
    ------------------------------



  • 5.  RE: Calculating Size at source

    Posted Fri May 01, 2020 12:09 PM
    Thank you SangGyu​

    ------------------------------
    Optim Learner
    ------------------------------



  • 6.  RE: Calculating Size at source

    Posted Wed April 22, 2020 12:18 PM
    The Data Byte Count in the archive report should be the byte count Optim read from your source. If you are unsure, just look at the byte count in the report to the actual byte count of the file you created by looking at the file in File Explorer or similar file/folder tool. If compression is on, the file you create is probably smaller than the Byte Count in the archive report. 


    ------------------------------
    Keith Tidball
    Progressive Insurance
    ------------------------------



  • 7.  RE: Calculating Size at source

    Posted Fri May 01, 2020 12:10 PM
    Thank you Keith​

    ------------------------------
    Optim Learner
    ------------------------------