AIX Open Source

 View Only
  • 1.  Mount Amazon S3 in AIX

    Posted Mon March 07, 2022 01:52 PM
    Has anyone mounted a S3 bucket on AIX? Anyone ported s3fs to AIX?

    ------------------------------
    Matt Geisler
    ------------------------------


  • 2.  RE: Mount Amazon S3 in AIX

    IBM Champion
    Posted Mon March 07, 2022 02:03 PM
    I think that s3fs requires FUSE, which I don't believe is available for AIX. At one point, there was a port of s3cmd for AIX, which you could maybe make a case for being in the Toolbox, but that's not a file system like interface.

    Do you specifically need a file system like interface, or would the ability to fetch/put specific objects suffice? As in, would one of the Python (or other language already on use on AIX) modules that talks S3 meet your needs?

    You could also do this with Transparent Cloud Tiering and Spectrum Scale, depending on what you're trying to accomplish.

    -- 
    Stephen L. Ulmer
    Enterprise Architect
    Mainline Information Systems
    (m) 352-870-8649








  • 3.  RE: Mount Amazon S3 in AIX

    IBM Champion
    Posted Mon March 07, 2022 02:07 PM
    It had been a long time, so I went and looked again, s3cmd is literally an S3 CLI implemented in Python. If that meets you're needs, it may already just work.

    -- 
    Stephen L. Ulmer
    Enterprise Architect
    Mainline Information Systems
    (m) 352-870-8649




    On Mar 7, 2022, at 2:02 PM, Stephen Ulmer <Stephen.Ulmer@mainline.com> wrote:

    I think that s3fs requires FUSE, which I don't believe is available for AIX. At one point, there was a port of s3cmd for AIX, which you could maybe make a case for being in the Toolbox, but that's not a file system like interface.

    Do you specifically need a file system like interface, or would the ability to fetch/put specific objects suffice? As in, would one of the Python (or other language already on use on AIX) modules that talks S3 meet your needs?

    You could also do this with Transparent Cloud Tiering and Spectrum Scale, depending on what you're trying to accomplish.

    -- 
    Stephen L. Ulmer
    Enterprise Architect
    Mainline Information Systems
    (m) 352-870-8649









  • 4.  RE: Mount Amazon S3 in AIX

    Posted Mon March 07, 2022 03:46 PM
    Thanks for the info! Let me give that a try... Appreciate the help...

    ------------------------------
    Matt Geisler
    ------------------------------



  • 5.  RE: Mount Amazon S3 in AIX

    Posted Mon August 22, 2022 12:26 PM
    Wondering if you have any success in getting S3 cli to work in AIX?
    Looking for a solution from AIX directly to AWS S3.
    Many thanks,
    Marvin Yuen

    ------------------------------
    Marvin Yuen
    ------------------------------



  • 6.  RE: Mount Amazon S3 in AIX

    Posted Mon August 22, 2022 12:43 PM

    I tried sometime back and I could install and use AWS S3 on AIX.
    Today also I tried using pip and it installed (though I do not have amazon S3 account so can't verify)

    # /opt/freeware/bin/python3 -m pip install s3
    Collecting s3
    ....
    ....
    Successfully installed Jinja2-3.1.2 MarkupSafe-2.1.1 Pygments-2.13.0 alabaster-0.7.12 babel-2.10.3 certifi-2022.6.15 charset-normalizer-2.1.1 docutils-0.16 futures-3.0.5 idna-3.3 imagesize-1.4.1 importlib-metadata-4.12.0 packaging-21.3 pyparsing-3.0.9 pytz-2022.2.1 requests-2.28.1 s3-3.0.0 snowballstemmer-2.2.0 sphinx-5.1.1 sphinx-rtd-theme-0.5.2 sphinxcontrib-applehelp-1.0.2 sphinxcontrib-devhelp-1.0.2 sphinxcontrib-htmlhelp-2.0.0 sphinxcontrib-jsmath-1.0.1 sphinxcontrib-qthelp-1.0.3 sphinxcontrib-serializinghtml-1.1.5 urllib3-1.26.12 xmltodict-0.13.0 zipp-3.8.1
    WARNING: You are using pip version 20.1.1; however, version 22.2.2 is available.
    You should consider upgrading via the '/opt/freeware/bin/python3 -m pip install --upgrade pip' command.




    Same way I could also install aws-s3-tools
    What is the issue you are facing ? 
    Install build tools and gcc from AIX toolbox if you are missing them. 




    ------------------------------
    SANKET RATHI
    ------------------------------



  • 7.  RE: Mount Amazon S3 in AIX

    Posted Tue August 23, 2022 08:20 AM
    We are researching options to land files on AWS S3 from AIX.
    Your info definitely does help quick start to our POC. I have shared with our AIX admin.
    Many thanks for your quick response.

    ------------------------------
    Marvin Yuen
    ------------------------------



  • 8.  RE: Mount Amazon S3 in AIX

    Posted Tue August 23, 2022 02:05 PM
    Hi,

    We are getting below error when we install s3

    root@jxn-ux-hbccmsb1i[/tmp]# /opt/bin/python3 -m pip install s3
    WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ReadTimeoutError("HTTPSConnectionPool(host='pypi.org', port=443): Read timed out. (read timeout=15)")': /simple/s3/
    WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ReadTimeoutError("HTTPSConnectionPool(host='pypi.org', port=443): Read timed out. (read timeout=15)")': /simple/s3/
    WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ReadTimeoutError("HTTPSConnectionPool(host='pypi.org', port=443): Read timed out. (read timeout=15)")': /simple/s3/
    WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ReadTimeoutError("HTTPSConnectionPool(host='pypi.org', port=443): Read timed out. (read timeout=15)")': /simple/s3/
    WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ReadTimeoutError("HTTPSConnectionPool(host='pypi.org', port=443): Read timed out. (read timeout=15)")': /simple/s3/
    ERROR: Could not find a version that satisfies the requirement s3 (from versions: none)
    ERROR: No matching distribution found for s3
    root@jxn-ux-hbccmsb1i[/tmp]#

    ------------------------------
    Premkumar Nagraj-Vendor
    ------------------------------



  • 9.  RE: Mount Amazon S3 in AIX

    Posted Thu September 01, 2022 11:16 AM
    Edited by SANKET RATHI Thu September 01, 2022 11:16 AM
    Hi Premkumar, 
    Sorry for delay. Does your AIX system have access to internet ? 
    For pip to work it needs connection to pip repository. 
    If you do not have connection to internet then you can download the source and installing using pip (but you need to download dependencies as well)

    ------------------------------
    SANKET RATHI
    ------------------------------