Automated Testing

  • 1.  Issue transfer speed between zdt and local pc.

    Posted Tue August 29, 2023 03:49 AM
    Edited by Juan Carlos Delgado Wed August 30, 2023 03:37 AM

    Hi all,

    I am into task to transfer a large number of heavy files from my PC to z/OS.( zDT)

    Transfer Speed between our zDT and local pc are so poor. I ask to some colleague from Linux team and seemingly is not related with Linux SO. However they send me this detail:

    Communication between zDT and Linux Server is going through virtual interface tap0

     

    serverL:/ # ethtool tap0

    Settings for tap0:

            Supported ports: [ ]

            Supported link modes:   Not reported

            Supported pause frame use: No

            Supports auto-negotiation: No

            Supported FEC modes: Not reported

            Advertised link modes:  Not reported

            Advertised pause frame use: No

            Advertised auto-negotiation: No

            Advertised FEC modes: Not reported

            Speed: 10Mb/s

            Duplex: Full

            Port: Twisted Pair

            PHYAD: 0

            Transceiver: internal

            Auto-negotiation: off

            MDI-X: Unknown

            Current message level: 0xffffffa1 (-95)

                                   drv ifup tx_err tx_queued intr tx_done rx_status pktdata hw wol 0xffff8000

            Link detected: yes

    serverL:/ #

     It is possible that issue is related with value: Speed: 10Mb/s 

    ¿It is possible to modify that value? 

    Thanks in advance.

     



    ------------------------------
    Juan Carlos Delgado
    ------------------------------



  • 2.  RE: Issue transfer speed between zdt and local pc.

    Posted Tue August 29, 2023 12:39 PM

    Hi Juan,

    From the description, I suppose you were trying to create a z/OS volume component using ZD&T EE Web UI tooling, by extracting volume from a z/OS running in ZD&T on Linux. If not, please ignore the following.

    If yes, I think you defined a z/OS Source Environment for that 'z/OS running in ZD&T on Linux'. You can speed up the volume transfer speed a lot by bypassing the tap0 interface, by defining a 'ZD&T Source Environment' in the ZD&T Web UI instead, and create volume component from it.



    ------------------------------
    Jamie Liu
    ------------------------------



  • 3.  RE: Issue transfer speed between zdt and local pc.

    Posted Wed August 30, 2023 03:57 AM

    From the documentation:

    At the time of writing, we were aware of two specific problems that might impact OSA
    performance.


    If frames larger than expected are used, an excessive number of frames might be dropped
    (causing a retransmission). This might not be noticed unless careful measurements or
    comparisons are made. We believe this problem is resolved by including the sysctl
    parameter that is now recommended:

    net.core.rmem_max=1048576

    Linux attempts to offload various low-level LAN interface functions to the NIC adapter. This
    might not be compatible with the awsOSA implementation and can result in drastic
    performance degradations. We note that more recent Linux distributions might not
    experience these problems.

    IBM does not provide performance specifications for ISV zPDT OSA. When working correctly,
    informal observation indicates that FTP throughput might be in the 5 - 20 MBps26 (megabytes
    per second) range, assuming an unconstrained network in a dedicated environment. If your
    performance is very much worse than this, consider experimenting with the ethtool
    commands described here.

    One or more of the following commands, intended to disable the Linux offloading of IP
    functions, might improve the situation:


    # ethtool -K eth0 rx off (disable RX checksumming offload)
    # ethtool -K eth0 tso off (disable TCP segmentation offload)
    # ethtool -K eth0 gso off (disable generic segmentation offload)
    # ethtool -K eth0 gro off (disable generic RX offload)
    # ethtool -K eth0 lro off (disable large RX offload)
    # ethtool -K eth0 rxvlan off (if you are using VLANs)
    # ethtool -k eth0 (display status of NIC)
    # ethtool -S eth0 (display statistics)
    # ethtool -K em1 rx off (newer style of NIC naming)
    # ethtool -K enp0s25 rx off (newer style of NIC naming)

    You might need to experiment with these commands. One user reported the following
    combination most effective for his system.


    # ethtool -K eth0 rx off
    # ethtool -K eth0 gso off
    # ethtool -K eth0 gro off
    # ethtool -K eth0 rxvlan off

    We suspect that effective combinations of these options differ with various Linux levels and
    with various NIC adapters.

    Sebastian



    ------------------------------
    Sebastian Welton
    ------------------------------



  • 4.  RE: Issue transfer speed between zdt and local pc.

    Posted Thu August 31, 2023 06:19 AM

    Hello Sebastian, thanks for your time.

    I check that almost all parameters are "off". I tried some command and I get: Cannot set device feature settings: Operation not permitted



    ------------------------------
    Juan Carlos Delgado
    ------------------------------



  • 5.  RE: Issue transfer speed between zdt and local pc.

    Posted Thu August 31, 2023 11:53 AM

    Hi Juan,

                     a couple of things:

    • if you're transferring from the host Linux (where ZD&T is running) to z/OS then the device would be tap0, if not, run the find_io command on the ZD&T system to find which is the network adapter that is emulting the OSA and through which you communicate with z/OS ant that would the adapter to use, more times than not it is eth0 but you need to check first
    • the commands need to be run as a super user such as root, normal users cannot run these commands so you'll either need to sudo or su to run these commands

    Sebastian



    ------------------------------
    Sebastian Welton
    ------------------------------



  • 6.  RE: Issue transfer speed between zdt and local pc.

    IBM Champion
    Posted Sat September 02, 2023 06:44 AM
    I get
    colin@colin-ThinkCentre-M920s:/home/zPDT$ ethtool tap0
    Settings for tap0:
    Supported ports: [  ]
    Supported link modes:   Not reported
    Supported pause frame use: No
    Supports auto-negotiation: No
    Supported FEC modes: Not reported
    Advertised link modes:  Not reported
    Advertised pause frame use: No
    Advertised auto-negotiation: No
    Advertised FEC modes: Not reported
    Speed: 10000Mb/s
    Duplex: Full
    Auto-negotiation: off
    Port: Twisted Pair
    PHYAD: 0
    Transceiver: internal
    MDI-X: Unknown
    netlink error: Operation not permitted
            Current message level: 0x00000000 (0)

    This is between my server and the zPDT running within the server                              

    For my laptop - ethernet cable to server  I get
    colin@colin-ThinkCentre-M920s:/home/zPDT$ ethtool eno1
    Settings for eno1:
    Supported ports: [ TP ]
    Supported link modes:   10baseT/Half 10baseT/Full
                           100baseT/Half 100baseT/Full
                           1000baseT/Full
    Supported pause frame use: No
    Supports auto-negotiation: Yes
    Supported FEC modes: Not reported
    Advertised link modes:  10baseT/Half 10baseT/Full
                           100baseT/Half 100baseT/Full
                           1000baseT/Full
    Advertised pause frame use: No
    Advertised auto-negotiation: Yes
    Advertised FEC modes: Not reported
    Speed: 1000Mb/s
    Duplex: Full
    Auto-negotiation: on
    Port: Twisted Pair
    PHYAD: 1
    Transceiver: internal
    MDI-X: on (auto)
    netlink error: Operation not permitted
            Current message level: 0x00000007 (7)
                                   drv probe link
    Link detected: yes


    I dont think I have done anything special to my z/OS image

    Colin





  • 7.  RE: Issue transfer speed between zdt and local pc.

    Posted Mon September 04, 2023 11:49 AM

    Hello, thank you all. My Issue was solved with:

    sudo ethtool -K ens192 rx off
    sudo ethtool -K ens192 tso off
    sudo ethtool -K ens192 gso off 
    sudo ethtool -K ens192 gro off
    sudo ethtool -K ens192 lro off



    ------------------------------
    Juan Carlos Delgado
    ------------------------------