z/OS

z/OS

z/OS

IBM z/OS is a widely-used mainframe operating system designed for a stable, secure and highly available environment for running mission-critical applications.

 View Only
Expand all | Collapse all

EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

  • 1.  EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Sat February 18, 2023 03:09 PM

    Getting this error when Liberty starts up in a CICS 5.6 region.

    In the liberty log this message appears:

    Caused by: java.net.UnknownHostException: : : EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    It does not say what host name is causing the problem.

    The server starts up and is usable despite this error



    ------------------------------
    Dan Kalmar
    ------------------------------


  • 2.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Mon February 20, 2023 03:51 PM

    Hey Dan,

    Is the LPAR in question connected to a DNS server and functional? I've seen similar errors when the hostname for the system is unresolvable. As you mentioned, without knowing what hostname its trying to resolve it's a bit of a mystery, but I have seen several implementations where the LPAR itself is either not connected to a DNS server or is connected to a DNS server that doesn't have an entry for whatever hostname the system considers itself to be. Some services do a hostname lookup on its own hostname and will fail, but still listen on the TCPIP stack specified. A way to prevent these errors, in cases where you either can't connect to a DNS server or add a DNS entry, is to add a name to the hosts file or IPNODES table that resolves the systems name.

    Hope this helps some,

    Steven



    ------------------------------
    Steven Perva
    Sr Mainframe Innovation Engineer
    Ensono
    Chicago IL
    ------------------------------



  • 3.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Mon February 20, 2023 11:58 PM

    Hello

    I checked the hostname from OMVS and was able to PING it:

     

    DANI2:/u/DANI2: >hostname                                  

    z2open.ddns.net                                            

    DANI2:/u/DANI2: >ping z2open.ddns.net                      

    CS V2R4: Pinging host z2open.ddns.net (149.106.132.212)    

    Ping #1 response took 0.002 seconds.                       

    DANI2:/u/DANI2: >     

     

    I can also ping any public domain name from this system.

    So it seems that maybe this error is related to a blank host name defined somewhere and that is why the message includes

    Three consecutive semicolon characters ?

     

    Cheers...Dani                                    

     






  • 4.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Tue February 21, 2023 11:58 AM

    I suspect you're right. I wonder what out there is trying to do a hostname lookup and how you could possibly find out the emitter of the message... Looks like you've covered all of your bases because everything is functional. This may be a task for the CICS folks to track down if you don't believe it's associated to any user code, assuming its just something that comes out before any applications are running in the region.



    ------------------------------
    Steven Perva
    Sr Mainframe Innovation Engineer
    Ensono
    Chicago IL
    ------------------------------



  • 5.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Tue February 21, 2023 04:05 PM

    Yes, this error comes out during Liberty JVM startup before any application code is executed.

    I opened a support case with z/Os Websphere team.  Let's see what they say.

     






  • 6.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Thu March 30, 2023 04:08 AM

    Well, no progress with getting any help from IBM.

    Since we use z/OS under the ZD&T license, there is no real support for z/OS issues.

    Can anyone suggest how this error can be traced so we can figure out what hostname is causing the error message during Liberty JVM startup?



    ------------------------------
    Dan Kalmar
    ------------------------------



  • 7.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Thu March 30, 2023 08:34 PM

    Hi Dan,

    I've reached out to a few IBMers to try and get an answer. I'll point them to this thread to respond. 

    Thanks! 



    ------------------------------
    Fiona King
    ------------------------------



  • 8.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Fri March 31, 2023 12:45 AM

    Thanks Fiona !



    ------------------------------
    Dan Kalmar
    ------------------------------



  • 9.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Fri March 31, 2023 09:50 AM

    The 'Caused by" is usually part of a call stack that would show what code is throwing the exception and what called it, etc.  That would, probably, help a lot in figuring out what host name it is trying to resolve.  Do you still have it?  



    ------------------------------
    David Follis
    WebSphere Java Batch Architect
    IBM
    Poughkeepsie NY
    845-435-5462
    ------------------------------



  • 10.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Sat April 01, 2023 04:33 AM

    What debug options are required to have the "call stack" available for review?
    I have the STDERR file available.



    ------------------------------
    Dan Kalmar
    ------------------------------



  • 11.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Sat April 01, 2023 04:54 PM

    Here is the contents of STDERR:

    java.security.PrivilegedActionException: java.net.UnknownHostException: : : EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.
        at java.security.AccessController.doPrivileged(AccessController.java:751)
        at com.ibm.ws.logging.internal.impl.JsonLogHandler.<init>(JsonLogHandler.java:88)
        at com.ibm.ws.logging.internal.impl.MessageLogHandler.<init>(MessageLogHandler.java:32)
        at com.ibm.ws.logging.internal.impl.BaseTraceService.update(BaseTraceService.java:395)
        at com.ibm.ws.logging.internal.impl.BaseTraceService.init(BaseTraceService.java:270)
        at com.ibm.websphere.ras.TrConfigurator.init(TrConfigurator.java:88)
        at com.ibm.ws.logging.internal.impl.LogProviderImpl.configure(LogProviderImpl.java:33)
        at com.ibm.ws.kernel.launch.internal.LauncherDelegateImpl.getLogProviderImpl(LauncherDelegateImpl.java:195)
        at com.ibm.ws.kernel.launch.internal.LauncherDelegateImpl.launchFramework(LauncherDelegateImpl.java:91)
        at com.ibm.ws.kernel.boot.internal.KernelBootstrap.go(KernelBootstrap.java:214)
        at com.ibm.ws.kernel.boot.EmbeddedServerImpl$ServerTask.run(EmbeddedServerImpl.java:529)
        at java.lang.Thread.run(Thread.java:825)
    Caused by: java.net.UnknownHostException: : : EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.
        at java.net.InetAddress.getLocalHost(InetAddress.java:1691)
        at com.ibm.ws.logging.internal.impl.JsonLogHandler$1.run(JsonLogHandler.java:91)
        at com.ibm.ws.logging.internal.impl.JsonLogHandler$1.run(JsonLogHandler.java:88)
        at java.security.AccessController.doPrivileged(AccessController.java:747)
        ... 11 more
    Caused by: java.net.UnknownHostException: : EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.
        at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
        at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:1048)
        at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1468)
        at java.net.InetAddress.getLocalHost(InetAddress.java:1686)
        ... 14 more
    java.security.PrivilegedActionException: java.net.UnknownHostException: : : EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.
        at java.security.AccessController.doPrivileged(AccessController.java:751)
        at com.ibm.ws.logging.internal.impl.JsonLogHandler.<init>(JsonLogHandler.java:88)
        at com.ibm.ws.logging.internal.impl.ConsoleLogHandler.<init>(ConsoleLogHandler.java:43)
        at com.ibm.ws.logging.internal.impl.BaseTraceService.update(BaseTraceService.java:401)
        at com.ibm.ws.logging.internal.impl.BaseTraceService.init(BaseTraceService.java:270)
        at com.ibm.websphere.ras.TrConfigurator.init(TrConfigurator.java:88)
        at com.ibm.ws.logging.internal.impl.LogProviderImpl.configure(LogProviderImpl.java:33)
        at com.ibm.ws.kernel.launch.internal.LauncherDelegateImpl.getLogProviderImpl(LauncherDelegateImpl.java:195)
        at com.ibm.ws.kernel.launch.internal.LauncherDelegateImpl.launchFramework(LauncherDelegateImpl.java:91)
        at com.ibm.ws.kernel.boot.internal.KernelBootstrap.go(KernelBootstrap.java:214)
        at com.ibm.ws.kernel.boot.EmbeddedServerImpl$ServerTask.run(EmbeddedServerImpl.java:529)
        at java.lang.Thread.run(Thread.java:825)
    Caused by: java.net.UnknownHostException: : : EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.
        at java.net.InetAddress.getLocalHost(InetAddress.java:1691)
        at com.ibm.ws.logging.internal.impl.JsonLogHandler$1.run(JsonLogHandler.java:91)
        at com.ibm.ws.logging.internal.impl.JsonLogHandler$1.run(JsonLogHandler.java:88)
        at java.security.AccessController.doPrivileged(AccessController.java:747)
        ... 11 more
    Caused by: java.net.UnknownHostException: : EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.
        at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
        at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:1048)
        at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1468)
        at java.net.InetAddress.getLocalHost(InetAddress.java:1686)
        ... 14 more



    ------------------------------
    Dan Kalmar
    ------------------------------



  • 12.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Sun April 02, 2023 01:06 AM
      |   view attached

    I have also uploaded a more detailed "trace.log" file showing the error



    ------------------------------
    Dan Kalmar
    ------------------------------

    Attachment(s)

    txt
    trace.log.txt   2.05 MB 1 version


  • 13.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Mon April 03, 2023 08:17 AM

    Looking at the source for JsonLogHandler (https://github.com/OpenLiberty/open-liberty/blob/integration/dev/com.ibm.ws.logging/src/com/ibm/ws/logging/internal/impl/JsonLogHandler.java) it would appear we're doing this:

    InetAddress.getLocalHost().getCanonicalHostName();

    and from the call stack it looks like getLocalHost is the bit that is throwing the error.  
    The doc for that says it throws an unknown host exception "if the local host name could not be resolved into an address." 
    I don't know what could cause that though...



    ------------------------------
    David Follis
    WebSphere z/OS and Java Batch Architect
    IBM
    Poughkeepsie NY
    845-435-5462
    ------------------------------



  • 14.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Mon April 03, 2023 10:06 AM

    Does it say anywhere what the local host name is ?  (the one it is trying to resolve) 



    ------------------------------
    Dan Kalmar
    ------------------------------



  • 15.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Mon April 03, 2023 10:12 AM
    Edited by David Follis Mon April 03, 2023 10:19 AM

    I believe it is asking the TCP/IP stack what its local host name is...  I have no idea why it wouldn't know...
    The bottom call stack segment has this:
    --
    at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
        at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:1048)
        at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1468)
        at java.net.InetAddress.getLocalHost(InetAddress.java:1686)
    --
    The top thing there (lookupAllHostAddr) is going out of Java (native method), probably to call some C API that ultimately calls TCP/IP...but I'm out of my neighborhood now...

    I asked around and got a suggestion to collect the TCP/IP Resolver trace...

    Collecting TRACE RESOLVER Output





    ------------------------------
    David Follis
    WebSphere z/OS and Java Batch Architect
    IBM
    Poughkeepsie NY
    845-435-5462
    ------------------------------



  • 16.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Mon April 03, 2023 10:43 AM

    Thanks for the info.
    I'll tryo to get a Resolver trace.



    ------------------------------
    Dan Kalmar
    ------------------------------



  • 17.  RE: EDC9503I A non-recoverable error occurred when attempting to resolve the name or address.

    Posted Sun April 09, 2023 06:29 AM

    The resolver trace shows the following error when the JVM starts up:

    *************************************************************************** 
    GetNameInfo Started: 2023/04/09 10:54:30.706575                             
    GetNameinfo Invoked with following inputs:                                  
       Sockaddr Structure:                                                      
         Sock_len: 16                                                           
         Sock_family: 2                                                         
         Sock_sin_port: 0                                                       
         Sock_sin_Addr: 149.106.132.212                                         
       Sockaddr Length:    16                                                   
       No Service Name specified                                                
       Host Name Length:  1025                                                  
       Flags parameter supplied with settings:                                  
         Flags = 0x00000004                                                     
       Options parameter supplied with settings:                                
       Options = 0xC0000001                                                     
       Identification parameter supplied with settings:                         
         Identification = 0x00000005                                            
    GetNameInfo - DNS lookup for IPv4 Address                                   
    res_query(212.132.106.149.in-addr.arpa, C_IN, T_PTR)                        
     Querying resolver cache for 149.106.132.212                                
     EZBRECFR:  RetVal = 0, RC = 0, Reason = 0x00000000                         
     Negative Cache data from 192.168.1.254 was retrieved                       
    res_query Failed:  RetVal = -1, RC = 1, Reason = 0x78981005                 
    GetNameInfo - Local table lookup for IPv4 Address                           
     ADDRTABLE from globalipnodes ADCD.Z24D.TCPPARMS(Z2OIPNOZ)                  
     - Lookup for 149.106.132.212                                               
    GetNameInfo Failed Using Local Tables                                       
    GetNameInfo Failed:  RetVal = -1, RC = 1, Reason = 0x78AB1004               
    GetNameInfo Ended: 2023/04/09 10:54:30.790705                               
    *************************************************************************** 

    Seems it tries to validate the external IP assigned to the router:   149.106.132.212

    I have now added an entry for this IP into the Resolver's globalipnodes table.
    This change eliminated the error.

    Thanks for the help.



    ------------------------------
    Dan Kalmar
    ------------------------------