IBM Security Verify

 View Only
Expand all | Collapse all

Getting an error while performing IDP initiated SSO

  • 1.  Getting an error while performing IDP initiated SSO

    Posted Thu November 12, 2020 10:22 AM
    Logged in to the IDP portal and when clicked on Splunk application it is redirecting to IDP login page instead of logging into Splunk application. I resarted the LMI and it didn't resolve the issue. Any advise? From the Federation message logs,

    11/12/20 8:59:07:116 EST] 00000690 i.am.fim.trustserver.sts.modules.OAuth20MappingRuleSTSModule E No client ID found for token ID DOk8PsdG1T0A9TKID7ck
    [11/12/20 8:59:07:118 EST] 00000690 i.am.fim.trustserver.sts.modules.OAuth20MappingRuleSTSModule E OAuth mapping rule missing for client ID null
    [11/12/20 9:10:57:708 EST] 000001bd com.ibm.ws.logging.internal.impl.IncidentImpl I FFDC1015I: An FFDC Incident has been created: "org.postgresql.util.PSQLException: FATAL: the database system is shutting down com.ibm.ws.rsadapter.impl.PostgreSQLHelper 1298" at ffdc_20.11.12_09.10.57.0.log
    [11/12/20 9:10:57:784 EST] 000001bd com.ibm.ws.logging.internal.impl.IncidentImpl I FFDC1015I: An FFDC Incident has been created: "com.ibm.ws.rsadapter.exceptions.DataStoreAdapterException: DSRA8100E: Unable to get a PooledConnection from the DataSource. with SQL State : 57P03 SQL Code : 0 com.ibm.ejs.j2c.poolmanager.FreePool.createManagedConnectionWithMCWrapper 199" at ffdc_20.11.12_09.10.57.1.log
    [11/12/20 9:10:57:787 EST] 000001bd com.ibm.ws.logging.internal.impl.IncidentImpl I FFDC1015I: An FFDC Incident has been created: "javax.resource.spi.ResourceAllocationException: DSRA8100E: Unable to get a PooledConnection from the DataSource. with SQL State : 57P03 SQL Code : 0 com.ibm.ws.rsadapter.jdbc.WSJdbcDataSource.getConnection 299" at ffdc_20.11.12_09.10.57.2.log
    [11/12/20 9:11:00:806 EST] 000001bd com.tivoli.am.fim.distributed.jdbc.JDBCCleanupThread I java.lang.RuntimeException: Cannot get a good connection from the database.
    at com.tivoli.am.fim.utils.sql.DataSourceWithRetry.getConnection(DataSourceWithRetry.java:166)
    at com.tivoli.am.fim.distributed.jdbc.JDBCDAOFactory.getTransaction(JDBCDAOFactory.java:76)
    at com.tivoli.am.fim.distributed.jdbc.JDBCDBHelper.<init>(JDBCDBHelper.java:64)
    at com.tivoli.am.fim.distributed.jdbc.JDBCCleanupThread.cleanUp(JDBCCleanupThread.java:77)
    at com.tivoli.am.fim.distributed.jdbc.JDBCCleanupThread.run(JDBCCleanupThread.java:65)
    Caused by: java.sql.SQLException: FATAL: the database system is shutting down DSRA0010E: SQL State = 57P03, Error Code = 0
    at org.postgresql.core.v3.ConnectionFactoryImpl.doAuthentication(ConnectionFactoryImpl.java:398)
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:173)
    at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64)
    at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:136)
    at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29)
    at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21)
    at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:31)
    at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24)
    at org.postgresql.Driver.makeConnection(Driver.java:393)
    at org.postgresql.Driver.connect(Driver.java:267)
    at java.sql.DriverManager.getConnection(DriverManager.java:675)
    at java.sql.DriverManager.getConnection(DriverManager.java:258)
    at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:95)
    at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:78)
    at org.postgresql.ds.jdbc23.AbstractJdbc23ConnectionPoolDataSource.getPooledConnection(AbstractJdbc23ConnectionPoolDataSource.java:58)
    at com.ibm.ws.rsadapter.impl.DatabaseHelper$1.run(DatabaseHelper.java:955)
    at com.ibm.ws.rsadapter.impl.DatabaseHelper$1.run(DatabaseHelper.java:941)
    at java.security.AccessController.doPrivileged(AccessController.java:703)
    at com.ibm.ws.rsadapter.impl.DatabaseHelper.getPooledConnection(DatabaseHelper.java:941)
    at com.ibm.ws.rsadapter.impl.WSManagedConnectionFactoryImpl.getConnection(WSManagedConnectionFactoryImpl.java:824)
    at com.ibm.ws.rsadapter.impl.WSManagedConnectionFactoryImpl.createManagedConnection(WSManagedConnectionFactoryImpl.java:665)
    at com.ibm.ejs.j2c.FreePool.createManagedConnectionWithMCWrapper(FreePool.java:1372)
    at com.ibm.ejs.j2c.FreePool.createOrWaitForConnection(FreePool.java:1246)
    at com.ibm.ejs.j2c.PoolManager.reserve(PoolManager.java:1465)
    at com.ibm.ejs.j2c.ConnectionManager.allocateMCWrapper(ConnectionManager.java:581)
    at com.ibm.ejs.j2c.ConnectionManager.allocateConnection(ConnectionManager.java:314)
    at com.ibm.ws.rsadapter.jdbc.WSJdbcDataSource.getConnection(WSJdbcDataSource.java:138)
    at com.ibm.ws.rsadapter.jdbc.WSJdbcDataSource.getConnection(WSJdbcDataSource.java:112)
    at com.tivoli.am.fim.utils.sql.DataSourceWithRetry.getConnection(DataSourceWithRetry.java:124)
    ... 4 more

    [11/12/20 9:11:08:480 EST] 00000067 com.ibm.ws.logging.internal.impl.IncidentImpl I FFDC1015I: An FFDC Incident has been created: "org.postgresql.util.PSQLException: Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections. com.ibm.ws.rsadapter.impl.PostgreSQLHelper 1298" at ffdc_20.11.12_09.11.08.0.log
    [11/12/20 9:11:08:532 EST] 00000067 com.ibm.ws.logging.internal.impl.IncidentImpl I FFDC1015I: An FFDC Incident has been created: "com.ibm.ws.rsadapter.exceptions.DataStoreAdapterException: DSRA8100E: Unable to get a PooledConnection from the DataSource. with SQL State : 08001 SQL Code : 0 com.ibm.ejs.j2c.poolmanager.FreePool.createManagedConnectionWithMCWrapper 199" at ffdc_20.11.12_09.11.08.1.log
    [11/12/20 9:11:08:534 EST] 00000067 com.ibm.ws.logging.internal.impl.IncidentImpl I FFDC1015I: An FFDC Incident has been created: "javax.resource.spi.ResourceAllocationException: DSRA8100E: Unable to get a PooledConnection from the DataSource. with SQL State : 08001 SQL Code : 0 com.ibm.ws.rsadapter.jdbc.WSJdbcDataSource.getConnection 299" at ffdc_20.11.12_09.11.08.2.log
    [11/12/20 9:11:08:534 EST] 00000067 com.ibm.tscc.rtss.storage.spif.DBStorageRuntimeServiceImpl E CTGVS3511E An error occurred while establishing a connection to the DataSource with JNDI name "jdbc/config".
    java.sql.SQLException: Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections. DSRA0010E: SQL State = 08001, Error Code = 0
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:207)
    at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64)
    at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:136)
    at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29)
    at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21)
    at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:31)
    at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24)
    at org.postgresql.Driver.makeConnection(Driver.java:393)
    at org.postgresql.Driver.connect(Driver.java:267)
    at java.sql.DriverManager.getConnection(DriverManager.java:675)
    at java.sql.DriverManager.getConnection(DriverManager.java:258)
    at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:95)
    at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:78)
    at org.postgresql.ds.jdbc23.AbstractJdbc23ConnectionPoolDataSource.getPooledConnection(AbstractJdbc23ConnectionPoolDataSource.java:58)
    at com.ibm.ws.rsadapter.impl.DatabaseHelper$1.run(DatabaseHelper.java:955)
    at com.ibm.ws.rsadapter.impl.DatabaseHelper$1.run(DatabaseHelper.java:941)
    at java.security.AccessController.doPrivileged(AccessController.java:703)
    at com.ibm.ws.rsadapter.impl.DatabaseHelper.getPooledConnection(DatabaseHelper.java:941)
    at com.ibm.ws.rsadapter.impl.WSManagedConnectionFactoryImpl.getConnection(WSManagedConnectionFactoryImpl.java:824)
    at com.ibm.ws.rsadapter.impl.WSManagedConnectionFactoryImpl.createManagedConnection(WSManagedConnectionFactoryImpl.java:665)
    at com.ibm.ejs.j2c.FreePool.createManagedConnectionWithMCWrapper(FreePool.java:1372)
    at com.ibm.ejs.j2c.FreePool.createOrWaitForConnection(FreePool.java:1246)
    at com.ibm.ejs.j2c.PoolManager.reserve(PoolManager.java:1465)
    at com.ibm.ejs.j2c.ConnectionManager.allocateMCWrapper(ConnectionManager.java:581)
    at com.ibm.ejs.j2c.ConnectionManager.allocateConnection(ConnectionManager.java:314)
    at com.ibm.ws.rsadapter.jdbc.WSJdbcDataSource.getConnection(WSJdbcDataSource.java:138)
    at com.ibm.ws.rsadapter.jdbc.WSJdbcDataSource.getConnection(WSJdbcDataSource.java:112)
    at com.ibm.tscc.rtss.storage.spif.DBStorageRuntimeServiceImpl.getConnection(DBStorageRuntimeServiceImpl.java:203)
    at com.ibm.tscc.rtss.storage.spif.DBStorageRuntimeServiceImpl.getLastPolicyUpdate(DBStorageRuntimeServiceImpl.java:1028)
    at com.ibm.tscc.rtss.storage.spif.DBStorageRuntimeServiceImpl.notifyListenersIfUpdated(DBStorageRuntimeServiceImpl.java:997)
    at com.ibm.tscc.rtss.spif.monitor.DefaultMonitor.run(DefaultMonitor.java:177)
    at java.lang.Thread.run(Thread.java:812)
    Caused by: java.net.ConnectException: Connection refused (Connection refused)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:380)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:236)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:218)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403)
    at java.net.Socket.connect(Socket.java:666)
    at java.net.Socket.connect(Socket.java:606)
    at org.postgresql.core.PGStream.<init>(PGStream.java:60)
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:101)
    ... 31 more

    [11/12/20 9:11:09:049 EST] 00000067 com.ibm.tscc.rtss.storage.spif.DBStorageRuntimeServiceImpl E CTGVS3511E An error occurred while establishing a connection to the DataSource with JNDI name "jdbc/config".
    java.sql.SQLException: Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections. DSRA0010E: SQL State = 08001, Error Code = 0
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:207)
    at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:64)
    at org.postgresql.jdbc2.AbstractJdbc2Connection.<init>(AbstractJdbc2Connection.java:136)
    at org.postgresql.jdbc3.AbstractJdbc3Connection.<init>(AbstractJdbc3Connection.java:29)
    at org.postgresql.jdbc3g.AbstractJdbc3gConnection.<init>(AbstractJdbc3gConnection.java:21)
    at org.postgresql.jdbc4.AbstractJdbc4Connection.<init>(AbstractJdbc4Connection.java:31)
    at org.postgresql.jdbc4.Jdbc4Connection.<init>(Jdbc4Connection.java:24)
    at org.postgresql.Driver.makeConnection(Driver.java:393)
    at org.postgresql.Driver.connect(Driver.java:267)
    at java.sql.DriverManager.getConnection(DriverManager.java:675)
    at java.sql.DriverManager.getConnection(DriverManager.java:258)
    at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:95)
    at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:78)
    at org.postgresql.ds.jdbc23.AbstractJdbc23ConnectionPoolDataSource.getPooledConnection(AbstractJdbc23ConnectionPoolDataSource.java:58)
    at com.ibm.ws.rsadapter.impl.DatabaseHelper$1.run(DatabaseHelper.java:955)
    at com.ibm.ws.rsadapter.impl.DatabaseHelper$1.run(DatabaseHelper.java:941)
    at java.security.AccessController.doPrivileged(AccessController.java:703)
    at com.ibm.ws.rsadapter.impl.DatabaseHelper.getPooledConnection(DatabaseHelper.java:941)
    at com.ibm.ws.rsadapter.impl.WSManagedConnectionFactoryImpl.getConnection(WSManagedConnectionFactoryImpl.java:824)
    at com.ibm.ws.rsadapter.impl.WSManagedConnectionFactoryImpl.createManagedConnection(WSManagedConnectionFactoryImpl.java:665)
    at com.ibm.ejs.j2c.FreePool.createManagedConnectionWithMCWrapper(FreePool.java:1372)
    at com.ibm.ejs.j2c.FreePool.createOrWaitForConnection(FreePool.java:1246)
    at com.ibm.ejs.j2c.PoolManager.reserve(PoolManager.java:1465)
    at com.ibm.ejs.j2c.ConnectionManager.allocateMCWrapper(ConnectionManager.java:581)
    at com.ibm.ejs.j2c.ConnectionManager.allocateConnection(ConnectionManager.java:314)
    at com.ibm.ws.rsadapter.jdbc.WSJdbcDataSource.getConnection(WSJdbcDataSource.java:138)
    at com.ibm.ws.rsadapter.jdbc.WSJdbcDataSource.getConnection(WSJdbcDataSource.java:112)
    at com.ibm.tscc.rtss.storage.spif.DBStorageRuntimeServiceImpl.getConnection(DBStorageRuntimeServiceImpl.java:203)
    at com.ibm.tscc.rtss.storage.spif.DBStorageRuntimeServiceImpl.getLastPolicyUpdate(DBStorageRuntimeServiceImpl.java:1028)
    at com.ibm.tscc.rtss.storage.spif.DBStorageRuntimeServiceImpl.notifyListenersIfUpdated(DBStorageRuntimeServiceImpl.java:997)
    at com.ibm.tscc.rtss.spif.monitor.DefaultMonitor.run(DefaultMonitor.java:177)
    at java.lang.Thread.run(Thread.java:812)
    Caused by: java.net.ConnectException: Connection refused (Connection refused)
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:380)
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:236)
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:218)
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:403)
    at java.net.Socket.connect(Socket.java:666)
    at java.net.Socket.connect(Socket.java:606)
    at org.postgresql.core.PGStream.<init>(PGStream.java:60)
    at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:101)
    ... 31 more

    ------------------------------
    Venkat
    ------------------------------

    Attachment(s)



  • 2.  RE: Getting an error while performing IDP initiated SSO

    Posted Thu November 19, 2020 04:52 AM
    Venkat,

    There are a number of issues recorded in the message.log you have shared.

    1. OAuth Access Token not recognized - probably because it has expired (especially since next error is about refresh_token which client would try after failed Access Token).
    2. OAuth Refresh Token not recognized.  This seems to be related to this error also:
    FBTSPS071I The entity identified by uuid9565820f-016b-1007-b921-adbe994aef71 and display name https://splunkdevindexer1.core.mt.hicloud used within the federation or affiliation with ID uuid954c6d8c-016b-1273-9c27-adbe994aef71 and display name ICAP_Federation1 is disabled and not available for runtime use.

    Maybe something in you federation/OIDC configuration (ICAP_Federation1) is disabled?

    3. Database connection issues.  Not clear if this is related to errors but you probably need to check your database configuration and connectivity.

    Jon.

    ------------------------------
    Jon Harry
    Consulting IT Security Specialist
    IBM
    ------------------------------