IBM QRadar SOAR

 View Only

 AppHost Custom App actions "Pending", app tests successful, webserver error

A P's profile image
A P posted Wed September 17, 2025 05:14 AM

Hi,

We have been running our custom app for over two years and nothing has been changed. However, it has stopped working yesterday and I can see this error in the logs (but I'm not sure if it's related).

2025-09-17 08:40:49,585 DEBUG [connectionpool] [MainThread] https://hostname:443 "GET /rest/orgs/201 HTTP/1.1" 200 None
2025-09-17 08:40:49,591 DEBUG [rest_helper] [MainThread] Getting server version
2025-09-17 08:40:49,689 DEBUG [connectionpool] [MainThread] https://hostname:443 "GET /rest/const HTTP/1.1" 200 None
2025-09-17 08:40:49,695 INFO [rest_helper] [MainThread] IBM Security QRadar SOAR version: v51.0.7.0.20613
2025-09-17 08:40:50,125 DEBUG [connectionpool] [MainThread] https://hostname:443 "GET /rest/orgs/201/types/incident/fields HTTP/1.1" 200 None
2025-09-17 08:40:50,491 DEBUG [connectionpool] [MainThread] https://hostname:443 "GET /rest/orgs/201/types/actioninvocation/fields HTTP/1.1" 200 None
2025-09-17 08:40:50,931 DEBUG [connectionpool] [MainThread] https://hostname:443 "GET /rest/orgs/201/actions HTTP/1.1" 200 None
2025-09-17 08:40:50,939 INFO [actions_component] [MainThread] stomp_prefetch_limit set to 25
2025-09-17 08:40:50,947 INFO [actions_component] [MainThread] num_workers set to 25
2025-09-17 08:40:50,947 INFO [actions_component] [MainThread] Requesting existing queues for existing connectors
2025-09-17 08:40:51,020 DEBUG [connectionpool] [MainThread] https://hostname:443 "GET /rest/orgs/201/connectors/queues HTTP/1.1" 200 26
2025-09-17 08:40:51,021 DEBUG [actions_component] [MainThread] Got 0 connector queue(s) to subscribe to: []
2025-09-17 08:40:51,021 INFO [app] [MainThread] Components auto-load directory: /var/rescircuits/components/components
2025-09-17 08:40:51,082 INFO [component_loader] [MainThread] low code subscription queue: None
2025-09-17 08:40:51,082 INFO [component_loader] [MainThread] No low_code handlers found for connectors: set()
2025-09-17 08:40:51,083 INFO [component_loader] [MainThread] 'rc_cts.components.searcher_example.SearcherExample' loading
2025-09-17 08:40:51,083 DEBUG [component_loader] [MainThread] 'rc_cts.components.searcher_example.SearcherExample' loaded
2025-09-17 08:40:51,083 INFO [component_loader] [MainThread] 'rc_cts.components.threat_webservice.CustomThreatService' loading
2025-09-17 08:40:51,084 INFO [threat_webservice] [MainThread] Web handler for /cts/POST, /cts/GET, /cts/OPTIONS
2025-09-17 08:40:51,085 DEBUG [component_loader] [MainThread] 'rc_cts.components.threat_webservice.CustomThreatService' loaded
2025-09-17 08:40:51,086 INFO [component_loader] [MainThread] 'rc_webserver.components.webroot.WebRoot' loading
2025-09-17 08:40:51,086 DEBUG [component_loader] [MainThread] 'rc_webserver.components.webroot.WebRoot' loaded
2025-09-17 08:40:51,086 INFO [component_loader] [MainThread] 'rc_webserver.components.webservice.WebService' loading
2025-09-17 08:40:51,087 INFO [webservice] [MainThread] WebService listen address: 
2025-09-17 08:40:51,088 DEBUG [component_loader] [MainThread] 'rc_webserver.components.webservice.WebService' loaded
2025-09-17 08:40:51,088 INFO [component_loader] [MainThread] 'rc_cts.components.searcher_example.SearcherExample' loading
2025-09-17 08:40:51,088 DEBUG [component_loader] [MainThread] 'rc_cts.components.searcher_example.SearcherExample' loaded
2025-09-17 08:40:51,088 INFO [component_loader] [MainThread] 'rc_cts.components.threat_webservice.CustomThreatService' loading
2025-09-17 08:40:51,090 INFO [threat_webservice] [MainThread] Web handler for /cts/POST, /cts/GET, /cts/OPTIONS
2025-09-17 08:40:51,090 DEBUG [component_loader] [MainThread] 'rc_cts.components.threat_webservice.CustomThreatService' loaded
2025-09-17 08:40:51,090 INFO [component_loader] [MainThread] 'rc_webserver.components.webroot.WebRoot' loading
2025-09-17 08:40:51,090 DEBUG [component_loader] [MainThread] 'rc_webserver.components.webroot.WebRoot' loaded
2025-09-17 08:40:51,090 INFO [component_loader] [MainThread] 'rc_webserver.components.webservice.WebService' loading
2025-09-17 08:40:51,092 ERROR [webservice] [MainThread] Traceback (most recent call last):
  File "/opt/app-root/lib64/python3.9/site-packages/rc_webserver/components/webservice.py", line 56, in __init__
    super(WebService, self).__init__(_make_loc(opts), **_make_args(opts))
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/web/servers.py", line 146, in __init__
    super().__init__(bind, **kwargs)
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/web/servers.py", line 71, in __init__
    self.server = SocketType(
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/net/sockets.py", line 482, in __init__
    self._sock = self._create_socket()
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/net/sockets.py", line 768, in _create_socket
    sock = super()._create_socket()
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/net/sockets.py", line 755, in _create_socket
    sock.bind(self._bind)
OSError: [Errno 98] Address already in use

2025-09-17 08:40:51,092 ERROR [component_loader] [MainThread] Failed to load 'rc_webserver.components.webservice.WebService' ([Errno 98] Address already in use)
Traceback (most recent call last):
  File "/opt/app-root/lib64/python3.9/site-packages/resilient_circuits/component_loader.py", line 185, in _register_components
    component_class(opts=self.opts).register(self)
  File "/opt/app-root/lib64/python3.9/site-packages/rc_webserver/components/webservice.py", line 56, in __init__
    super(WebService, self).__init__(_make_loc(opts), **_make_args(opts))
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/web/servers.py", line 146, in __init__
    super().__init__(bind, **kwargs)
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/web/servers.py", line 71, in __init__
    self.server = SocketType(
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/net/sockets.py", line 482, in __init__
    self._sock = self._create_socket()
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/net/sockets.py", line 768, in _create_socket
    sock = super()._create_socket()
  File "/opt/app-root/lib64/python3.9/site-packages/circuits/net/sockets.py", line 755, in _create_socket
    sock.bind(self._bind)
OSError: [Errno 98] Address already in use
2025-09-17 08:40:51,093 INFO [component_loader] [MainThread] Loading 'ActionItemActions' from /var/rescircuits/components/components/ActionItemActions.py
2025-09-17 08:40:51,093 INFO [component_loader] [MainThread] Loading 'ArcSightActions' from /var/rescircuits/components/components/ArcSightActions.py
2025-09-17 08:40:51,093 INFO [component_loader] [MainThread] Loading 'AuxiliaryActions' from /var/rescircuits/components/components/AuxiliaryActions.py
2025-09-17 08:40:51,093 INFO [component_loader] [MainThread] Loading 'CaseActions' from /var/rescircuits/components/components/CaseActions.py
2025-09-17 08:40:51,094 INFO [component_loader] [MainThread] Loading 'DEVActions' from /var/rescircuits/components/components/DEVActions.py
2025-09-17 08:40:51,094 INFO [component_loader] [MainThread] Loading 'GeneralActions' from /var/rescircuits/components/components/GeneralActions.py
2025-09-17 08:40:51,094 INFO [component_loader] [MainThread] Loading 'IncidentActions' from /var/rescircuits/components/components/IncidentActions.py
2025-09-17 08:40:51,094 INFO [component_loader] [MainThread] Loading 'LocalMarketActions' from /var/rescircuits/components/components/LocalMarketActions.py
2025-09-17 08:40:51,094 INFO [component_loader] [MainThread] Loading 'ShiftlogActions' from /var/rescircuits/components/components/ShiftlogActions.py
2025-09-17 08:40:51,095 INFO [component_loader] [MainThread] Not loading TIP_Phase2Actions
2025-09-17 08:40:51,095 INFO [component_loader] [MainThread] Loading 'ThreatActions' from /var/rescircuits/components/components/ThreatActions.py
2025-09-17 08:40:51,095 INFO [component_loader] [MainThread] Not loading auxiliary_retention
2025-09-17 08:40:51,095 INFO [component_loader] [MainThread] Not loading searcher
2025-09-17 08:40:51,095 DEBUG [debugger] [MainThread] <registered[*] (<Debugger/* 8:MainThread (queued=0) [S]>, <App/* 8:MainThread (queued=29) [R]> )>
2025-09-17 08:40:51,096 DEBUG [debugger] [MainThread] <registered[cts_search.example] (<SearcherExample/cts_search.example 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,096 WARNING [actions_component] [MainThread] Channel: cts_search.example not associated with any handler
2025-09-17 08:40:51,096 DEBUG [debugger] [MainThread] <registered[*] (<Timer/* 8:MainThread (queued=0) [S]>, <Actions/* 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,097 DEBUG [debugger] [MainThread] <registered[web] (<TCPServer/web 8:MainThread (queued=0) [S]>, <WebService/web 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,097 WARNING [actions_component] [MainThread] Channel: web not associated with any handler
2025-09-17 08:40:51,097 DEBUG [debugger] [MainThread] <registered[*] (<Timer/* 8:MainThread (queued=0) [S]>, <Actions/* 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,098 DEBUG [debugger] [MainThread] <registered[*] (<Actions/* 8:MainThread (queued=0) [S]>, <App/* 8:MainThread (queued=26) [R]> )>
2025-09-17 08:40:51,098 WARNING [actions_component] [MainThread] Unverified STOMP TLS certificate (cafile=false)
2025-09-17 08:40:51,104 INFO [stomp_component] [MainThread] Connect to STOMP at 'hostname:65001'
2025-09-17 08:40:51,105 DEBUG [stomp_component] [MainThread] Set SSL for STOMP client for hosts '[('hostname', 65001)]' and certs 'None'
2025-09-17 08:40:51,105 DEBUG [stomp_component] [MainThread] STOMP listener initiated and listening for STOMP events
2025-09-17 08:40:51,106 DEBUG [debugger] [MainThread] <registered[web] (<HTTP/web 8:MainThread (queued=0) [S]>, <WebService/web 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,106 WARNING [actions_component] [MainThread] Channel: web not associated with any handler
2025-09-17 08:40:51,107 DEBUG [debugger] [MainThread] <registered[/cts] (<CustomThreatService//cts 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,107 WARNING [actions_component] [MainThread] Channel: threat_lookup_complete not associated with any handler
2025-09-17 08:40:51,107 WARNING [actions_component] [MainThread] Channel: /cts not associated with any handler
2025-09-17 08:40:51,107 DEBUG [debugger] [MainThread] <registered[loader] (<ComponentLoader/loader 8:MainThread (queued=0) [S]>, <App/* 8:MainThread (queued=25) [R]> )>
2025-09-17 08:40:51,108 WARNING [actions_component] [MainThread] Channel: loader not associated with any handler
2025-09-17 08:40:51,108 DEBUG [debugger] [MainThread] <registered[web] (<Dispatcher/web 8:MainThread (queued=0) [S]>, <HTTP/web 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,108 WARNING [actions_component] [MainThread] Channel: web not associated with any handler
2025-09-17 08:40:51,108 DEBUG [debugger] [MainThread] <registered[/] (<WebRoot// 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,109 WARNING [actions_component] [MainThread] Channel: / not associated with any handler
2025-09-17 08:40:51,109 DEBUG [debugger] [MainThread] <registered[*] (<Timer/* 8:MainThread (queued=0) [S]>, <Actions/* 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,109 DEBUG [debugger] [MainThread] <started[*] (<App/* 8:MainThread (queued=21) [R]> )>
2025-09-17 08:40:51,109 INFO [app] [MainThread] App Started
2025-09-17 08:40:51,110 DEBUG [debugger] [MainThread] <registered[web] (<WebService/web 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,110 WARNING [actions_component] [MainThread] Channel: web not associated with any handler
2025-09-17 08:40:51,110 DEBUG [debugger] [MainThread] <registered[functionworker] (<FunctionWorker/functionworker 8:MainThread (queued=0) [S]>, <Actions/* 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,110 WARNING [actions_component] [MainThread] Channel: functionworker not associated with any handler
2025-09-17 08:40:51,111 DEBUG [debugger] [MainThread] <registered[cts_search.example] (<SearcherExample/cts_search.example 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,111 WARNING [actions_component] [MainThread] Channel: cts_search.example not associated with any handler
2025-09-17 08:40:51,112 DEBUG [debugger] [MainThread] <registered[/cts] (<CustomThreatService//cts 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,112 WARNING [actions_component] [MainThread] Channel: threat_lookup_complete not associated with any handler
2025-09-17 08:40:51,112 WARNING [actions_component] [MainThread] Channel: /cts not associated with any handler
2025-09-17 08:40:51,112 DEBUG [debugger] [MainThread] <registered[/] (<WebRoot// 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,112 WARNING [actions_component] [MainThread] Channel: / not associated with any handler
2025-09-17 08:40:51,113 DEBUG [debugger] [MainThread] <load_all_failure[loader] ( )>
2025-09-17 08:40:51,113 ERROR [app] [MainThread] A component failed to load.  The application cannot start.
2025-09-17 08:40:51,113 DEBUG [debugger] [MainThread] <load[loader] ('ActionItemActions' )>
2025-09-17 08:40:51,133 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,135 DEBUG [debugger] [MainThread] <load[loader] ('ArcSightActions' )>
2025-09-17 08:40:51,140 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,141 DEBUG [debugger] [MainThread] <load[loader] ('AuxiliaryActions' )>
2025-09-17 08:40:51,164 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,171 DEBUG [debugger] [MainThread] <load[loader] ('CaseActions' )>
2025-09-17 08:40:51,184 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,185 DEBUG [debugger] [MainThread] <load[loader] ('DEVActions' )>
2025-09-17 08:40:51,186 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,187 DEBUG [debugger] [MainThread] <load[loader] ('GeneralActions' )>
2025-09-17 08:40:51,780 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,781 DEBUG [debugger] [MainThread] <load[loader] ('IncidentActions' )>
2025-09-17 08:40:51,888 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,890 DEBUG [debugger] [MainThread] <load[loader] ('LocalMarketActions' )>
2025-09-17 08:40:51,892 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,893 DEBUG [debugger] [MainThread] <load[loader] ('ShiftlogActions' )>
2025-09-17 08:40:51,895 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,896 DEBUG [debugger] [MainThread] <load[loader] ('ThreatActions' )>
2025-09-17 08:40:51,900 DEBUG [actions_component] [MainThread] Not multitenant
2025-09-17 08:40:51,901 DEBUG [debugger] [MainThread] <registered[select] (<Select/select 8:MainThread (queued=0) [S]>, <TCPServer/web 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,901 WARNING [actions_component] [MainThread] Channel: select not associated with any handler
2025-09-17 08:40:51,902 DEBUG [debugger] [MainThread] <ready[web] (<TCPServer/web 8:MainThread (queued=0) [S]>, ('127.0.0.1', 9000) )>
circuits.web/3.2.3 ready! Listening on: http://127.0.0.1:9000
2025-09-17 08:40:51,903 DEBUG [debugger] [MainThread] <registered[stomp] (<StompClient/stomp 8:MainThread (queued=0) [S]>, <Actions/* 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,903 WARNING [actions_component] [MainThread] Channel: stomp not associated with any handler
2025-09-17 08:40:51,903 DEBUG [debugger] [MainThread] <reconnect[*] ( subscribe=False)>
2025-09-17 08:40:51,903 DEBUG [debugger] [MainThread] <stopped[*] (<App/* 8:MainThread (queued=10) [S]> )>
2025-09-17 08:40:51,904 INFO [app] [MainThread] App Stopped
2025-09-17 08:40:51,905 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<ActionItemActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,906 INFO [actions_component] [MainThread] 'ActionItemActions.ActionItemActions' actions registered to 'im_actions'
2025-09-17 08:40:51,906 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<ArcSightActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,906 INFO [actions_component] [MainThread] 'ArcSightActions.ArcSightActions' actions registered to 'im_actions'
2025-09-17 08:40:51,907 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<AuxiliaryActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,907 INFO [actions_component] [MainThread] 'AuxiliaryActions.AuxiliaryActions' actions registered to 'im_actions'
2025-09-17 08:40:51,907 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<CaseActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,908 INFO [actions_component] [MainThread] 'CaseActions.CaseActions' actions registered to 'im_actions'
2025-09-17 08:40:51,908 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<DEVActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,908 INFO [actions_component] [MainThread] 'DEVActions.DEVActions' actions registered to 'im_actions'
2025-09-17 08:40:51,908 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<GeneralActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,909 INFO [actions_component] [MainThread] 'GeneralActions.GeneralActions' actions registered to 'im_actions'
2025-09-17 08:40:51,909 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<IncidentActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,909 INFO [actions_component] [MainThread] 'IncidentActions.IncidentActions' actions registered to 'im_actions'
2025-09-17 08:40:51,910 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<LocalMarketActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,910 INFO [actions_component] [MainThread] 'LocalMarketActions.LocalMarketActions' actions registered to 'im_actions'
2025-09-17 08:40:51,910 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<ShiftlogActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,911 INFO [actions_component] [MainThread] 'ShiftlogActions.ShiftlogActions' actions registered to 'im_actions'
2025-09-17 08:40:51,911 DEBUG [debugger] [MainThread] <registered[actions.im_actions] (<ThreatActions/actions.im_actions 8:MainThread (queued=0) [S]>, <ComponentLoader/loader 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,911 INFO [actions_component] [MainThread] 'ThreatActions.ThreatActions' actions registered to 'im_actions'
2025-09-17 08:40:51,911 INFO [actions_component] [MainThread] STOMP attempting to connect
2025-09-17 08:40:51,912 DEBUG [debugger] [MainThread] <close[web] ( )>
2025-09-17 08:40:51,912 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('ActionItemActions' )>, <ActionItemActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,912 INFO [component_loader] [MainThread] Loaded and registered component 'ActionItemActions'
2025-09-17 08:40:51,912 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('ArcSightActions' )>, <ArcSightActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,913 INFO [component_loader] [MainThread] Loaded and registered component 'ArcSightActions'
2025-09-17 08:40:51,913 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('AuxiliaryActions' )>, <AuxiliaryActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,913 INFO [component_loader] [MainThread] Loaded and registered component 'AuxiliaryActions'
2025-09-17 08:40:51,913 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('CaseActions' )>, <CaseActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,913 INFO [component_loader] [MainThread] Loaded and registered component 'CaseActions'
2025-09-17 08:40:51,914 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('DEVActions' )>, <DEVActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,914 INFO [component_loader] [MainThread] Loaded and registered component 'DEVActions'
2025-09-17 08:40:51,914 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('GeneralActions' )>, <GeneralActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,914 INFO [component_loader] [MainThread] Loaded and registered component 'GeneralActions'
2025-09-17 08:40:51,914 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('IncidentActions' )>, <IncidentActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,915 INFO [component_loader] [MainThread] Loaded and registered component 'IncidentActions'
2025-09-17 08:40:51,915 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('LocalMarketActions' )>, <LocalMarketActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,915 INFO [component_loader] [MainThread] Loaded and registered component 'LocalMarketActions'
2025-09-17 08:40:51,915 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('ShiftlogActions' )>, <ShiftlogActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,915 INFO [component_loader] [MainThread] Loaded and registered component 'ShiftlogActions'
2025-09-17 08:40:51,915 DEBUG [debugger] [MainThread] <load_complete[loader] (<load[loader] ('ThreatActions' )>, <ThreatActions/actions.im_actions 8:MainThread (queued=0) [S]> )>
2025-09-17 08:40:51,916 INFO [component_loader] [MainThread] Loaded and registered component 'ThreatActions'
2025-09-17 08:40:51,916 DEBUG [debugger] [MainThread] <Connect[*] ()>
2025-09-17 08:40:51,916 INFO [stomp_component] [MainThread] Connect to STOMP...
2025-09-17 08:40:51,916 DEBUG [transport] [MainThread] attempt reconnection (True, None, 0)
2025-09-17 08:40:51,916 DEBUG [transport] [MainThread] attempting connection to host hostname, port 65001
2025-09-17 08:40:51,918 DEBUG [transport] [MainThread] keepalive: autodetected linux-style support
2025-09-17 08:40:51,918 DEBUG [transport] [MainThread] keepalive: activating linux-style support
2025-09-17 08:40:51,918 DEBUG [transport] [MainThread] keepalive: using system defaults
2025-09-17 08:40:51,919 DEBUG [transport] [MainThread] keepalive: set 'enable' option to '1' on socket
2025-09-17 08:40:51,919 DEBUG [transport] [MainThread] wrapping SSL socket
2025-09-17 08:40:51,965 INFO [transport] [MainThread] established connection to host hostname, port 65001
2025-09-17 08:40:51,965 DEBUG [transport] [Thread-29] starting receiver loop (<Thread(Thread-29, started daemon 139633279104768)>)
2025-09-17 08:40:51,966 DEBUG [transport] [MainThread] created thread <Thread(Thread-29, started daemon 139633279104768)> using func <function default_create_thread at 0x7eff52b544c0>
2025-09-17 08:40:51,966 DEBUG [stomp_component] [MainThread] STOMP connecting to '('hostname', 65001)'
2025-09-17 08:40:52,052 DEBUG [transport] [Thread-29] received frame: 'CONNECTED', headers="{'server': 'ActiveMQ/5.18.7', 'heart-beat': '15000,0', 'session': '***', 'version': '1.2'}", body=''
2025-09-17 08:40:52,052 DEBUG [stomp_component] [Thread-29] STOMP connected!
2025-09-17 08:40:52,052 INFO [stomp_component] [MainThread] Connected to STOMP at [('hostname', 65001)]
2025-09-17 08:40:52,053 DEBUG [listener] [Thread-29] heartbeats calculated (0, 15000)
2025-09-17 08:40:52,053 DEBUG [debugger] [MainThread] <disconnect[web] (<socket.socket [closed] fd=-1, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0> )>
2025-09-17 08:40:52,054 DEBUG [listener] [Thread-29] set receive_sleep to 30.0, send_sleep to 0.0
2025-09-17 08:40:52,054 DEBUG [debugger] [MainThread] <closed[web] ( )>
2025-09-17 08:40:52,054 DEBUG [listener] [Thread-30] starting heartbeat loop
2025-09-17 08:40:52,055 DEBUG [debugger] [MainThread] <load_all_success[loader] ( )>
............................
2025-09-17 08:40:52,062 DEBUG [debugger] [MainThread] <Connected[stomp] ()>
2025-09-17 08:40:52,062 INFO [actions_component] [MainThread] STOMP connected.
2025-09-17 08:40:52,063 DEBUG [debugger] [MainThread] <Connect_success[*] (<Connect[*] ()>, 'success' )>
2025-09-17 08:40:52,063 DEBUG [actions_component] [MainThread] Connected successfully. Resubscribe? False
2025-09-17 08:40:52,063 INFO [actions_component] [MainThread] resilient-circuits has started successfully and is now running...
2025-09-17 08:40:52,063 INFO [actions_component] [MainThread] Subscribing to message destination 'im_actions'
2025-09-17 08:40:52,064 DEBUG [debugger] [MainThread] <Connected_success[stomp] (<Connected[stomp] ()>, None )>
2025-09-17 08:40:52,064 DEBUG [debugger] [MainThread] <Subscribe[*] ()>
2025-09-17 08:40:52,064 DEBUG [transport] [MainThread] sending frame: [b'SUBSCRIBE', b'\n', b'ack:client-individual\n', b'activemq.prefetchSize:25\n', b'destination:actions.201.im_actions\n', b'id:actions.201.im_actions\n', b'\n', b'\x00']
2025-09-17 08:40:52,064 INFO [stomp_component] [MainThread] Subscribed to message destination actions.201.im_actions
2025-09-17 08:40:52,065 DEBUG [debugger] [MainThread] <Subscribe_success[*] (<Subscribe[*] ()>, None )>
2025-09-17 08:40:52,065 DEBUG [_api] [MainThread] Attempting to release lock 139635066342224 on /opt/app-root/src/.resilient/resilient_circuits_lockfile
2025-09-17 08:40:52,065 DEBUG [_api] [MainThread] Lock 139635066342224 released on /opt/app-root/src/.resilient/resilient_circuits_lockfile
/etc/rescircuits/app.config: OK

Could anyone help please?

Thanks,

A

Juan Paulo's profile image
Juan Paulo

Hi, not exactly why you're getting the error, from what I see the "Address already in use", I would think that the port on which the app it's listeing it's already used by another process at the OS level. You should try to identify the process that it's using the port, with something like the netstat command below.

sudo netstat -anop|grep 22
tcp6       0      0 :::22                   :::*                    LISTEN      1/init               off (0.00/0/0)
tcp6       0      0 192.168.100.105:22      192.168.52.254:58454    ESTABLISHED 1/init               keepalive (6562.16/0/0)

Are you running this within an Apphost? If it was running within the Apphost what I might happened it's that the dying pod for any reason didn't release the port (was on closing)... and the new pod (the starting one) find the port used. What you need to make sure it's that the port it's not in use when trying to start the app. If for any reason you can't be sure of that, somethings by rebooting the Apphost it may resolve the issue. 

hope it does help.