Agent and Sensors

 View Only
  • 1.  InstanaAgent Node.js collector issue

    Posted Thu February 09, 2023 02:08 PM
      |   view attached

    Hi,

    I have installed the quote of the day application on the AWS EKS cluster using the node port deployment along with nginx. To monitor this I have installed the Instana agent on EKS with APM mode enabled. I can see all the infra metrics for Kubernetes like pods, nodes, services, namespace and deployments, etc. i followed all the steps as mentioned in official documentation. 

    But in the Application, i can only see the single node which is the cluster node. I can`t see all the calls and dependency services. The agents encountered with the below errors. 

    I followed all the steps as mentioned in the troubleshooting docs and installed the instana-autotrace-webhook and github-instana-autotrace-webhook  still i have the same error in agnets. 

    2023-02-09T17:31:09.429+00:00 | ERROR | instana-http-client-thread--5-4  | LoggerEndpoint   | com.instana.agent - 1.1.674 | Node.js collector (pid: 1, reporting pid: 26755): Failed to send data to agent via POST /com.instana.plugin.nodejs/profiles.26755. Got status code 404. Error: Failed to send data to agent via POST /com.instana.plugin.nodejs/profiles.26755. Got status code 404.
        at ClientRequest.<anonymous> (/opt/server/node_modules/@instana/collector/src/agentConnection.js:373:35)
        at Object.onceWrapper (events.js:520:26)
        at ClientRequest.emit (events.js:400:28)
        at HTTPParser.parserOnIncomingClient [as onIncoming] (_http_client.js:647:27)
        at HTTPParser.parserOnHeadersComplete (_http_common.js:126:17)
        at HTTPParser.execute (<anonymous>)
        at Socket.socketOnData (_http_client.js:515:22)
        at Socket.emit (events.js:400:28)
        at addChunk (internal/streams/readable.js:290:12)
        at readableAddChunk (internal/streams/readable.js:265:9)
    2023-02-09T17:31:09.429+00:00 | ERROR | instana-http-client-thread--5-3  | LoggerEndpoint   | com.instana.agent - 1.1.674 | Node.js collector (pid: 1, reporting pid: 26755): Error sending profiles to the host agent, backing off next upload
    2023-02-09T17:31:09.429+00:00 | WARN  | instana-http-client-thread--5-2  | LoggerEndpoint   | com.instana.agent - 1.1.674 | Node.js collector (pid: 1, reporting pid: 26755): You have enabled autoProfiling but the Instana agent this process reports to does not yet support autoProfiling for Node.js. Please update the Instana agent. (Node.js Sensor 1.2.14 or newer is required.)
    2023-02-09T17:31:09.435+00:00 | ERROR | instana-http-client-thread--5-4  | LoggerEndpoint   | com.instana.agent - 1.1.674 | Node.js collector (pid: 1, reporting pid: 26755): Error uploading messages
    2023-02-09T17:31:09.436+00:00 | ERROR | instana-http-client-thread--5-3  | LoggerEndpoint   | com.instana.agent - 1.1.674 | Node.js collector (pid: 1, reporting pid: 26755): Failed to send data to agent via POST /com.instana.plugin.nodejs/profiles.26755. Got status code 404. Error: Failed to send data to agent via POST /com.instana.plugin.nodejs/profiles.26755. Got status code 404.
        at ClientRequest.<anonymous> (/opt/server/node_modules/@instana/collector/src/agentConnection.js:373:35)
        at Object.onceWrapper (events.js:520:26)
        at ClientRequest.emit (events.js:400:28)
        at HTTPParser.parserOnIncomingClient [as onIncoming] (_http_client.js:647:27)
        at HTTPParser.parserOnHeadersComplete (_http_common.js:126:17)
        at HTTPParser.execute (<anonymous>)
        at Socket.socketOnData (_http_client.js:515:22)
        at Socket.emit (events.js:400:28)
        at addChunk (internal/streams/readable.js:290:12)
        at readableAddChunk (internal/streams/readable.js:265:9)

    I also attached the agents logs for reference. 

    Node.js Sensor 1.2.14 or newer is required. We already using the latest instana version and the version on Node.js sensor is 1.2.18.. Not sure why it showing false positive error. 


    Does anyone has face a similar issue. Can you please help here resolve the issue. 

    Attachment(s)

    zip
    agent-logs.zip   12 KB 1 version


  • 2.  RE: InstanaAgent Node.js collector issue

    IBM TechXchange Speaker
    Posted Fri February 10, 2023 07:48 PM
    Edited by Mike Mallo Fri February 10, 2023 07:50 PM

    Edit:Upon reading Diana's response, I would go with what she suggested first!

    Thanks Mayana for posting, one of our engineers recalls seeing 404 errors when the agent is trying to find the PID on the host. His guess was the traffic may be going to the wrong location and not using the downward api. We have a public support knowledge base article here that explains this more and some things to look for, can you try these steps and report back if this clears things up?  https://support.instana.com/hc/en-us/articles/360012602359-Kubernetes-OpenShift



    ------------------------------
    Mike Mallo 
    Instana Technical Head of Product
    IBM Corporation
    mmallo@us.ibm.com
    ------------------------------



  • 3.  RE: InstanaAgent Node.js collector issue

    Posted Fri February 10, 2023 07:49 PM

    Hi Mayana,


    From the sounds of what you wrote about the steps you've made, I think you've made some progress in the right direction!

    First, could you refer to the steps in the following documentation and let me know what happens?   https://www.instana.com/docs/ecosystem/node-js/#nodejs-collector-not-installed 


     Second, let's confirm that "Instana Autotrace Webhook" is working with nodejs on Kubernetes. Could you please refer to the steps in the following documentation and confirm that the verifying works: https://github.com/instana/instana-autotrace-webhook#verify-it-works ? 

    Third, it's common with this error message that perhaps you need to configure the network access by following this documentation: 
    https://www.instana.com/docs/setup_and_manage/host_agent/on/kubernetes/#configure-network-access-for-monitored-applications 

    Please let me know if it helps or if you get more feedback messages!

    Warm regards,

    Diana



    ------------------------------
    Diana Thai
    ------------------------------