Cognos Analytics

Cognos Analytics

Connect, learn, and share with thousands of IBM Cognos Analytics users! 

 View Only
Back to discussions
Expand all | Collapse all

Jupyter Windows 10 Analytics 11.1.5

  • 1.  Jupyter Windows 10 Analytics 11.1.5

    Posted 02/11/20 06:02 AM
    OK IBM's documentation on this is VERY POOR! at best, all the videos are for Linux, What every document I have come across, the install.bat should do everything.  Docker is installed and running, I am logged in, when your right click.   Any help on why this is happening would be greatly appreciated.



    C:\Program Files\ibm\cognos\jupyter\dist\scripts\windows>install.bat
    'Installing Jupyter Server'
    'Removing any previous *_original:installed images'
    Removing older ca_jupyter_server_instance_original:installed
    Removing older ca_jupyter_hub_original:installed
    Removing older ca_jupyter_viewer_original:installed
    'Building CA Jupyter Server'
    "Building Hub"
    Loading hub image
    unsupported os linux
    "=
    Tagging as 'installed'
    base image is "=
    "docker tag" requires exactly 2 arguments.
    See 'docker tag --help'.

    Usage: docker tag SOURCE_IMAGE[:TAG] TARGET_IMAGE[:TAG]

    Create a tag TARGET_IMAGE that refers to SOURCE_IMAGE
    "Building docker image for hub
    CLIENT_TAG 2020-02-11_10-36-44
    Sending build context to Docker daemon 50.69kB
    Step 1/15 : FROM ca_jupyter_hub_original:installed
    pull access denied for ca_jupyter_hub_original, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
    Error response from daemon: No such image: ca_jupyter_hub:2020-02-11_10-36-44
    Building Server
    Loading server_instance image

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    #CognosAnalyticswithWatson


  • 2.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/12/20 10:12 AM

    Hi Kurt, 

    Our apologies for the lack of support in our documentation. I'd just like to confirm a few things with you:

    1) Are you using Docker Desktop on windows 10? It's currently the only supported docker distribution for the jupyter server on windows 10. Judging from the error message you got "unsupported os linux", perhaps there's a different docker distribution installed on your machine?

    2) One requirement for linux containers on windows is that Hyper-V is enabled in windows 10. I'll post the verification steps below:

    1. Open the Control Panel.
    2. Click Programs.
    3. Click Turn Windows Features on or off.
    4. Find and expand the Hyper-V option.
    5. Ensure that the Hyper-V Platform is checked.

    I'll test out the latest version of docker desktop for windows 10 to make sure nothing was broken in their most recent version. Will get back to you!

    Regards,
    Rob

    ------------------------------
    ROBERT MCAULEY
    ------------------------------



  • 3.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/12/20 10:33 AM
    I  can confirm it is the latest of docker, it Docker Desktop, and it even said there was an update available this morning.  The machine is/was a clean VM machine that I requested for testing.  Hyper-V and Hyper V platform are checked.  I full administrator rights the machine, and I have even tried it with Symantec disabled. Docker starts fine, I right click on the little icon and logon with my docker id and password.  I have tried so many  different things.

    This machine does NOT have Analytics 11.1.5  on it, as obviously most people would run Windows 10, but documentation says that is ok too...

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 4.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/12/20 10:25 AM
    One thing that came to mind is that Docker Desktop is instructed to use Windows containers. The jupyter server
    requires that docker use linux containers.

    If you right click on the docker icon on the bottom right corner, there should be an option for switching to linux containers.
    You can also re-install docker desktop, and just make sure not to check the option "use windows containers instead of linux containers".

    Let me know if that helps (this gotcha definitely warrants a place in our documentation).

    Regards,
    Rob


    ------------------------------
    ROBERT MCAULEY
    ------------------------------



  • 5.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/12/20 10:56 AM
    That might have been a big GOTCHA.... switched to Unix Containers, and  almost works.   Guessing the below as this is not where 11.1.5 is installed and 
    IIS or Liberty is not running on this machine.

    Cheers,

    Kurt

    Successfully tagged ca_jupyter_viewer:2020-02-12_15-52-13
    SECURITY WARNING: You are building a Docker image from Windows against a non-Windows Docker host. All files and directories added to build context will have '-rwxr-xr-x' permissions. It is recommended to double check and reset permissions for sensitive files and directories.
    Starting CA Jupyter server
    Starting CA Jupyter Docker containers
    HOST_NAME is not set in config.conf. Aborting.


    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 6.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/12/20 11:28 AM
    That looks great!

    You would just need to open dist/scripts/windows/config.conf and set the fully qualified name of your windows machine there.
    This URL is going to tell the browser how to reach your jupyter server on windows 10 (needed for the python kernel connection).

    Will look into updating our documentation - thank you for the feedback Kurt, it's much appreciated.

    Regards,
    Rob

    ------------------------------
    ROBERT MCAULEY
    ------------------------------

    Original Message


  • 7.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/13/20 06:03 AM
    That was part of the question, since Analytics 11.1.5 is not on the same box, this Win 10 box does not have IIS or websever set up on it, as the link in the environment settings needs to point to http://  is that more missing documentation?

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 8.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/13/20 08:00 AM
    Right, so if I understand your question correctly, the variable HOST_NAME within config.conf should not include the protocol by which the browser
    communicates with your windows 10 jupyter server. It should just be the name of that box since the installation script will prepend the appropriate protocol (it will actually be WS/WSS instead of HTTP/HTTPS). 

    You won't be needing IIS or webserver on this box. The docker container ca_jupyter_hub is listening on port 8000 by default. Not sure if I've properly answered your question.

    Regards,
    Rob


    ------------------------------
    ROBERT MCAULEY
    ------------------------------

    Original Message


  • 9.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/13/20 09:02 AM
    I did think of that and have tried: ws://AZEWSEV000118:8000   port 8000 is listening, The jupyter box is pingable from the analytics server.  But the best I get is a spinning blue circle when I say new Notebook, and sadly nothing is the cogserver.log file give me any idea what it is doing.  Right  it has been spinning for 1 hour, and not even timed out.  I have also restarted analytic services, and stopped and started the jupyter service.

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 10.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/13/20 09:22 AM
    You may have already done this, but from the Cognos homepage under manage -> configuration -> system -> environment, can you verify that the jupyter service location is set to http://azewsev000118:8000? This is the URL that the analytics server will attempt to reach when creating a new notebook. If this is properly set and you still get that endless spinner, we should take a look at the docker logs on your windows box. To get the logs, you would need to run the command "docker logs ca_jupyter_hub", where ca_jupyter_hub is the name of the docker container. Let me know what you find. 

    ps: You won't need to restart the analytics service after updating the jupyter service location in the manage panel

    ------------------------------
    ROBERT MCAULEY
    ------------------------------

    Original Message


  • 11.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/13/20 10:05 AM
    Getting not able to communicate with the Cognos Analytics server.open...external application dispatcher URI.

    Logs show this:   (MaxRetryError("HTTPConnectionPool(host='win000176', port=9300): Max retries exceeded with url: /bi/v1/me (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f26fbb6e7f0>: Failed to establish a new connection: [Errno -5] No address associated with hostname',))",),)

    W 2020-02-13 14:45:02.599 JupyterHub web:1680] 500 GET /bi/v1/jupyter/hub/notebooks/new?kernel_name=python3 (::ffff:172.18.0.1): host
    [E 2020-02-13 14:45:02.601 JupyterHub log:150] {
    "X-Forwarded-Host": "AZEWSEV000118:8000",
    "X-Forwarded-Proto": "http",
    "X-Forwarded-Port": "8000",
    "X-Forwarded-For": "::ffff:172.18.0.1",
    "Via": "1.1 localhost (Apache-HttpClient/4.5.3 (cache))",
    "Connection": "close",
    "Host": "AZEWSEV000118:8000",
    "User-Agent": "Mozilla/5.0 (Windows NT 10.0; WOW64; Trident/7.0; rv:11.0) like Gecko",
    "Accept-Encoding": "gzip, deflate, peerdist",
    "X-Ca-Server": "http://win000176:9300",
    "X-Ca-Proxy": "1",
    "Content-Type": "application/octet-stream",
    "X-Ca-Gateway": "http://win000176:80",
    "X-Xsrf-Token": "QViOSn1DWpSY9VDp9CmdwoEwhU5EWcay",
    "X-Bi-Forwarded-For": "bi-proxy",
    "X-Ca-Transaction": "rootId=sGGM929wC9q2d4sjqGvvswwM42G4yGMwjd2v8942, parentId=, currentId=sGGM929wC9q2d4sjqGvvswwM42G4yGMwjd2v8942",
    "X-P2p-Peerdistex": "MinContentInformation=1.0, MaxContentInformation=1.0",
    "X-Ca-Sdkserver": "http://win000176:9300",
    "Original-Host": "win000176",
    "Accept": "text/html, application/xhtml+xml, image/jxr, */*",
    "X-P2p-Peerdist": "Version=1.1",
    "Original-Server_port": "9300",
    "X-Webcontentroot": "",
    "Accept-Language": "en-GB",
    "Cookie": "CRN=automaticPageRefresh%3D30%26columnsPerPage%3D3%26listViewSe

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 12.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/13/20 10:23 AM
    Thanks for the logs Kurt. This looks like the jupyter server is attempting to reach the analytics server at "win000176:9300". I was wondering if that is the correct host/port for reaching the analytics server? If not, it can be configured in the Cognos Configuration tool, under environment -> Dispatcher URI for external applications. Unfortunately once you modify this value, you would need to restart the analytics service.

    There's a way you can debug the connectivity from the jupyter server docker container to your analytics box. I'll post the steps below.

    1) docker exec -it -u 0 ca_jupyter_hub bash (this will let you enter the docker container)
    2) apt-get update && apt-get install iputils-ping (this will install the ping tool in that docker container)
    3) ping <your analytics host> (hopefully it can be reached)

    To exit the container, type "exit" and hit enter.

    If none of this works, there may be a DNS issue in resolving your analytics host. We'll cross that bridge if we get to it.

    Hope that helps,
    Rob

    ------------------------------
    ROBERT MCAULEY
    ------------------------------

    Original Message


  • 13.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/13/20 10:52 AM
    ok so  used winpty and your command
    I could not ping win000176, however I could ping its ip address of 10.38.22.39 I stopped and started the Cognos service with the ip instead of name, Analytics still works, but still same message of not being able to connect.

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 14.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/14/20 11:21 AM

    Kurt,

    I know this is a basic comment but did you set up authorization for Notebooks.  I had trouble getting the analytics server to communicate with Jupyter and finally found I hadn't set the permissions for Notebook correctly.  Once I changed that it connected.

    Just a thought

     

    Scott

     

    Bar chart

    Scott Taylor

    Cognos Administrator | Senior BI Analyst | ext. 4332

     



    ------Original Message------

    ok so  used winpty and your command
    I could not ping win000176, however I could ping its ip address of 10.38.22.39 I stopped and started the Cognos service with the ip instead of name, Analytics still works, but still same message of not being able to connect.

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    #CognosAnalyticswithWatson


  • 15.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/31/20 06:46 AM
    Hi Scott, where do I configure this?

    /Martin

    ------------------------------
    Martin
    ------------------------------

    Original Message


  • 16.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 04/01/20 08:55 PM
    Martin,
    Under Manage / People / Capabilities / Notebook click on properties then the access tab.  Here you set the permissions for the users that have notebook authority.  Originally the access was only 'Access' but I changed to 'Manage' so the users could write and run notebook scripts.
    Hope this helps.
    Scott

    ------------------------------
    Scott
    Cognos Administrator
    Wenatchee WA
    ------------------------------

    Original Message


  • 17.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/13/20 10:20 AM
    found this in the cogserver.log file:  2020-02-13T15:14:01.767+0000 ERROR com.ibm.bi.platform.commons.web.BIResponseWrapper [Default Executor-thread-213] qylyMd8d9lyl4Cjdqw4Cdvq4wM24hdh4dwq4M84h qylyMd8d9lyl4Cjdqw4Cdvq4wM24hdh4dwq4M84h NA 10.33.68.135 57626 LoginUser-953366295 AggAAAAEok5eAAAAAAoAAACxYciKk0j4GT/6FAAAAFTHdgspBHtAMHLJ73Fp0AZWK4nWBwAAAFNIQS0yNTYgAAAATQ7VjyPvwEqy+mts/1AaJjD+mdYpGL7/KpXhArWqlzY= /v1/jupyter/hub/notebooks/new bi-service 8364 HttpServletResponseCode for /bi/v1/jupyter/hub/notebooks/new is in error: 500

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 18.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/14/20 09:54 AM
    Hi Robert,
        Update for you, finally got them to talk to each other, but I can't use the name of the Server, I have  to put the IP address in the Dispatcher for External ….. It took some start/stops/builds /restart/Cognos refresh the setting in systems environ.  The only the I can come up with that might be a cause is the machines are on different gateway servers, which would be strange, since I could ping either machine.  
       Thanks for you help!  

    Cheers,

    Kurt

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 19.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/14/20 12:21 PM

    Hi Kurt,

    Let's try an experiment to see where the DNS issue is. Can you try the following:

    1) On your jupyter box, try pinging your Cognos box by hostname (hopefully this works)
    2) On your jupyter box, enter the jupyter docker container (docker exec -it -u 0 ca_jupyter_hub bash) and try pinging your Cognos box by hostname (I assume this will fail)
    3) On your jupyter box, enter the jupyter docker container, and try pinging any public domain (Hopefully this works)

    If 1 fails, it's most likely a networking problem between your two boxes (could be related to the different gateway servers)
    If 2 fails but 1 & 3 passes, the DNS server in your jupyter box isn't being used by the docker container, and it's defaulting to google's DNS server (8.8.8.8)
    If 2 & 3 fails, but 1 passes, it looks like DNS isn't working at all within the docker container.

    Let me know what comes from this experiment. Unfortunately these Docker DNS issues aren't always easy to diagnose. Once we get a clear picture of where it's failing, we can look into a solution together.

    Regards,
    Rob



    ------------------------------
    ROBERT MCAULEY
    ------------------------------

    Original Message


  • 20.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/17/20 06:29 AM
    Hi Rob,
       I don't see my previous post so will say that again... 2 fails and 1 & 3 work.  Also, noticed this on Friday, when I log off the machine, docker shuts down and is not available.  Kind of strange, good thing CA does not do that...

    Cheers,

    Kurt​​

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 21.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/18/20 02:57 PM
    Hey Kurt,

    For the DNS issue, I don't suppose you have an internal DNS server in your organization, do you?
    If so, there's a way in Docker Desktop for you to configure it.

    If you right-click the docker icon on the bottom right corner -> Settings -> Daemon and switch the toggle button from "basic" to "advanced", you should be able to add the DNS server. My config now looks like:

    {
    "registry-mirrors": [],
    "insecure-registries": [],
    "debug": true,
    "experimental": false,
    "dns": ["8.8.8.8", "<custom DNS server IP here>"]
    }

    Docker should restart after you save that config. You may need to run the `start.bat` script to launch the notebook server again, although it should come back up on its own once Docker restarts.

    For the Docker shutting down problem, I personally haven't experienced it before, but I'll run some tests on my own Windows 10 machine and get back to you. 

    Regards,
    Rob

    ------------------------------
    ROBERT MCAULEY
    ------------------------------

    Original Message


  • 22.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/25/20 09:20 AM
      |   view attached
    I have attached a file, out of the blue it stopped working, 3 different browsers, 3 different errors... kernel starts and dies..

    I did a complete uninstall of jupyter as well as docker, same exact thing....not sure this product was ready  to go to market.

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Attachment(s)

    txt
    Jupyter Server Logs.txt   21 KB 1 version
    Original Message


  • 23.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/25/20 03:04 PM

    Looking at the logs, it appears to be CORS related:

    "Blocking Cross Origin WebSocket Attempt. Origin: http://win000176:9300"

    It's definitely odd that it would stop working all of a sudden... would you mind checking the variable "Gateway URI" in your cognos configuration? This is what is compared to the browser's Origin header for added security.

    For example, if you navigate to "http://win000176:9300" to reach Cognos, but the Gateway URI parameter is set to something different, a cross-origin error will occur. We just need to make sure the Gateway URI matches "http://win000176:9300". Hope that helps.



    ------------------------------
    ROBERT MCAULEY
    ------------------------------

    Original Message


  • 24.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/26/20 08:10 AM
    Other problem resolved, still Kernal Dead...this is the log excerpt also if you look at the bottom in bold, it is from an earlier session that timed out, and it appears to have thought it was still running....

    12:24:22.525 - info: [ConfigProxy] 200 GET /api/routes
    [I 2020-02-26 12:24:22.526 JupyterHub proxy:301] Checking routes
    12:29:22.525 - info: [ConfigProxy] 200 GET /api/routes
    [I 2020-02-26 12:29:22.526 JupyterHub proxy:301] Checking routes
    12:34:22.525 - info: [ConfigProxy] 200 GET /api/routes
    [I 2020-02-26 12:34:22.526 JupyterHub proxy:301] Checking routes
    12:39:22.525 - info: [ConfigProxy] 200 GET /api/routes
    [I 2020-02-26 12:39:22.526 JupyterHub proxy:301] Checking routes
    12:44:22.525 - info: [ConfigProxy] 200 GET /api/routes
    [I 2020-02-26 12:44:22.526 JupyterHub proxy:301] Checking routes
    12:49:22.525 - info: [ConfigProxy] 200 GET /api/routes
    [I 2020-02-26 12:49:22.525 JupyterHub proxy:301] Checking routes
    [I 2020-02-26 12:51:24.284 JupyterHub log:158] 302 GET /bi/v1/jupyter/notebooks/new?kernel_name=python3 -> /bi/v1/jupyter/hub/notebooks/new?kernel_name=python3 (@::ffff:172.18.0.1) 1.23ms
    [I 2020-02-26 12:51:24.468 JupyterHub log:158] 302 GET /bi/v1/jupyter/hub/notebooks/new?kernel_name=python3 -> /bi/v1/jupyter/hub/login?next=/bi/v1/jupyter/hub/notebooks/new?kernel_name=python3 (@::ffff:172.18.0.1) 116.38ms
    [I 2020-02-26 12:51:24.556 JupyterHub log:158] 302 GET /bi/v1/jupyter/hub/login?next=/bi/v1/jupyter/hub/notebooks/new?kernel_name=python3 -> /bi/v1/jupyter/hub/ibmcalogin?next=%2Fbi%2Fv1%2Fjupyter%2Fhub%2Fnotebooks%2Fnew%3Fkernel_name%3Dpython3 (@::ffff:172.18.0.1) 1.40ms
    [W 2020-02-26 12:51:24.827 JupyterHub base:311] Invalid cookie token
    [I 2020-02-26 12:51:24.831 JupyterHub log:158] 302 GET /bi/v1/jupyter/hub/ibmcalogin?next=%2Fbi%2Fv1%2Fjupyter%2Fhub%2Fnotebooks%2Fnew%3Fkernel_name%3Dpython3 -> /bi/v1/jupyter/hub/notebooks/new?kernel_name=python3 (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 198.41ms
    [I 2020-02-26 12:51:25.034 JupyterHub log:158] 302 GET /bi/v1/jupyter/hub/notebooks/new?kernel_name=python3 -> /bi/v1/jupyter/hub/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/caload/notebooks/new?kernel_name=python3&trust=jupyter (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 117.56ms
    [I 2020-02-26 12:51:25.269 JupyterHub dockerspawner:452] Container 'ca_jupyter-xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw' is gone
    [I 2020-02-26 12:51:25.276 JupyterHub spawner:643] Setting env CULL_TIMEOUT to 3600
    [I 2020-02-26 12:51:25.394 JupyterHub dockerspawner:540] Created container 'ca_jupyter-xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw' (id: a47be9d) from image ca_jupyter_server_instance:latest
    [I 2020-02-26 12:51:25.394 JupyterHub dockerspawner:557] Starting container 'ca_jupyter-xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw' (id: a47be9d)
    [I 2020-02-26 12:51:27.677 JupyterHub base:726] User xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw took 2.524 seconds to start
    [I 2020-02-26 12:51:27.678 JupyterHub proxy:242] Adding user xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw to proxy /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/ => http://172.18.0.4:8888
    12:51:27.680 - info: [ConfigProxy] Adding route /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw -> http://172.18.0.4:8888
    12:51:27.681 - info: [ConfigProxy] 201 POST /api/routes/bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw
    [I 2020-02-26 12:51:27.687 JupyterHub log:158] 302 GET /bi/v1/jupyter/hub/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/caload/notebooks/new?kernel_name=python3&trust=jupyter -> /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/caload/notebooks/new?kernel_name=python3&trust=jupyter&redirects=1 (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 2578.06ms
    [I 2020-02-26 12:51:27.693 JupyterHub log:158] 200 GET /bi/v1/jupyter/hub/api (@172.18.0.4) 0.94ms
    [I 2020-02-26 12:51:28.271 JupyterHub log:158] 302 GET /bi/v1/jupyter/hub/api/oauth2/authorize?client_id=jupyterhub-user-xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw&redirect_uri=%2Fbi%2Fv1%2Fjupyter%2Fuser%2FxQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw%2Foauth_callback&response_type=code&state=[secret] -> /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/oauth_callback?code=[secret]&state=[secret] (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 38.63ms
    [I 2020-02-26 12:51:28.489 JupyterHub log:158] 200 POST /bi/v1/jupyter/hub/api/oauth2/token (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@172.18.0.4) 99.93ms
    [I 2020-02-26 12:51:28.593 JupyterHub log:158] 200 GET /bi/v1/jupyter/hub/api/authorizations/token/[secret] (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@172.18.0.4) 58.98ms
    12:54:22.525 - info: [ConfigProxy] 200 GET /api/routes
    [I 2020-02-26 12:54:22.602 JupyterHub proxy:301] Checking routes

    [I 2020-02-26 11:25:50.828 JupyterHub log:158] 307 DELETE /bi/v1/jupyter/shutdown/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw (@172.18.0.4) 1.15ms
    [I 2020-02-26 11:25:50.901 JupyterHub proxy:264] Removing user xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw from proxy (/bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/)
    11:25:50.903 - info: [ConfigProxy] Removing route /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw
    11:25:50.904 - info: [ConfigProxy] 204 DELETE /api/routes/bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw
    [I 2020-02-26 11:25:50.911 JupyterHub dockerspawner:628] Stopping container ca_jupyter-xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw (id: 8df3a54)
    [W 2020-02-26 11:26:00.902 JupyterHub base:892] User xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw: server is slow to stop
    [I 2020-02-26 11:26:00.903 JupyterHub log:158] 200 DELETE /bi/v1/jupyter/hub/shutdown/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw (@172.18.0.4) 10071.31ms
    [I 2020-02-26 11:26:01.811 JupyterHub dockerspawner:634] Removing container ca_jupyter-xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw (id: 8df3a54)
    /opt/conda/lib/python3.6/site-packages/sqlalchemy/orm/persistence.py:1066: SAWarning: DELETE statement on table 'servers' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.





    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 25.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 02/28/20 09:34 AM
    Hey Kurt, sorry for the late reply.

    Those logs seem to be from the cleanup service in the Hub, where containers are removed after a period of inactivity to free up
    resources. You're right that the service thought the container was still running when it was not, and that's definitely something I'll
    report to the team - however I don't think it relates to the kernel problem you encountered, unfortunately.

    I'm wondering if something in the network changed. The kernel relies on the HOST_NAME variable within "<jupyter install dir>/dist/scripts/windows/config.conf" to be the fully qualified domain name (or IP) of your jupyter windows machine in order to communicate with it. If you could, please verify that it's still correct.

    I'd be interested in looking at the logs from the previous container (the one that had the CORS error). If you can, open a new notebook (even though the kernel may die), and retrieve the logs from the newly spawned docker container (not the ca_jupyter_hub or ca_jupyter_viewer). The kernel logs should be present in that container.

    Sorry for your troubles. Hopefully we can get to the bottom of this soon.

    ------------------------------
    ROBERT MCAULEY
    ------------------------------

    Original Message


  • 26.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/02/20 07:47 AM
      |   view attached
    Hi Robert Log attached.

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Attachment(s)

    txt
    CA Juypter latest log.txt   5 KB 1 version
    Original Message


  • 27.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/06/20 10:00 AM
    Edited by System Admin 01/20/23 04:11 PM
      |   view attached
    Hi Robert,
         I poked and prodded the actual VM unix image looking for some of the things you find on google, but no luck find them out there, 
    ls -lisaI tried used VI to modify jupyterhub_confg.py and add some code I found.  Saved it used cat to look at it, the code was there, however when stop/started the service, I though well guess the code was bad, as it did not work, and so checked and it appears that file gets overwritten during a start.

    Have duplicated the 6 DNS servers that Analytics box has on it, over on the Jupyter box, and vice versa, all is now hard coded with IP address everywhere.

    I did a fresh install of e everything today. still no luck.

    Any thoughts?

    Cheers,

    Kurt


    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Attachment(s)

    txt
    06MAR20 Jupyter Log.txt   5 KB 1 version
    Original Message


  • 28.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/06/20 10:45 AM
    Hey Kurt,

    Yeah unfortunately modifying files within the docker container won't persist when you restart the server, because the containers are wiped away and the images are used. You could modify the Dockerfiles within the install directory and create customized images, but that's a lot of work and I personally don't think they will solve the kernel disconnection problem.

    Looking at the logs I again see the CORS error:

    [W 2020-03-06 12:33:59.805 SingleUserNotebookApp handlers:480] Blocking Cross Origin API request for 
/bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/api/sessions.  Origin: http://win000176:9300, 
Host: 10.119.20.64:8000

    One question: how are you accessing Cognos in the browser? Are you using its hostname or its IP address? From the logs it looks like you're using win000176:9300, but I'm willing to bet that if you use Cognos's IP address the CORS problem will be resolved.

    I'm also assuming the Gateway URI parameter in your Cognos config is using the IP address? The Gateway URI parameter really needs to match what you enter in the browser when connecting to Cognos to avoid the CORS security error.

    Regards,
    Rob

    ------------------------------
    ROBERT MCAULEY
    ------------------------------

    Original Message


  • 29.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/09/20 10:38 AM


    Hi Robert,
      I am just at a total loss on this.... everything is using ip4 address, all point to same DNS. it is starting the kernel, but then it dies, and each time you restart, it dies again.  I have all antivirus off also.  Does anyone actually have this up and running in a production environment? I can't imagine this as anything viable, especially since it uses Windows 10 and not Windows server.


    [I 2020-03-09 13:36:09.455 SingleUserNotebookApp log:158] 200 GET /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/api/config/notebook?_=1583760969303 (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 7.41ms
    [I 2020-03-09 13:36:09.493 SingleUserNotebookApp log:158] 200 GET /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/api/config/common?_=1583760969304 (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 7.45ms
    [I 2020-03-09 13:36:09.575 SingleUserNotebookApp log:158] 200 GET /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/api/contents/new?type=notebook&_=1583760969305 (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 6.76ms
    [I 2020-03-09 13:36:09.782 SingleUserNotebookApp log:158] 200 GET /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/api/contents/new7/checkpoints?_=1583760969306 (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 1.74ms
    [I 2020-03-09 13:36:09.839 SingleUserNotebookApp kernelmanager:164] Kernel started: bb8bb0bd-b02a-4496-be13-f18b0c239050
    [I 2020-03-09 13:36:09.845 SingleUserNotebookApp log:158] 201 POST /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/api/sessions (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 30.17ms
    [I 2020-03-09 13:36:10.995 SingleUserNotebookApp handlers:190] Adapting to protocol v5.1 for kernel bb8bb0bd-b02a-4496-be13-f18b0c239050
    [W 2020-03-09 13:36:10.997 SingleUserNotebookApp zmqhandlers:151] Blocking Cross Origin WebSocket Attempt. Origin: http://10.38.22.39:9300, Host: 10.119.20.64:8000
    [W 2020-03-09 13:36:10.998 SingleUserNotebookApp log:158] 403 GET /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/api/kernels/bb8bb0bd-b02a-4496-be13-f18b0c239050/channels?session_id=64691cfd143a42068527155b5d93541b (@::ffff:172.18.0.1) 907.40ms
    [W 2020-03-09 13:36:12.161 SingleUserNotebookApp handlers:254] Replacing stale connection: bb8bb0bd-b02a-4496-be13-f18b0c239050:64691cfd143a42068527155b5d93541b
    [I 2020-03-09 13:37:08.421 SingleUserNotebookApp multikernelmanager:198] Kernel restarted: bb8bb0bd-b02a-4496-be13-f18b0c239050
    [I 2020-03-09 13:37:09.401 SingleUserNotebookApp log:158] 200 POST /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/api/kernels/bb8bb0bd-b02a-4496-be13-f18b0c239050/restart (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 1291.33ms
    [W 2020-03-09 13:37:09.550 SingleUserNotebookApp handlers:254] Replacing stale connection: bb8bb0bd-b02a-4496-be13-f18b0c239050:64691cfd143a42068527155b5d93541b
    [I 2020-03-09 13:37:52.741 SingleUserNotebookApp multikernelmanager:198] Kernel restarted: bb8bb0bd-b02a-4496-be13-f18b0c239050
    [I 2020-03-09 13:37:53.769 SingleUserNotebookApp log:158] 200 POST /bi/v1/jupyter/user/xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw/api/kernels/bb8bb0bd-b02a-4496-be13-f18b0c239050/restart (xQWVnb25VSzp1Ojc4YmJlZjRjOTljZWE2NDBiNGIwODcxYzM0Y2FiOWUw@::ffff:172.18.0.1) 1439.96ms
    [W 2020-03-09 13:37:53.921 SingleUserNotebookApp handlers:254] Replacing stale connection: bb8bb0bd-b02a-4496-be13-f18b0c239050:64691cfd143a42068527155b5d93541b

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 30.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/31/20 04:35 AM

    Have you found a solution to this? I'm experiencing the same problem, but im stuck at this stage:

    requests.exceptions.ConnectionError: HTTPConnectionPool(host='naxarkn132', port=9300): Max retries exceeded with url: /bi/v1/me (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f1ab72c7c50>: Failed to establish a new connection: [Errno -5] No address associated with hostname',))

    /Martin



    ------------------------------
    Martin
    ------------------------------

    Original Message


  • 31.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/31/20 06:59 AM
    Hi Kurt, sorry for posting twice, but I cant figure out where to find private messages.

    As hostname I use my compugers name(the name i got when typing "hostname" in cmd) HOST_NAME=XPS13-6RMD5S4
    Is this not correct? If not, how do I find the correct host name?

    /Martin

    ------------------------------
    Martin
    ------------------------------

    Original Message


  • 32.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/09/20 11:18 AM
    Hi Robert,
        What can you tell me about this, 1st time I actually found it:  Configure Docker in Windows
    Microsoft remove preview
    Configure Docker in Windows
    The Docker Engine and client aren't included with Windows and need to be installed and configured individually. Furthermore, the Docker Engine can accept many custom configurations. Some examples include configuring how the daemon accepts incoming requests, default networking options, and debug/log settings.
    View this on Microsoft >



    IBM makes no mention of it, and nor the install.



    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 33.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/02/20 06:39 AM
    win000176 is a stand alone VM test server.

    ------------------------------
    Kurt Blevins
    Aegon UK
    ------------------------------

    Original Message


  • 34.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 03/09/20 11:49 AM
    Right  it has been spinning for 1 hour, and not even timed out.

    ------------------------------
    Salt Alüminyum
    Salt Alüminyum
    ------------------------------

    Original Message


  • 35.  RE: Jupyter Windows 10 Analytics 11.1.5

    Posted 06/30/21 10:13 AM
    now win 11 has been released... and every time win update is painful to find the most suitable compatible software.

    ------------------------------
    keo nha cai 365
    ------------------------------



Related Content