Same problem ( and same solution ) here with PAW 2.0.87 on Windows Server 2016 and Mirantis Container Runtime (MCR) 20.10.21 on a virtual server with lots of free RAM and disk space:
All of a sudden creating containers by the PowerShell script ".\scripts\paw.ps1" failed, each time the error messages pointing to other random containers.
followed by an uninstall & re-install of the MCR did not resolve the issue.
But we got a different ( german ) error message:
ERROR: for <container> Cannot start service <container>: hcsshim::CreateComputeSystem <UniqueID>: Nicht gen³gend Systemressourcen, um den angeforderten Dienst auszuf³hren.
for instance:
ERROR: for prism-proxy Cannot start service prism-proxy: hcsshim::CreateComputeSystem 65ec1d682fc51616524e5e49fe96ea9d3e8477f71cb17c03c06573455651dc00: Nicht gen³gend Systemressourcen, um den angeforderten Dienst auszuf³hren.
+ throw "Execution failed with exit code ${LASTEXITCODE}: $ ...
+ CategoryInfo : OperationStopped: (Execution faile...ainers to start:String) [], RuntimeException
+ FullyQualifiedErrorId : Execution failed with exit code 1: start service prism-proxy: hcsshim::CreateComputeSystem
ERROR: for <container> Cannot start service <container>: hcsshim::CreateComputeSystem <UniqueID>: Insufficient system resources exist to complete the requested service.
Original Message:
Sent: Mon March 25, 2024 10:55 AM
From: Jaganathan Chetty Palanisamy
Subject: Planning Analytics workspace is down due to space error on docker/windowsfilter folder
Hi,
The issue is resolved. IBM gave the below steps to resolve the issue.
1. docker rm $(docker ps -a -q)
2. edit regedit
Computer\HKEY_LOCAL_MACHINE\SYSTEM\ControlSet001\Services\NDIS\IfTypes\23
registry name - IfUsedNetLuidIndices
do modify select all values, delete them and type in '01'
save and exit
3. reboot the server
4. check docker engine is running
5. Run ./paw.ps1 to create the containers
------------------------------
Jaganathan Chetty Palanisamy
Original Message:
Sent: Tue March 19, 2024 04:39 PM
From: Jaganathan Chetty Palanisamy
Subject: Planning Analytics workspace is down due to space error on docker/windowsfilter folder
Thanks Walter for your response.
Our Wintel has increased the size of C: by 100 GB (we have 128 GB of free space now in C:) and reboot the server. But still the PAW startup is saying the same message as insufficient resources. Now it does not look like a space issue on C: drive. Docker engine seems to be running fine.
The problem initially started after Wintel team installed some OS patches on the server and rebooted, PAW service did not come up after that. Wintel team has rolled back the installed patches too now but no luck. It looks like there is an antivirus called Crowdstrike running on the box, I am going to have them turned off and try again. If you have the instructions on removing PAW and reinstalling again on windows 2016, could you share it. I am going to try that if turning off the antivirus does not work.
------------------------------
Jaganathan Chetty Palanisamy
Original Message:
Sent: Mon March 18, 2024 04:52 PM
From: Walter Coffen
Subject: Planning Analytics workspace is down due to space error on docker/windowsfilter folder
Jagan.
Make sure your server has been backed up by IT.
Delete or move off of the C:\ drive ipa_workspace_win_2.0.55.1184.zip and /images/images.tar. This will free up more than 24GB. They are only needed if you install, or re-install PAW; they are not needed to run PAW day-to-day. The first file can be re-downloaded from IBM if you delete it, and it contains the second file. If you delete, make sure you empty the server's Recycle bin, otherwise disk space will not free up. You should look for other wasted space such as prior versions of PAW where you might have the old version's zip and tar files. Maybe a ton of log files have accumulated too. Additionally, there is a \scripts\clean.ps1 that should be run in the old/prior PAW folder when a newly upgraded PAW has been installed. Do not run clean.ps1 for the current PAW until a newer PAW is up and validated. If you run this incorrectly, you will likely need the server restored by IT.
Reboot, Docker is probably in a funk after not being able to fully start PAW.
You should probably have a BIG D:\ or E:\ data drive where PAW gets stored, rather than the C:\ drive where Microsoft does all its work. PAW can be told to write to a different drive as the C:\ drive is usually not where IT wants stuff written.
You should upgrade PAW and PA. A lot has happened since 2020.
------------------------------
Walter Coffen
Technology Manager
QueBIT Consulting, LLC
Original Message:
Sent: Mon March 18, 2024 10:28 AM
From: Jaganathan Chetty Palanisamy
Subject: Planning Analytics workspace is down due to space error on docker/windowsfilter folder
Hi,
We are unable to bring up planning analytics workspace service, below is the error message we are seeing for some of the containers when trying to start the PAX service. The space in C: is only 28 GB now, not sure if this is enough to bring up the containers. Could you please suggest any ideas? If cleanup is needed, please send us any instructions for cleaning up the windowsfilter.
Below is the version used.
OS: Windows 2016 server standard
PAW - PAW 2.0.55
TM1 - PA .0.9.2 Local
The same below error is appearing for multiple containers.
ERROR: for paw-ui-api Cannot start service paw-ui-api: hcsshim::CreateComputeSysteme9c70c78d5a440a06be3d62b22e8595e9b2fe75150975786e53dbfa62f65f4e2: Insufficient system resources exist to complete the requested service.
(extra info: {"SystemType":"Container","Name":"e9c70c78d5a440a06be3d62b22e8595e9b2fe75150975786e53dbfa62f65f4e2","Owner":"docker","VolumePath":"\\\\?\\Volume{99ef8690-39a6-
11eb-b8c8-9f85d74bcf9b}","LayerFolderPath":"C:\\ProgramData\\docker\\windowsfilter\\e9c70c78d5a440a06be3d62b22e8595e9b2fe75150975786e53dbfa62f65f4e2","Layers":[{"ID":"f87df
71e-96b5-5d4d-bad3-f1f5fc18a687","Path":"C:\\ProgramData\\docker\\windowsfilter\\9d4d41a039c3cf89f2fbf3e215ffe74347704d6c52cb5da6efee455d7c899e4f"},{"ID":"1795d45d-4bf1-5d5
e-a1f6-2315a403676d","Path":"C:\\ProgramData\\docker\\windowsfilter\\5a4e78d87eea11f8c8481930783c87ab19993a70b59f2ca14ae9d02faf6b62a6"},{"ID":"3160db40-4db9-5e7a-adff-6d8f9
8b4af3e","Path":"C:\\ProgramData\\docker\\windowsfilter\\89cf3e9b32dca9c989635fceb67ffb9c569226e979d68a19ade2b6fd3f29c125"},{"ID":"266cdb87-6927-5a38-8b87-4a5054a5e0dd","Pa
th":"C:\\ProgramData\\docker\\windowsfilter\\aa0f850ba7cc735d4612954f126b8f13ec61fee4d64ec95c5cb2d8c62381b5f7"},{"ID":"1f0ad460-c88d-5a49-a417-8e4b70a44b4f","Path":"C:\\Pro
gramData\\docker\\windowsfilter\\31d1972267a5f666a6f866c5efc2ff03a29f0fedde335c59bddb31f7a53d381f"},{"ID":"32513b55-3e80-59f4-865b-a319d5240453","Path":"C:\\ProgramData\\do
cker\\windowsfilter\\fa412095b71f300b4a3d51a33c0b901204f22d6351c6d761935adfeeb64a2df6"},{"ID":"ef42a02e-2539-57b6-b9e5-a884d22d2794","Path":"C:\\ProgramData\\docker\\window
sfilter\\e26b667fb8e84eca69e08cf9c592b3fef4489b4f9d7fccefceae074e92600782"},{"ID":"ecdfa463-f7c0-5fde-95a4-bfcc9d369716","Path":"C:\\ProgramData\\docker\\windowsfilter\\33d
9add530e2e06c012d43452ae13b5aea06eea06b0c7c9db61aed37901a289d"},{"ID":"4d8a387a-8a9c-5c1a-8b5d-a5e3e771e857","Path":"C:\\ProgramData\\docker\\windowsfilter\\b3496287927fed2
d8a090afb3977d23a0ab16617b3a55b1e4f5fea53efd3fe92"},{"ID":"a4aa03c8-c0b6-5808-b929-416b4df95169","Path":"C:\\ProgramData\\docker\\windowsfilter\\f750377c0adbcfe04f29a4cd020
7cb0546ff70473d5a546cbc94cc2617ae6c9c"},{"ID":"ab772d5a-e7d1-5fb6-a55f-b869d81fb21d","Path":"C:\\ProgramData\\docker\\windowsfilter\\be815a3eda5f4a52b8cf947db9621b483e5db19
dbd066bbd723fab1efae67cfe"},{"ID":"6ac2fa67-4a01-54f7-b606-ac17e4003771","Path":"C:\\ProgramData\\docker\\windowsfilter\\943abd37d4b00b9bc4076640cb30623563d129eed4aa84dbce0
a008e818bd031"},{"ID":"623f5562-ec03-5335-b575-778665c398eb","Path":"C:\\ProgramData\\docker\\windowsfilter\\ba5bb61b68f4a65816ba5993886def11e70afabe03cd2a40fcb68cbe60f309b
3"},{"ID":"bd8c539b-a13b-500a-821e-1829822cd9f5","Path":"C:\\ProgramData\\docker\\windowsfilter\\e882f8df83fcf75601c48348c6d32caf13e17afe4be01cb6039ae7485dac9704"},{"ID":"e
4f8a3ff-e3e0-5fdc-ba59-f1ffcfa8599b","Path":"C:\\ProgramData\\docker\\windowsfilter\\2f7d90e6238093004c50772f65109c3c5b9980eed13d15af5508aea702ab7c1c"},{"ID":"0af75a30-df24
-583c-a125-fbe48b8dc8da","Path":"C:\\ProgramData\\docker\\windowsfilter\\9be5e08143d679caf4a4f4babaeca0af6d02c8fe3f410a2f10a9b39da2cba92c"},{"ID":"d8870767-a0e4-5174-9b8e-e
92c5894b859","Path":"C:\\ProgramData\\docker\\windowsfilter\\e31b01e5079dad57cd5cb1cc6c2bcc99c8f9d2ea8b00610d966751ce66006ad8"},{"ID":"4c095483-287e-598b-9545-4a6763f81fbc"
,"Path":"C:\\ProgramData\\docker\\windowsfilter\\a7d7f7cdf95df37fd710dba1b40fe7e0ed88dc9e37c7877674f76bc67f177dfe"},{"ID":"2a839dbd-55bb-538b-8a5e-c22021118054","Path":"C:\
\ProgramData\\docker\\windowsfilter\\c7a3b395df9ea09b71cf26c71bc2fa4545c13815d8d9a93b8713407ef56d80a6"},{"ID":"1d0d7edc-139a-5635-908a-516287037a50","Path":"C:\\ProgramData
\\docker\\windowsfilter\\8a89432a811305855911cd8d599074d6c4fac0f41d86a6b16f64c0b496442d38"},{"ID":"ae91fd6a-5068-5ff5-8730-78cea36e6d9c","Path":"C:\\ProgramData\\docker\\wi
ndowsfilter\\0baea10c3d489effbd8e8f9b19a916e389829681c52e36af7347f2dec74edad7"},{"ID":"d1d6c6b2-1fb2-54aa-a1ab-02fbba1710f8","Path":"C:\\ProgramData\\docker\\windowsfilter\
\70d9c67636c276c0ebdf661e18d645f2dca5c82eeeec3f02a5040a0fc6437d10"},{"ID":"720c4ec5-99a
9-5a52-ac4a-ce5d23d78a9a","Path":"C:\\ProgramData\\docker\\windowsfilter\\496b50e03c9f6fc4495c23fe0b1f009c6e462c07e5f463fa6c4be5471808844e"},{"ID":"8e9f8e80-1b9f-53a1-ab44-
845b20cd34e2","Path":"C:\\ProgramData\\docker\\windowsfilter\\f8efbdd13fc35dad912f8c035d6a0f5856b8745be39cc2489eda7e6a2f836f02"}],"HostName":"e9c70c78d5a4","MappedDirectori
es":[{"HostPath":"d:\\paw_admin\\log\\paw-ui-api","ContainerPath":"c:\\log","ReadOnly":false,"BandwidthMaximum":0,"IOPSMaximum":0,"CreateInUtilityVM":false}],"HvPartition":
false,"EndpointList":["96edadf0-0c6c-43ea-a306-2144cd3fda79"],"AllowUnqualifiedDNSQuery":true})
Regards
Jagan
------------------------------
Jaganathan Chetty Palanisamy
------------------------------