Workspaces Not Shutting Down or Deleting
Hey there, continuing a conversation in general.
For the most part, when I shut down, restart, or delete a workspace, it errors out and gives me a permission denied error in the admin console.
The docker logs show a bit more info:
My system is running on:
I’m running coder v 2.8.1, updated today from v2.8.0 after I saw the build is outdated error for the first time.
I’ve updated everything I possibly can. Occasionally, I’m able to delete a workspace immediately after rebooting, but then the next time I’m unsuccessful.
For the most part, when I shut down, restart, or delete a workspace, it errors out and gives me a permission denied error in the admin console.
Error: Error stopping container b339c7aa191aaf056fb9d822d7ed461e958fe271f3fe25df07ab61c6896e61be: Error response from daemon: cannot stop container: b339c7aa191aaf056fb9d822d7ed461e958fe271f3fe25df07ab61c6896e61be: permission deniedError: Error stopping container b339c7aa191aaf056fb9d822d7ed461e958fe271f3fe25df07ab61c6896e61be: Error response from daemon: cannot stop container: b339c7aa191aaf056fb9d822d7ed461e958fe271f3fe25df07ab61c6896e61be: permission deniedThe docker logs show a bit more info:
2024-02-09 01:05:31.223 [debu] net.tailnet.net.wgengine: magicsock: [0xc000622500] derp.Recv(derp-999): derp.Recv: failed to get reader: failed to read frame header: EOF
2024-02-09 01:05:31.224 [debu] net.tailnet.net.wgengine: derp-999: [v1] backoff: 11 msec
2024-02-09 01:05:31.236 [debu] net.tailnet.net.wgengine: derphttp.Client.Recv: connecting websocket to https://coder.zeinestone.me/derp
2024-02-09 01:05:31.338 [debu] net.tailnet.net.wgengine: netcheck: netcheck.runProbe: got STUN response for 1002stun0 from 45.26.149.20:45924 (18aec99f33a9d2b3dc7f015b) in 112.208751ms
2024-02-09 01:05:31.344 [debu] net.tailnet.net.wgengine: netcheck: netcheck.runProbe: got STUN response for 1003stun0 from 45.26.149.20:45924 (d639afd8bc5c117e99ce7ce1) in 118.401673ms
2024-02-09 01:05:31.345 [debu] net.tailnet.net.wgengine: netcheck: [v1] measuring ICMP latency of coder (999): no address for node 999b
2024-02-09 01:05:31.349 [debu] net.tailnet.net.wgengine: netcheck: netcheck.runProbe: got STUN response for 1004stun0 from 45.26.149.20:45924 (c20db2cafb4f67df84e00445) in 123.357684ms
2024-02-09 01:05:31.438 [debu] net.tailnet.net.wgengine: magicsock: derp-999 connected; connGen=11
2024-02-09 01:05:31.511 [debu] net.tailnet.net.wgengine: netcheck: [v1] report: udp=true v6=false v6os=false mapvarydest=false hair= portmap= v4a=45.26.149.20:45924 derp=999 derpdist=999v4:70ms
2024-02-09 01:05:32.072 [debu] sdk request method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata body=""
2024-02-09 01:05:32.124 [debu] sdk response method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata status=204 body="" trace_id="" span_id=""
2024-02-09 01:05:33.072 [debu] sdk request method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata body=""
2024-02-09 01:05:33.126 [debu] sdk response method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata status=204 body="" trace_id="" span_id=""
2024-02-09 01:05:38.071 [debu] sdk request method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata body=""
2024-02-09 01:05:38.134 [debu] sdk response method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata status=204 body="" trace_id="" span_id=""
2024-02-09 01:05:39.867 [info] connecting to coderd
2024-02-09 01:05:39.922 [warn] run exited with error ...
error= GET https://coder.z.me/api/v2/workspaceagents/me/rpc?version=2.0: unexpected status code 403: Agent trying to connect from non-latest build.
Error: build is outdated2024-02-09 01:05:31.223 [debu] net.tailnet.net.wgengine: magicsock: [0xc000622500] derp.Recv(derp-999): derp.Recv: failed to get reader: failed to read frame header: EOF
2024-02-09 01:05:31.224 [debu] net.tailnet.net.wgengine: derp-999: [v1] backoff: 11 msec
2024-02-09 01:05:31.236 [debu] net.tailnet.net.wgengine: derphttp.Client.Recv: connecting websocket to https://coder.zeinestone.me/derp
2024-02-09 01:05:31.338 [debu] net.tailnet.net.wgengine: netcheck: netcheck.runProbe: got STUN response for 1002stun0 from 45.26.149.20:45924 (18aec99f33a9d2b3dc7f015b) in 112.208751ms
2024-02-09 01:05:31.344 [debu] net.tailnet.net.wgengine: netcheck: netcheck.runProbe: got STUN response for 1003stun0 from 45.26.149.20:45924 (d639afd8bc5c117e99ce7ce1) in 118.401673ms
2024-02-09 01:05:31.345 [debu] net.tailnet.net.wgengine: netcheck: [v1] measuring ICMP latency of coder (999): no address for node 999b
2024-02-09 01:05:31.349 [debu] net.tailnet.net.wgengine: netcheck: netcheck.runProbe: got STUN response for 1004stun0 from 45.26.149.20:45924 (c20db2cafb4f67df84e00445) in 123.357684ms
2024-02-09 01:05:31.438 [debu] net.tailnet.net.wgengine: magicsock: derp-999 connected; connGen=11
2024-02-09 01:05:31.511 [debu] net.tailnet.net.wgengine: netcheck: [v1] report: udp=true v6=false v6os=false mapvarydest=false hair= portmap= v4a=45.26.149.20:45924 derp=999 derpdist=999v4:70ms
2024-02-09 01:05:32.072 [debu] sdk request method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata body=""
2024-02-09 01:05:32.124 [debu] sdk response method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata status=204 body="" trace_id="" span_id=""
2024-02-09 01:05:33.072 [debu] sdk request method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata body=""
2024-02-09 01:05:33.126 [debu] sdk response method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata status=204 body="" trace_id="" span_id=""
2024-02-09 01:05:38.071 [debu] sdk request method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata body=""
2024-02-09 01:05:38.134 [debu] sdk response method=POST url=https://coder.z.me/api/v2/workspaceagents/me/metadata status=204 body="" trace_id="" span_id=""
2024-02-09 01:05:39.867 [info] connecting to coderd
2024-02-09 01:05:39.922 [warn] run exited with error ...
error= GET https://coder.z.me/api/v2/workspaceagents/me/rpc?version=2.0: unexpected status code 403: Agent trying to connect from non-latest build.
Error: build is outdatedMy system is running on:
Linux coder 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/LinuxLinux coder 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/LinuxI’m running coder v 2.8.1, updated today from v2.8.0 after I saw the build is outdated error for the first time.
I’ve updated everything I possibly can. Occasionally, I’m able to delete a workspace immediately after rebooting, but then the next time I’m unsuccessful.
