How to fix jupyterhub issue
Anyone have any experience with jupyterhub?
I'm getting:
TimeoutError: pod jupyterhub/jupyter-zfjryuibwedbvgjvmxrvjcfjybevht did not start in 300 seconds!
With config
# This file can update the JupyterHub Helm chart's default configuration values.
#
# For reference see the configuration reference and default values, but make
# sure to refer to the Helm chart version of interest to you!
#
# Introduction to YAML: https://www.youtube.com/watch?v=cdLNKUoMc6c
# Chart config reference: https://zero-to-jupyterhub.readthedocs.io/en/stable/resources/reference.html
# Chart default values: https://github.com/jupyterhub/zero-to-jupyterhub-k8s/blob/HEAD/jupyterhub/values.yaml
# Available chart versions: https://hub.jupyter.org/helm-chart/
#
proxy:
secretToken: tuFslOftLZF2t7ECEUZeMgmfOaIdv1RX
debug:
enabled: true
singleuser:
defaultUrl: "/lab"
extraEnv:
JUPYTERHUB_SINGLEUSER_APP: jupyter_server.serverapp.ServerApp
JUPYTERHUB_ADMIN: admin
memory:
limit: 6G
guarantee: 512M
cpu:
limit: 2
guarantee: .5
image:
name: jupyter/datascience-notebook
tag: latest
hub:
services:
datarango:
admin: true
name: datarango
api_token: secret-token
extraConfig:
myConfig.py: |
c.JupyterHub.authenticator_class = CustomNullAuthenticator
# This file can update the JupyterHub Helm chart's default configuration values.
#
# For reference see the configuration reference and default values, but make
# sure to refer to the Helm chart version of interest to you!
#
# Introduction to YAML: https://www.youtube.com/watch?v=cdLNKUoMc6c
# Chart config reference: https://zero-to-jupyterhub.readthedocs.io/en/stable/resources/reference.html
# Chart default values: https://github.com/jupyterhub/zero-to-jupyterhub-k8s/blob/HEAD/jupyterhub/values.yaml
# Available chart versions: https://hub.jupyter.org/helm-chart/
#
proxy:
secretToken: tuFslOftLZF2t7ECEUZeMgmfOaIdv1RX
debug:
enabled: true
singleuser:
defaultUrl: "/lab"
extraEnv:
JUPYTERHUB_SINGLEUSER_APP: jupyter_server.serverapp.ServerApp
JUPYTERHUB_ADMIN: admin
memory:
limit: 6G
guarantee: 512M
cpu:
limit: 2
guarantee: .5
image:
name: jupyter/datascience-notebook
tag: latest
hub:
services:
datarango:
admin: true
name: datarango
api_token: secret-token
extraConfig:
myConfig.py: |
c.JupyterHub.authenticator_class = CustomNullAuthenticator
1 Reply
Logs:
[D 2024-04-12 00:51:50.110 JupyterHub scopes:884] Checking access to /hub/api/users/zfjryuibwedbvgjvmxrvjcfjybevht/server/progress via scope read:servers
[D 2024-04-12 00:51:50.110 JupyterHub scopes:697] Argument-based access to /hub/api/users/zfjryuibwedbvgjvmxrvjcfjybevht/server/progress via read:servers
[D 2024-04-12 00:51:50.112 JupyterHub spawner:2303] progress generator: jupyter-zfjryuibwedbvgjvmxrvjcfjybevht
[D 2024-04-12 00:51:50.226 log:192] 200 GET /hub/health (@10.36.0.1) 0.47ms
[D 2024-04-12 00:51:51.469 proxy:924] Proxy: Fetching GET http://proxy-api:8001/api/routes
irrelevant health routes
[D 2024-04-12 00:55:41.805 JupyterHub reflector:374] pods watcher timeout
[D 2024-04-12 00:55:41.805 JupyterHub reflector:289] Connecting pods watcher
[D 2024-04-12 00:55:42.226 JupyterHub log:192] 200 GET /hub/health (@10.36.0.1) 0.47ms
[D 2024-04-12 00:55:44.226 JupyterHub log:192] 200 GET /hub/health (@10.36.0.1) 0.45ms
[W 2024-04-12 00:55:45.616 JupyterHub user:879] zfjryuibwedbvgjvmxrvjcfjybevht's server failed to start in 300 seconds, giving up.
Common causes of this timeout, and debugging tips:
1. Everything is working, but it took too long.
To fix: increase `Spawner.start_timeout` configuration
to a number of seconds that is enough for spawners to finish starting.
2. The server didn't finish starting,
or it crashed due to a configuration issue.
Check the single-user server's logs for hints at what needs fixing.
Stopping user
Deleting pod jupyterhub/jupyter-user
Deleting oauth client jupyterhub-user
Finished stopping user
Exception in Future <Task finished name='Task-182' coro=<BaseHandler.spawn_single_user.<locals>.finish_user_spawn() done, defined at ...> exception=TimeoutError('pod "podname" did not start in 300 seconds!')> after timeout
Traceback (most recent call last): ...
TimeoutError: pod jupyterhub/jupyter-zfjryuibwedbvgjvmxrvjcfjybevht did not start in 300 seconds!
[D 2024-04-12 00:51:50.110 JupyterHub scopes:884] Checking access to /hub/api/users/zfjryuibwedbvgjvmxrvjcfjybevht/server/progress via scope read:servers
[D 2024-04-12 00:51:50.110 JupyterHub scopes:697] Argument-based access to /hub/api/users/zfjryuibwedbvgjvmxrvjcfjybevht/server/progress via read:servers
[D 2024-04-12 00:51:50.112 JupyterHub spawner:2303] progress generator: jupyter-zfjryuibwedbvgjvmxrvjcfjybevht
[D 2024-04-12 00:51:50.226 log:192] 200 GET /hub/health (@10.36.0.1) 0.47ms
[D 2024-04-12 00:51:51.469 proxy:924] Proxy: Fetching GET http://proxy-api:8001/api/routes
irrelevant health routes
[D 2024-04-12 00:55:41.805 JupyterHub reflector:374] pods watcher timeout
[D 2024-04-12 00:55:41.805 JupyterHub reflector:289] Connecting pods watcher
[D 2024-04-12 00:55:42.226 JupyterHub log:192] 200 GET /hub/health (@10.36.0.1) 0.47ms
[D 2024-04-12 00:55:44.226 JupyterHub log:192] 200 GET /hub/health (@10.36.0.1) 0.45ms
[W 2024-04-12 00:55:45.616 JupyterHub user:879] zfjryuibwedbvgjvmxrvjcfjybevht's server failed to start in 300 seconds, giving up.
Common causes of this timeout, and debugging tips:
1. Everything is working, but it took too long.
To fix: increase `Spawner.start_timeout` configuration
to a number of seconds that is enough for spawners to finish starting.
2. The server didn't finish starting,
or it crashed due to a configuration issue.
Check the single-user server's logs for hints at what needs fixing.
Stopping user
Deleting pod jupyterhub/jupyter-user
Deleting oauth client jupyterhub-user
Finished stopping user
Exception in Future <Task finished name='Task-182' coro=<BaseHandler.spawn_single_user.<locals>.finish_user_spawn() done, defined at ...> exception=TimeoutError('pod "podname" did not start in 300 seconds!')> after timeout
Traceback (most recent call last): ...
TimeoutError: pod jupyterhub/jupyter-zfjryuibwedbvgjvmxrvjcfjybevht did not start in 300 seconds!