RUNPOD_SSH_PUBLIC_KEY to PUBLIC_KEY.$PUBLIC_KEY instead of $RUNPOD_SSH_PUBLIC_KEY resolved the issue. I would also recommend adding some extra logging as the current script fails silently. I have a branch with the updates ready but looks as though I can't pull request into the repo.