Runpod•4mo ago

error on running moonshotai/Kimi-K2-Instruct

i get these error this is my first time using runpod, so not sure how do i resolve this i have run the thing using hugging face repo, everything with default with trust code enabled, i dont know much about other settings below are few error that i think might help in identifying have also attached the long verision of error

Please install it by running `pip install blobfile`.\n
ev3xd1banx60og[info]    raise ImportError(\n
ev3xd1banx60og[info]  File "/usr/local/lib/python3.10/dist-packages/tiktoken/load.py", line 13, in read_file\n

Please install it by running `pip install blobfile`.\n
ev3xd1banx60og[info]    raise ImportError(\n
ev3xd1banx60og[info]  File "/usr/local/lib/python3.10/dist-packages/tiktoken/load.py", line 13, in read_file\n

INFO 07-18 18:32:13 [__init__.py:244] Automatically detected platform cuda.\n
ev3xd1banx60og[error]worker exited with exit code 1
xpo2j9jmpfrnpp[info]INFO 07-18 18:28:04 [config.py:224] Replacing legacy 'type' key with 'rope_type'\n
xpo2j9jmpfrnpp[info]You are using a model of type kimi_k2 to instantiate a model of type deepseek_v3. This is not supported for all configurations of models and can yield errors.\n

INFO 07-18 18:32:13 [__init__.py:244] Automatically detected platform cuda.\n
ev3xd1banx60og[error]worker exited with exit code 1
xpo2j9jmpfrnpp[info]INFO 07-18 18:28:04 [config.py:224] Replacing legacy 'type' key with 'rope_type'\n
xpo2j9jmpfrnpp[info]You are using a model of type kimi_k2 to instantiate a model of type deepseek_v3. This is not supported for all configurations of models and can yield errors.\n

message.txt

4 Replies

Neuron EnixOP•4mo ago

i was able to run TinyLlama/TinyLlama_v1.1 with default settigs, but not able to run kimi-k2

Dj•4mo ago

kimi needs a vllm upgrade that isn't out yet :frowning3: If you use vllm from source it should be fine though!

Unknown User•4mo ago

Message Not Public

Neuron EnixOP•4mo ago

ok, lemme try with the pod

Gaming

Programming

error on running moonshotai/Kimi-K2-Instruct

Did you find this page helpful?