Runpod•2y ago

Jupyter Notebook is not showing the output of any code

I have my model but when I run the .safetensors and ask a question the cells do not respond to anything and I have already tried restarting it.

ashley•2/10/24, 9:57 AM

There isn't any useful information provided. This is not Jupyter, it's some application that you are running inside Jupyter, and you have not specified the name of the application, where you got it from etc etc. You need to provide details if you want assistance.

Aashley There isn't any useful information provided. This is not Jupyter, it's some appl...

Deleted User #4562OP•2/10/24, 9:58 AM

I'm running Mixtral 8x7b on the Notebook generated by Runpod with a NVIDIA H100, trying to run a Mixtral .safetensors using Hugging Face which returns the model response, but it doesn't respond to any cells. I use

Deleted User #4562OP•2/10/24, 9:59 AM

DDeleted User #4562 I have my model but when I run the .safetensors and ask a question the cells do ...

Deleted User #4562OP•2/10/24, 10:00 AM

. full code

Deleted User #4562OP•2/10/24, 10:02 AM

i click this play button

Madiator2011•2/10/24, 11:06 AM

looks like first cell might still be running. [*] means that cell is in que to be run. You know that cell finished running after it will be replaced by number.

MMadiator2011 looks like first cell might still be running. [*] means that cell is in que to b...

Deleted User #4562OP•2/10/24, 11:16 AM

eres español?

Deleted User #4562OP•2/10/24, 11:16 AM

el "que" del corrector te delató

Madiator2011•2/10/24, 11:16 AM

I do not speak spanish

Deleted User #4562OP•2/10/24, 11:17 AM

okay no problem

Deleted User #4562OP•2/10/24, 11:17 AM

I thought that * doesn't mean anything

Deleted User #4562OP•2/10/24, 11:17 AM

thank you

DDeleted User #4562 I'm running Mixtral 8x7b on the Notebook generated by Runpod with a NVIDIA H100,...

kopyl•2/10/24, 12:08 PM

H100s are useless on Runpod until they make it possible to run CUDA 11.8 on a host machine. 12.0-12.2 is incredibly buggy for me.

Aashley There isn't any useful information provided. This is not Jupyter, it's some appl...

kopyl•2/10/24, 12:09 PM

It is Jupyter.

What made you think it’s not?

Kkopyl H100s are useless on Runpod until they make it possible to run CUDA 11.8 on a ho...

Deleted User #4562OP•2/10/24, 12:09 PM

And how can I execute Mixtral?

Deleted User #4562OP•2/10/24, 12:09 PM

And train it

Deleted User #4562OP•2/10/24, 12:09 PM

Using Runpod

DDeleted User #4562 And how can I execute Mixtral?

kopyl•2/10/24, 12:10 PM

Use A100

Kkopyl Use A100

Deleted User #4562OP•2/10/24, 12:10 PM

Do you know about MoEs? Idk about how many A100 I need

Deleted User #4562OP•2/10/24, 12:11 PM

To run a 8 experts MoE

Deleted User #4562OP•2/10/24, 12:11 PM

(Mixtral)

Deleted User #4562OP•2/10/24, 12:11 PM

I read that I need 1 A100 for each expert

Deleted User #4562OP•2/10/24, 12:11 PM

And other sources says otherwise

DDeleted User #4562 Do you know about MoEs? Idk about how many A100 I need

kopyl•2/10/24, 12:12 PM

I never trained this particular LLM, so I can’t tell you.

Why not try yourself?

Kkopyl I never trained this particular LLM, so I can’t tell you. Why not try yourself?

Deleted User #4562OP•2/10/24, 12:13 PM

I have a limited budget and I don't want to spend it training it too much by testing one by one, so I try to be as efficient as possible.

Deleted User #4562OP•2/10/24, 12:13 PM

So I'm looking into it, although I'll probably end up trying it myself.

Deleted User #4562OP•2/10/24, 12:13 PM

Tysm

Kkopyl It is Jupyter. What made you think it’s not?

ashley•2/10/24, 12:15 PM

Jupyter is working fine, the application he is using is not, people can't just say "this doesn't work" without saying WHAT. We are not mind readers. Don't know why you are asking me such dumb shit, I thought you were smart.

Aashley Jupyter is working fine, the application he is using is not, people can't just s...

kopyl•2/10/24, 12:17 PM

I thought you were smart enough to know that it’s Jupyter and not to insult others.

Kkopyl I thought you were smart enough to know that it’s Jupyter and not to insult othe...

ashley•2/10/24, 12:18 PM

Jupyter is Jupyter, he said his app was not producing output, clearly you are the dumbest person on the planet

Madiator2011•2/10/24, 12:33 PM

Oh come on lets not start another fight