V
��
1. git clone the linked repo, it has the trained clip-to-llama thingamajig included already
2. setup the venv, or if you are lazy like me, use an existing venv from one of the other billion projects with a superset of this one's requirements.txt
3. edit app.py to remove all the gradio and spaces junk
4. replace "meta-llama/Meta-Llama-3.1-8B" with "unsloth/Meta-Llama-3.1-8B-bnb-4bit" to save space and not have to authenticate with hf
5. print(stream_chat(Image.open("/path/to/boobas.png")))
6. ???
7. profit
F
FVVVVF
F
N
C
DFF
DD
C
HCDFF
DC
![Dazzastrous [4090]](https://cdn.discordapp.com/avatars/871389071686135838/c4a5f4d81d9eeb18d856295d692e2c07.webp?size=40)
DDC
DC
DDDD
DF
FD
SFFDFFFDDD
![Dazzastrous [4090]](https://cdn.discordapp.com/avatars/871389071686135838/c4a5f4d81d9eeb18d856295d692e2c07.webp?size=16)
1. git clone the linked repo, it has the trained clip-to-llama thingamajig included already
2. setup the venv, or if you are lazy like me, use an existing venv from one of the other billion projects with a superset of this one's requirements.txt
3. edit app.py to remove all the gradio and spaces junk
4. replace "meta-llama/Meta-Llama-3.1-8B" with "unsloth/Meta-Llama-3.1-8B-bnb-4bit" to save space and not have to authenticate with hf
5. print(stream_chat(Image.open("/path/to/boobas.png")))
6. ???
7. profit