Axolotl Fine Tune Error (flash_attn_2_cuda.cpython-311-x86_64-linux-gnu.so: undefined symbol)
Hi! I was using axolotl image for fine tuning successfully but now I'm getting this error:
flash_attn_2_cuda.cpython-311-x86_64-linux-gnu.so: undefined symbol
Everything was working normally until yesterday. I'm following the steps in the fine tuning tutorial: https://docs.runpod.io/tutorials/pods/fine-tune-llm-axolotl#using-a-hugging-face-datasetFine tune an LLM with Axolotl on RunPod | RunPod Documentation
Learn how to fine-tune large language models with Axolotl on RunPod, a streamlined workflow for configuring and training AI models with GPU resources, and explore examples for LLaMA2, Gemma, LLaMA3, and Jamba.
0 Replies