"llama.cpp abort:97: CUDA error" When Using LM Studio

zluda_trace logs (tarball/zip file)

LMSCudaLog.txt

Description

So I have ZLUDA hooked into LMS (Latest beta version), and it seems to load normally, with some errors. It did take almost 15 minutes for it to "load", but then right when it hits 100%, LMS stops loading the model and gives an error 97 CUDA error. I've tried changing files around with ZLUDAs, but no luck. I've heard that at one point LMS used to work, so maybe I'm just doing something wrong.

Steps to reproduce

1. Open Windows CMD (Admin)
2. Run this command, yours will be different "C:\ZLuda\zluda.exe -- D:\Local AI Program Folder\LM Studio\LM Studio.exe
3. Install CUDA engine (Not the CUDA 12 Engine)
4. Load model

ZLUDA version

6 Preview-70

Operating System

Windows 10 19045

GPU

Radeon RX 6700XT