The Github describes arguments to use GPU acceleration, but it is fuzzy on what the arguments do and completely neglects to mention what the values for those arguments do. I understand the --gpulayers arg, but the two ints after --useclblast are lost on me. I defaulted to “[path]\koboldcpp.exe --useclblast 0 0 --gpulayers 40”, but it seems to be completely ignoring GPU acceleration, and I’m clueless where the problem lies. I figured it would be easier to ask for a guide and just start my GGML setup from scratch.
Note this is koboldcpp.exe and not KoboldAI.
The Github describes arguments to use GPU acceleration, but it is fuzzy on what the arguments do and completely neglects to mention what the values for those arguments do. I understand the --gpulayers arg, but the two ints after --useclblast are lost on me. I defaulted to “[path]\koboldcpp.exe --useclblast 0 0 --gpulayers 40”, but it seems to be completely ignoring GPU acceleration, and I’m clueless where the problem lies. I figured it would be easier to ask for a guide and just start my GGML setup from scratch.