Marvin Damschen@mastodon.nu to LocalLLaMA@sh.itjust.works · 3 hours agoI wrote about running LLMs locally on the Intel Arc Pro B60 GPU previously, where I used Intel's official software stack (llm-scaler / vLLM).plus-squaremessage-squaremessage-square0fedilinkarrow-up19arrow-down12
arrow-up17arrow-down1message-squareI wrote about running LLMs locally on the Intel Arc Pro B60 GPU previously, where I used Intel's official software stack (llm-scaler / vLLM).plus-squareMarvin Damschen@mastodon.nu to LocalLLaMA@sh.itjust.works · 3 hours agomessage-square0fedilink