(Deleted for not relevant anymore)
You must log in or register to comment.
I guess it depends on what you mean by usable, I think people have had success with ROCM, it’s not as solid as CUDA of course but it’s been more than usable
Before buying a GPU for this, evaluate models using your CPU and system memory first. The only difference would be speed but note that CPUs can be acceptably fast and that responses are the same.