Piggybacking too as I am considering the same. Please OP and thank you.
And what model class are you using?
Lightweight (2B), reasonable ~10B or above 32B?
Do they load fast?
I had a look at NetworkChucks setup and don’t think I can afford an overpowered rig in this economy. Depending on the rig, may have to wait >20s for a prompt answer.
Piggybacking too as I am considering the same. Please OP and thank you.
And what model class are you using? Lightweight (2B), reasonable ~10B or above 32B?
Do they load fast?
I had a look at NetworkChucks setup and don’t think I can afford an overpowered rig in this economy. Depending on the rig, may have to wait >20s for a prompt answer.
Thank you again!