I’m sick and tired of the Capitalist religion and all their fanatic believers. The Western right-wing population are the most propagandized and harmful people on Earth.
Random suspicion: It is correlated to how much compute US have. That’s the only reason I can think of. I also wondered why they would do that when US tech are grabbing the global hardware. They’d like to keep control of inference in the cloud but are missing power thus lack compute. But they also benefit from a western AI ecosystem that have much more compute available. Pure guess, but maybe something like that ?
so there is very little batch size. Even 512 causes OOM.
As a single user, can you set it down to 2 ? Longshot, but fewer batches must then mean lesser memory, but with a bit slower speed ?. …just a thought.
Alternatively you could try one of the distributed inference engines ? I don’t think they give more speed, but adding another small machine might take the heat of you own memory so you can open a browser again ?
Haven’t tried it yet.
“ZLUDA is a drop-in replacement for CUDA on non-NVIDIA GPUs. ZLUDA allows running unmodified CUDA applications using non-NVIDIA GPUs with near-native performance”
Thanks for the warning…
Sharp hacker. I learned about a few new layers in the hardware stack. I didn’t know that one memory cell could be manipulated from its neighbors either.
Maybe I’m just getting old, but the ‘freshness’ was over the top for me. I saw some of her early vids, and they were very nice and relaxed.
“Writer denies it, but publisher pulls horror novel after multiple allegations of Typewriter use”
The violators create the Laws…
No, not much, but a happy smiling selfie is seriously not a bad idea!
When we smile to our selves once a day in front of a mirror, we tend to mimic that emotion so we can manipulate our own mood in a deliberate feedback. (There are papers on it).
That is hard to habituate for some of us, so having a smiling selfie on your desktop will continuously nudge you towards …a happier mood than otherwise. …in theory at least ;-)
I would try a less quantized version. Sometimes inaccurate weights compound and a loop can occur.
Bigger cloud models can do it too when they get perplexed/overwhelmed, or have countering instructions etc. It is possible to detect repeated sentences and ‘snap it out of it’ by inserting a rough/LOUD! order, or even mindful words like ‘caaaalm down… close your eyes and breath slowly…’ into the context. …or both. Feels odd, but the llm just reacts to the human language/intend anyway…
“The online advertising industry has built a massive surveillance machine”
I think this is the important stuff. The current fascist regime just uses the surveillance that is already established, working and harming citizens in their non-free society. However, all the prior US/Western governments have done this in some way or another.
There is no-where, where its okay for Corporations/Capitalist to surveil/control people for their benefit, and oc that oc goes for their elite Government that allows a private/psychotic surveillance ‘machine’ to exist, and even grow huge…
Incredible how the AI safety teams didn’t find a problem with private Corporate Psychopaths owning/exploiting the most dangerous technology in human history. It’s almost as if they were hired and paid by said Corporations ?!
Boycott them all…
Also: “In capitalism, the market decides. In oligarchy, connections and donations decide. It sure look like the US is transitioning from the former to the latter.”
The Ideal of ‘Capitalism’ is nonsense and have always been. Rich Uckers using ‘might is right’ is the core of Capitalism - it is perpetual economic war with death, poverty and suffering while property changes hands - it’s a War !! It’s incredibly obnoxious to read these believers that still haven’t figured out that the rich Unts are the ones that pay for the ‘free market’ flower-power propaganda. It’s all a primitive scam - manufactured consent - that only benefits the 1%, but here we once again see one of the sad believers that can’t understand what’s happening with his pet idealized belief system - his pet religion…
Time to rebel against powerful individuals doing what they want…
Holy crap they have momentum !
Wow. At some point you really should use the same amount of energy actually examining what Russia is saying, and thus what is actually happening. Oh well, I guess its just easier to get a fully formed opinion served by propaganda…
hostnamectl set-hostname moon # 1. Set hostname
docker run hello-world # 2. Host on the moon
You are welcome !
fyi: walled article.
Hm, I could use that on a few Android devices…