Not helping here, but I heard a guy with Guix did that. Guix just builds a profile with the extra desktop parts, run it in a local container if you want and add that profile to the local software stack. Not a vm but maybe you don’t need it ? Both the system, home and the desktop profile are declarative, so very mobile. I think he had his DE user profile remote also, so extremely minimal/air-gapped and stable solution with almost zero local data: system, home, desktop-profile, remote user profile (ldap etc).

In declarative operating systems, you describe what you want, and the system builds it for you. Your whole system configuration is a few files of std code (learning experience ;). Personally, I’m done with the usual monolithic distros. They are too error prone for my taste, and not really moving with the dev flow of operating systems imho.

Anyway, just a loose rumor/idea, I have no links and don’t actually know how to do it, sorry.

Great that you chose weights for the final evaluation. Black, and whitelists are just too …0D/binary for any advanced use, and are unfortunately used everywhere.

Classic Capitalist behavior and problems, now just amplified by the Capitalists new super tool… Monetary/greedy slop amplified by a new tool, jobs ruined in an archaic system that enforces jobs to survive, stolen ‘copyright’ that are only a leftover from this warring ideology, and so on.

AI is currently a tool, and people should hate the users that causes harm with the tool, or better yet, hate the underlying combative system of market capitalism that forces tools to be used like this, forces slop and structural problems, and creates enormous problems for ordinary people. They should not hate the tool - a hammer is only bad in a bad environment.

As long as we keep believing in a combative society paid for, and controlled by the ones with the mightiest tool, it won’t ever get better. Capitalism are sponsored by, and benefit only, the rich, and everyone else are the victims of their behavior, and the automatic consequences it have in all of our social lives.

I could be wrong, but it seems he just mounted ‘/porn’ directly as ‘/’ ? Efficient, I guess.

…actually, there seem to room for more improvements; I’m not sure there’s any need for an ‘operating system’ on the system - a small fap-app ™ could likely handle all content on the system ? Work documents could be injected in to the fap-stream © when he needs to stop ? That would release many gb for even more fap-ability © ?

‘Betrayal’ is a harsh word for optimizing trivialities with a closed source model. Whether it was a success or not, doesn’t really tell us why it’s a betrayal. I guess this has to do with the current wave of ‘AI-hate’ reactions we see everywhere.

I a year you might have an agent to manage them all. They could be edge devices, or different nodes in your/your ai’s work flow. Don’t get rid of them unless you hate AI, or for good causes.

Probably just inserted the Magic word “Profit” into the sentence. Any psychopathy is allowed from that point onwards…

Weather true or not, I think that in the coming years, several billion people will suddenly have the chance to discuss these things with AI, and scrutinize all facets of the current scientific body. I predict that all fields will be disrupted, and shake all former intuition and certainty about current quality of our models. New ideas and papers inspired by this is already popping up, and it will get more and more intrusive until a new knowledge paradigm emerges.

…a super prolific autistic account hoarder ?

Good news everyone ! “top 200 most common passwords” isn’t in the list, so we can keep using that one !

I have a few super old phones/tablets I didn’t threw out for some reason. IF termux can be installed, does the Android version mean anything for the running services ? My latest Android device is version 7.

If you are posting satire, then be kind and mark it as such. Otherwise you just waste other peoples time, and I assume that were not the purpose ?

This is all just Capitalist slop. Has nothing to do with AI or llms, just the kind of society it exists in and the type of psychopath corporations that delivers. We seem to forget that all other tool we use to de-shittify the net, ALL fight capitalist tendencies, but when AI comes along and gives the Capitalist believers a new tool for scamming people, then it is suddenly the tools fault !!

People hate Capitalism, not the tool…

Quick link: https://github.com/dwash96/aider-ce

I have not tested it, but Zluda are are drop-in cuda replacement for non-nvidia gpus. The speed should be great. You could check if your goto card is supported…

A backup drive ? dotfiles (.config) ? /tmp /var/log /boot ? map it into your home for something temporary - Downloads ? Slow audio files ? If you like to tinker for fun: btrfs / bcachefs could perhaps utilize it for something, like automatically offloading unused/slow files to the slow usb ? Raid ? ;) Create a partition and let zram swap compressed unused memory pages to the usb partition (I think it keeps pages compressed now ?). You can also run ‘usb over ethernet’, so another machine can use it directly - not sure why tho ;)

On a side note. I still use one of my first usb 1.? drives with 32mb in my old router. 32mb is still 12mb more than my first hard drive, and it fits well with the small openwrt packages. It even has a little slide button to select ‘floppy drive’ mode and a physical ‘readonly’ mode. I wonder what the smallest/oldest usb stick people still use, are ?

Agree. “Are you perhaps too angry?”, “The HELL I’m not! F*ck off !”, “alrighty then”…

Compute prices are not going down. If you want a budget friendly compute, then you may need to look for NPU’s. They are slower, and is unfortunately also getting more expensive pr TOPS. Electricity prices in the West are going up as a low output gets bought up by datacenters instead. The newest GPU’s are more efficient in re. to power pr Top, but they are not budget friendly.

I have not seen a recent comparison of GPU vs Npu; TOPS vs price vs power consumption, but @ aliexpress, I saw a small 40 TOPS Npu as a nvme stick with 16gb ram that draws 10 watts, or so (search for ‘ai accelerator nvme’). This little thing can scan files 24/7 and your i5 can help out in peaks. Afaik you can run a distributed model that also runs in, and uses your i5 memory/compute, so if you max out i5 memory, perhaps the combined compute is enough for a larger model ? Maybe a few Npu sticks can work together on the same model ?

Alternatively, you could look for the next version of a Huawei gpu card (first had baby kinks afaik), or one of the other upcoming producers from China. They’ll come faster and faster, but are earmarked for local consumption first.

Another suggestion is to buy one of the old P40/80 (from the ‘pascal’ chipset, I think) (or was it k40/80 ??). They should still support a descent range of modern quantization needs and often have 24gb ram. A refurbished miner card cost around 50-70$+ - cant remember exactly tho.

Lastly, you could try something different. If the i5, with enough memory, can run a large model slowly, you could add a dedicated KV cache, so most of the tokens won’t need to be recalculated. Memory and bandwidth are the most important here, but any old server could be upgraded to be a dedicated KV cache server (might need a network upgrade tho!).

Anyway, Ideas are easy and cheap. If I were you, I would ask an AI for a little python app where you can add a product and it returns a graph where it compares with other products and show optimality over time given prices/power and Tops - Gpu vs Npu. Good hunting…

They are just trying to remove all the nonsense western propaganda. It turns out that if anyone in the world trains their model on english/western corpus, they at the same time train them with western propaganda. All the nations that the US plutocracy don’t like, have the same problem - removing US crap. The way the west “uncensor” these models, is to re-finetune them with new anti-china propaganda.

We can say that about Capitalism. Anyone wants to spread their garbage in an attempt to survive this combattive ideology. Before AI, 90% of all internet information were Capitalist slop, but now its all AI’s fault …smh…