That looks like exactly the sort of thing i want. Any existing solution to get it to behave like an ollama instance (i have a bunch of services pointed at an ollama run on docker).
That looks like exactly the sort of thing i want. Any existing solution to get it to behave like an ollama instance (i have a bunch of services pointed at an ollama run on docker).
Huh so basicly sidestepping the gpu issue entirly and essentially just using some other special piece of silicon with fast (but conventional ram). I still dont understand why u cant distribute a large llm over many different processors each holding a section of the parameters in memory.
I run !news_summary@lemmy.dbzer0.com and bypassing cloudflair, paywalls, anti bot filters, etc is way easyer compared to what anyone thinks.
Their is no escape from web scrapers. Best u can do is poison ur images and obfuscate the page source.
I got no backups ao ur doing better than me. If 1 ssd dies there goes all my data.
Hardware perspective i need a nas. I got myself some piece of acer oem thats not too shit just need a case and some drives (i dont wanna just make stack of drives on top of the stack of old oems i call a homelab).
Am getting starlink installed cos shitty rural aussie internet is shit. So gonna have to do some fucking around to make that work.
Would like some local media reccommendation algorithm (can probs just write some code to dump jellyfin into openwebui and task an llm).
Gotta set up an image gen ai and hook that up to openwebui.
Gotta set up an email server to make authelia notifications not just dumped to a file.
Ohh and i got literaly no backups of anything (well except my docker composes that are on git).
Other than that we will see what i want.
I don’t like portainer, you’ll learn more by not using it. I just set everything up using compose files and then I have a start script to start them all in case my server goes down. You can check out my setup here.
Gpl Fuck yeah. Thats awsome
What sort of open source
From memory but wikepedia back me up: https://en.wikipedia.org/wiki/Electron_(software_framework)
I was technicaly correct in Github created it but they nolonger maintain it so idk what control they still have over the project.
It’s currently maintained by OpenJS Foundation with founding members included Google, Microsoft, IBM, PayPal, GoDaddy, and Joyent. https://en.wikipedia.org/wiki/OpenJS_Foundation
Thats not what i mean. Microsoft owns github, github who created electron.
Microsoft controls github which controls electron.
Another example of Microsoft using its control of FOSS projects to push you towards their web-based alternatives of something you already have except now for the low low price of a monthly subscription fee, AI slop, and all ur data.
So i see that they have a premium version and that the code is gpl. So are the premium features in the repo? Can i make my own build that gives me the premium features free?
This. Its excellent. Cross platform. AI search. Location tagging. Everythibg u want.
kWh is the stupidest unit ever. kWh = 1000J/s * 6060s = 3.610^6J so 0.1kWh = 360kJ
That was before my time lol.
Docker containers arnt virtual machines despite acting like them. They dont actually require compute resources to be sitting around doing nothing like a traditional vm cos they are essentially just a proxy between the kernal in the container and the kernal on the base machine.
If the container isnt doing anything then it isnt consuming resources.
I like containers it makes shit very convenient. I dont give a fuck about the specifics of some service i copy paste a docker compose and im off to the races.
How did fix the boot loop on android?
Everything is the same network if u have taikscale