I won’t touch the proprietary junk. Big tech “free” usually means street corner data whore. I have a dozen FOSS models running offline on my computer though. I also have text to image, text to speech, am working on speech to text, and probably my ironman suit after that.
These things can’t be trusted though. It is just a next word statistical prediction system combined with a categorization system. There are ways to make an LLM trustworthy, but it involves offline databases and prompting for direct citations, these are different from Chat prompt structures.
The best years of YT before 2017, there was an advanced maker and DIY tech culture revolving around people sharing projects and content just to share it. That died. This all pro CC thing has an up side to some extent, but it also lobotomized YT. Peertube might eventually get to the same kind of utility level, but it needs a lot of time and momentum to get there.
Oobabooga is the main GUI used to interact with models.
https://github.com/oobabooga/text-generation-webui
FYI, you need to find checkpoint models. In the available chat models space, naming can be ambiguous for a few reasons I’m not going to ramble about here. The main source of models is Hugging Face. Start with this model (or get the censored version):
https://huggingface.co/TheBloke/llama2_7b_chat_uncensored-GGML
First, let’s break down the title.
As for options on the landing page or “model card”
The 7B models are about like having a conversation with your average teenager. Asking technical questions yielded around 50% accuracy in my experience. A 13B model got around 80% accuracy. The 30B WizardLM is around 90-95%. I’m still working on trying to get a 70B running on my computer. A lot of the larger models require compiling tools from source. They won’t work directly with Oobabooga.
Hey there Lionir. Thanks for the post. Can the Beehaw team please look into copying or getting the creator of this bot to work here? https://lemmy.world/u/PipedLinkBot@feddit.rocks
I think the person that created that bot is somehow connected to the piped.video project. I know the whole privacy consciousness thing isn’t for everyone, but this bot’s posts are quite popular elsewhere on Lemmy.
FYI, the main reason to use piped.video links is that it is setup as an alternative front end for YT that automatically routes all users through a bunch of VPNs to help mitigate Alphabet’s privacy abuses and manipulation.
Not exactly. Stupid people with advanced tools make stupid outputs. Venture capital is pushing the propaganda sauce hard and a lot of stupid people are jumping on AI as a corporate trend. These are the idiots.
The tools are next level. We are on the edge of this tech becoming a really big deal. There are several research papers making breakthroughs regularly and making double digit percentile improvements on efficiency and accuracy. The reason it is a big deal is because you can have around 1/4 of the knowledge of the entire internet running on hardware as powerful as a current flagship phone. Sure it lies around 1/2 the time, but these are problems that are being solved. Like, the latest and greatest models are ancient history in a matter of 2-3 weeks. To be honest, have a casual conversation with an offline and uncensored LLM. You may know it is lying from time to time, but if you’re being objective, so are most humans you encounter under casual circumstances. The sociological function and potential value of this tech is pretty powerful medicine. Like if you need someone to talk to, or to talk out an issue in private, this is a way to make that happen.
Watch this ~1hr long video when you get the chance. He’s using the stalkerware LLM, but he also describes how to use langchain to parse data like what you are wanting to do.
Toss it in the attic or under the bed and save it. You’ll appreciate it differently in the future, and FAR more than any money you will get for it in the short term.
Google is broken because AI is making it obsolete. I bet in 10 years google will be a historical footnote.
Just got a new gigabyte. The bootloader is shit combined with shitvidia to make a terrible combination to avoid. I expect most companies are doing the same bullshit with TPM/Secure boot. Everything proprietary is criminal theft.
I was a buyer for a chain of high end bike shops for many years. Amazon really only sells junk products. Any real quality brands of niche products can’t support amazon and the typical brick and mortar business inventory structure. Like, I spent between $100k-$500k in preseason bike brand commitments for 3 stores. If any of those brands decided to allow sales on Amazon I would drop them immediately. Multiply this by every bike shop that exists. This is more than Amazon could compete with by a long shot. The issue is that every Buyer in a shop knows what they are able to sell effectively and buys accordingly. I tailored my orders for every shop independently. It would be impossible for Amazon to predict and fund high end bikes at this scale.
“So what,” you say, “it’s just bikes.” No it is not. The bike brands are usually part of a group of brands that include several parts, clothing, and accessory products. These are part of preseason commitments with the bike brands too. So all of these are not sold on Amazon either. This is the case with most things, the best or even decent stuff is not sold on Amazon.
The worst thing with amazon is that they aggregate all identical products in their warehouses. This makes it trivial for a seller to insert fake goods into a product pool and it is completely untraceable back to them.
Worse yet. Install a whitelist firewall or have a look at the connections required to access Discord. You will immediately stop using it. It involves dozens of undocumented raw IP address connections and weird ports. Top this off by telling me what their business model is and how they are profitable. They provide no documentation whatsoever about what they are doing and why. The best explanation anyone has ever given me when asked why they use discord is, ‘because everyone else is doing it.’ That is idiotic nonsense.
Hey, I thought of mentioning, but got sidetracked and forgot. Most of the dozen or so consumer grade routers I have hacked around with seem to have less than optimal placement of DC stepdown converters located around the processor and radio circuit blocks. I mean, they appear to be optimised for radio as the primary design constraint, not for what is best for the DC converter operation. They tend to place electrolytic capacitors in close proximity to circuit blocks that get quite warm. I can’t say how often capacitors are creating problems, but it would not surprise me if this is the cause of many issues for many people after a year or two. I can say that I had problems with a cable company provided modem a few years ago. It had an obvious leaky cap and several that were around 25% out of spec, along with a couple identical parts that were around 5% out as I would expect with my typical shelf stock. Replacing all of them fixed the modem.
When are we going to get accessibility options coded up in Lemmy? That’s all I read, “Zombie Steve feasts on disabled people.”
Who thought this would be a funny article of shrugged shoulders to find this philosophical bomb?
I prefer to run hardware supported by OpenWRT or DDWRT. These have monitoring and firewall options under access control.
If you are not the type to flash your own hardware, pcWRT might be an option. It is small business consisting of a dude in Texas that created a simplified front end for OpenWRT. You just have to trust him, which I haven’t had a problem with, and is probably better than trusting whatever underpaid person has access to similar interfaces for whatever commercial vendor you choose. He has a well secured SSH used to send out occasional updates for the device automatically. His setup does not give you access to the underlying OpenWRT system behind his front end, but with a USB to serial converter and a port on the board you can access OpenWRT in a terminal. I have it setup to log any activity and never had any issues. I’m no expert, but I did install Gentoo once.
https://shop.pcwrt.com/collections/all
No affiliation/not an affiliate link. Beware that some people pushing his stuff are doing an affiliation deal. Also, while his stuff is nice and relatively simple, it has more value in the past when OpenWRT was much harder to setup on your own. OpenWRT is open source but the pcWRT frontend is not.
Steve hitched a ride up a mountain, got off at the top, watched the bus drive away, convinced he’s conquering all the fops, too dumb for the bus; froze to death at the stop.
The main difference will be if you have an Intel processor generation 10 or higher. The whole reason windows 11 was created is because Intel released their asymmetrical core architecture in the 10th generation processors.
One of the core parts of an operating system is the CPU scheduler. This is what juggles all the different things that are happening in the fore and background in order to make the computer work properly. On the surface the CPU scheduler is a rather simple function as far as reading and understanding the code, but it is the kind of thing that a tiny change can have massive repercussions in unexpected ways. It is designed to have a delicate balance that is very easy to screw up.
One of the fundamental aspects of the CPU scheduler used in W10 is that it assumes all of the cores your computer has are the same. Rewriting the CPU scheduler required a whole new rewrite of Windows to accommodate a much more complex architecture with some faster and some slower cores and a different spin up rate to go from idle to max speed on the two types, along with some differences in speed even on cores with adjacent threads. It also required changes to cache management strategies. This still isn’t fully publicly documented for W11. I just know the way the scheduler changed in Linux and watched a conference with John Brown, the main Intel open source developer who mentioned that the 10th gen asymmetry was the main trigger for W11.
Endless Sky. The save game is a text file. Save a file on the mobile app (F-Droid), and on the PC (Flatpak), and note the last line. This is the line you must swap to transfer the save file. It is the first game I have played on both practically. The game mechanics are different between the two and you need to alter your strategy accordingly. On mobile, I travel with a ship setup for boarding pirate vessels and never target enemies directly; all of my guns are automatic turrets. I just use a fast ship and travel with a large group of fighters. It is more of a grind on mobile, but it can be used to build up resources and reserves. The game is much bigger than it first appears to be. You need to either check out a guide or explore very deep into the obscure pockets of the map.