I don’t see a ‘should’? That’s a straight command. And even if it were there, is it any more reasonable to dictate what people should not do with their computers?
Because you’re an earthling, just like all of us, and LMs are threatening earth, and it is your duty to not use them, especially not for stupid memes. You must stop using LMs on your own computer or anywhere. I am telling you that as your sister on this planet that we both inhabit.
Ok stow away the hippie crap for a moment. The difference in scale between someone using their personal hardware to run models and the shit the hyperscalers are doing is not even fathomable.
My GPU uses a max of 250W if under full load, which it uses for a few seconds while running a simple request. A single Blackwell blows it out of the water, but those are not provisioned as single boards. They are provided in large racks, containing more CPUs, GPUs, RAM and Storage than i have ever possessed in my life, and i am at it since the early 90s. The difference in resource usage between those 2 scenarios isn’t even measurable because it is simply bonkers.
I honestly can’t tell if you’re joking at my expense or if you’re serious. This thread started to feel like Hexbear for some reason and it makes me want to cry
If you’re joking know that this is a totally believable sentiment for somebody on Lemmy to have.
If you’re serious, then you’re delusional. LLMs themselves can’t threathen anything, they’re not alive. You might be thinking about their power usage or the sentiments of the companies that make them, but none of that is a factor when using them locally. The computer uses the same power regardless of if it’s used to play games or generate text.
Honestly fuck this platform. It is insufferable to post something I had found amusing just to be scolded for not following the Lemmy hivemind. If anyone knows a platform that’s not corporate and doesn’t have such a kneejerk hatred of llms dm me. Goodbye
Lmao if people not wanting to see a user support an industry that’s killing the planet at an alarming scale in such a short time makes you want to leave, then I guess good riddance.
“see if I make weapons at HOME with the gun-O-matic that Lockheed stole and killed so much to produce, I’m not supporting the military industrial complex!”
It’s more about which instance you’re posting in. dbzer0.com for example has far less issues with LLMs and neural networks when run locally - those are practically embraced in the respective communities, while the hyperscalers attempts are loathed as they should be.
Sadly, people conflate local neural networks with the crap they are getting pushed by MS/Meta/OpenAI/Anthropic. Most of them don’t realize the difference in scale between running a local model on a GPU with 16GB VRam and 250W TDP vs even a single rack of Blackwells. They neither have the technical knowledge to separate the two things from another, nor the political knowledge to realize that local NNs empower, while centralized NNs disenfranchise.
A individual running a language model on a single 16gb GPU causes orders of magnitude less environmental damage than buying a carton of almond milk. Please direct your anger where it actually belongs, at the goddamn capitalist vampires building hyperscale datacenters.
You shouldn’t use your computer to use local models out of reach of the Hyperscalers? You shouldn’t use your single GPU with 16 GB Vram because hyperscalers are building datacenters that can’t be used for anything else, using evaporative cooling because republican politicians just ignore their constituents, increasing everyones power bills while erecting gas turbines poisoning the area for a model you don’t have any control over?
Please try to separate local models and the hyperscalers bullshit. Local models stay under local control, don’t need racks full of blackwells or vera rubin, don’t need datacenters at all. All they need is a consumer grade GPU with enough Vram, which would be cheap as fuck if the hyperscalers wouldnt buy up every single last bit of silicon. They are cooled by 1-2 fans and an aluminium block, or if you are getting fancy using a closed loop watercooling solution.
Local LLM’s are not comparable in resource expension at all - they are a small blip, but that blip is at least under control of the person who decided to be independent from all this shit.
I hadn’t, that’s why it seemed strange.
What obliges you to tell me what I can do with my own computer?
Nobody is telling you what you can do, just what you shouldn’t. If you can’t understand the difference, that’s on you.
I don’t see a ‘should’? That’s a straight command. And even if it were there, is it any more reasonable to dictate what people should not do with their computers?
Because you’re an earthling, just like all of us, and LMs are threatening earth, and it is your duty to not use them, especially not for stupid memes. You must stop using LMs on your own computer or anywhere. I am telling you that as your sister on this planet that we both inhabit.
Love you
Ok stow away the hippie crap for a moment. The difference in scale between someone using their personal hardware to run models and the shit the hyperscalers are doing is not even fathomable.
My GPU uses a max of 250W if under full load, which it uses for a few seconds while running a simple request. A single Blackwell blows it out of the water, but those are not provisioned as single boards. They are provided in large racks, containing more CPUs, GPUs, RAM and Storage than i have ever possessed in my life, and i am at it since the early 90s. The difference in resource usage between those 2 scenarios isn’t even measurable because it is simply bonkers.
I honestly can’t tell if you’re joking at my expense or if you’re serious. This thread started to feel like Hexbear for some reason and it makes me want to cry
If you’re joking know that this is a totally believable sentiment for somebody on Lemmy to have.
If you’re serious, then you’re delusional. LLMs themselves can’t threathen anything, they’re not alive. You might be thinking about their power usage or the sentiments of the companies that make them, but none of that is a factor when using them locally. The computer uses the same power regardless of if it’s used to play games or generate text.
Honestly fuck this platform. It is insufferable to post something I had found amusing just to be scolded for not following the Lemmy hivemind. If anyone knows a platform that’s not corporate and doesn’t have such a kneejerk hatred of llms dm me. Goodbye
Lmao if people not wanting to see a user support an industry that’s killing the planet at an alarming scale in such a short time makes you want to leave, then I guess good riddance.
“see if I make weapons at HOME with the gun-O-matic that Lockheed stole and killed so much to produce, I’m not supporting the military industrial complex!”
It’s more about which instance you’re posting in. dbzer0.com for example has far less issues with LLMs and neural networks when run locally - those are practically embraced in the respective communities, while the hyperscalers attempts are loathed as they should be.
Sadly, people conflate local neural networks with the crap they are getting pushed by MS/Meta/OpenAI/Anthropic. Most of them don’t realize the difference in scale between running a local model on a GPU with 16GB VRam and 250W TDP vs even a single rack of Blackwells. They neither have the technical knowledge to separate the two things from another, nor the political knowledge to realize that local NNs empower, while centralized NNs disenfranchise.
A individual running a language model on a single 16gb GPU causes orders of magnitude less environmental damage than buying a carton of almond milk. Please direct your anger where it actually belongs, at the goddamn capitalist vampires building hyperscale datacenters.
You shouldn’t use your computer to use local models out of reach of the Hyperscalers? You shouldn’t use your single GPU with 16 GB Vram because hyperscalers are building datacenters that can’t be used for anything else, using evaporative cooling because republican politicians just ignore their constituents, increasing everyones power bills while erecting gas turbines poisoning the area for a model you don’t have any control over?
Please try to separate local models and the hyperscalers bullshit. Local models stay under local control, don’t need racks full of blackwells or vera rubin, don’t need datacenters at all. All they need is a consumer grade GPU with enough Vram, which would be cheap as fuck if the hyperscalers wouldnt buy up every single last bit of silicon. They are cooled by 1-2 fans and an aluminium block, or if you are getting fancy using a closed loop watercooling solution.
Local LLM’s are not comparable in resource expension at all - they are a small blip, but that blip is at least under control of the person who decided to be independent from all this shit.
nothin, I was trynna make a bit about the general opinion on balahj lemmy, that is: ML bad no matter what.
its a bit, I dont actually take that stance.
Thank you you saved my sanity