[deleted by user]

  • Eager Eagle@lemmy.worldEnglish
    0·
    2 months ago

    I hope people in the us wake the fuck up and these companies start losing users to foreign ones by the millions

  • maegul (he/they)@lemmy.mlEnglish
    0·
    2 months ago

    Probably a shallow response …

    But I always figured AI/LLMs are basically apocalyptic for all sorts of individualistic values in computing (including privacy but also independence and diversity).

    Whether they’re good or useful etc, I just struggle to see how they will ever be justifiable against these sorts of values.

    Sure, local models and our hardware will get better … but better than the state of the art from the big labs and providers? Given that data and training are the big bottlenecks on quality … I struggle to see how AI isn’t a complete feudal capturing of information computing and processing. Not to mention what happens to the pipeline that produces information content if everyone is only consuming it through the models that train on it.

    So for me the big question is, what’s our call on a possible (likely even?) future where we are forever stuck using cloud provided AI along with all of its negatives, in the same way that basically all of us has been and still is stuck using MS windows, Google and the big-social-media hellscape?

    For me, I baulk at this.

      • maegul (he/they)@lemmy.mlEnglish
        0·
        2 months ago

        Oh I hear you (and appreciate the response).

        For me, I can’t help but think of another alternative, which I’m surprised I haven’t heard of yet …

        stripping down one’s personal technological cognitive load to a stack of systems that can fit into one’s brain (like the Python mantra), focusing on learning that stack well building sustainable and stable systems, and then just detoxing from the increasingly polluted digital information stream (protected commons, traditional formats such as books and in person engagement … dunno).

        Depends on what the end goal is, but AIs seem to be about using tech more or just opting out of sovereignty. Something like the above seems to me to be about using tech less (in the end) and pushing toward being a secondary tool rather than an end of its own.

  • utopiah@lemmy.ml
    0·
    2 months ago

    IMHO LLM usage isn’t coherent with independence. That being said I wrote quite a bit on self-hosting LLMs. There are quite a few tools available, like ollama itself relying on llama.cpp that can both work locally and provide an API compatible replacement to cloud services. As you suggested though typically at home one doesn’t have the hardware, GPUs with 100+GB of VRAM, to run the state of the art. There is a middle ground though between full cloud, API key, closed source vs open source at home on low-end hardware : running STOA open models on cloud. It can be done on any cloud but it’s much easier to start with dedicated hardware and tooling, for that HuggingFace is great but there are multiples.

    TL;DR: closed cloud -> models on clouds -> self-hosted provide a better path to independence, including training.

  • steel_for_humans@piefed.socialEnglish
    0·
    2 months ago

    Say I have a GPU with 32GB VRAM and I am on Linux, what local LLM would be good for coding?

    Currently I just have an iGPU ;) but that’s always an option, albeit a very expensive one.

      • steel_for_humans@piefed.socialEnglish
        0·
        2 months ago

        I meant that I can buy one of those Radeons dedicated to AI work, like the ASRock Radeon AI PRO R9700 Creator 32GB GDDR6. If I need to.

        Currently my Ryzen iGPU is all I need, because all I need is to see the graphical desktop environment on my screen ;) It does the job well.

        I use Claude Code as well and I am slightly concerned with that ID verification news, even more so because of the technology partner that they chose.

  • lsjw96kxs@sh.itjust.worksFrançais
    0·
    2 months ago

    Personally, I would like to use AI, but I don’t due to it being non local. I know there are local AI that could do things, but I don’t know which models are the good one for each task. If someone can give me pointers for it, I’d be grateful, for exemple a good model for local coding :)

  • ropatrick@lemmy.world
    0·
    2 months ago

    I love the sound of this but can I ask, if the net goes down and you hardly notice, where do you get your ‘net’ from? Or is it that your intranet doesn’t need internet as such and everything is just local?

    I might have answered my own question there but I’m interested to understand it a bit more.

    Thanks!

      • ropatrick@lemmy.world
        0·
        2 months ago

        OK I have you. You dont need the internet because you have the internet in your terabyte farm. Pretty cool.

        Thanks for the detailed reply.

        One final question, I’m sure its dark at the bottom of the deep rabbit hole you are in, what do you do for batteries for your head torch?! 😀

          • webghost0101@sopuli.xyz
            0·
            2 months ago

            Thats weird, i don’t remember having an alt account called SuspiciousCarrot78 but surely you must be me, same project, same neurology… same fixation pattern.

              • webghost0101@sopuli.xyz
                0·
                2 months ago

                Yep, definitely talking to myself again

                Jokes aside, i haven’t seen you mention anything for media streaming.

                I highly passionately recommend Navidrome for music. It is my absolute favorite and most used self hosted service.

                For acquiring media like film and music depending where you live ripping those from your local library is in some places arguably a protected fair use. (Comes from the time mp3 players became common and runners used to take rented cds in their walkman outside before). In my experience, 480p dvd is much higher quality then internet 480p streams and the total size is much smaller then what you find in downloads.

                ARM can help you automatically rip these as long as you have a drive in your pc. I got ARM running in a proxmox lxc with drive passtrough but that honestly was a pain to setup so not sure you should go that exact route, either way the moment arm is functional its smooth sailing and your only concern becomes storage space.

  • trailee@sh.itjust.works
    0·
    2 months ago

    Even if the tools are not yet there, “they” want to know exactly who asks for code to things like a DIY radar station or autonomous drone control. We’re well into “first they came” territory.