• Turret3857@infosec.pub
    link
    fedilink
    English
    arrow-up
    8
    ·
    1 day ago

    I mean, I get where you’re coming from, but an open-source AI (as defined by the foundation that escapes my mind ATM) would designate that the data set and source code are both open and free to the public. It would be entirely ethical, even more-so if youre a green-energy user. I’m no fan of AI myself, but if I had to use it, I would prefer an approach where its not a black box doing god knows what with whoever’s property/data/images

      • nagaram@startrek.website
        link
        fedilink
        English
        arrow-up
        15
        arrow-down
        1
        ·
        edit-2
        2 days ago

        Which is funny since that does solve a lot of the problems.

        If it’s completely open source at least.

        Like OS data sets and model that can be ran locally means it’s not trained on stolen data and it’s not spying on people for more data.

        And if it runs locally on a GPU, it’s no worse for the environment than gaming. Really the big problem with the data center compute is the infrastructure of getting that data around.

        • thesmokingman@programming.dev
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          3
          ·
          2 days ago

          Blockchain mining, completely open source and run on local GPUs, is no worse for the environment than gaming via this logic. I think that’s easily disprovable.

          • psychadlligoat@piefed.social
            link
            fedilink
            English
            arrow-up
            6
            arrow-down
            1
            ·
            2 days ago

            except Blockchain mining has no practical use that can’t be solved using simpler tech, AI does have those applications

            • thesmokingman@programming.dev
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              2 days ago

              Not yet, not for some time, and certainly not at single local GPU running at minimal use. Both you and the commenter I was responding to seem to forget how massive the @home projects were.

              • nagaram@startrek.website
                link
                fedilink
                English
                arrow-up
                3
                ·
                23 hours ago

                For simply productivity like Copilot or Text Gen like ChatGPT.

                It absolutely is doable on a local GPU.

                Source: I do it.

                Sure I can’t do auto running simulations to find new drugs and protein sequencing or whatever. But it helps me code. It helps me digest software manuals. That’s honestly all I want

                Also, massive compute projects for the @home project are good?

                Local LLMs runs fine on a 5 year old GPU, a 3060 12 gig. I am getting performance on par with cloud ran models. I’m upgrading to a 5060ti just because I wanted to play with image Gen.

      • Smorty [she/her]@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        edit-2
        1 day ago

        hmm - oki?..,… bt also whad doed the “lead” mean in dis case? thads my main confus

        oh yes alsuualsuu like - i feel open-source llm moldes like the granite ones from IMB (where u cn actulli hav a look at where the training data came from) r like - kindsa cool… open weight on the othr hand is jus like proprietary bt with a nicer brandin

        • Wugmeister@lemmy.dbzer0.com
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 day ago

          The lead is a metaphor for how training an AI uses a shit-ton of energy, and if its a Corp training it the water used to cool the GPUs is often dumped straight into a local river, which does bad things to the stuff living in the river.

          It could also be referring to how the training data is usually scraped from all across the internet, but I think this person is specifically concerned with the environmental cost.

        • astropenguin5@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          1 day ago

          I’m pretty sure the ‘lead’ is just a metaphor for a ‘bad thing’. I’m not really sure how it applies to ai or anything tho, besides maybe the stealing of people’s data and art and things to train on.

          That’s just a guess tho it is rather confusing