Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. This is bad.

This is bad.

Scheduled Pinned Locked Moved Uncategorized
84 Posts 20 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • xgranade@wandering.shopX xgranade@wandering.shop

    This is bad. This is very, very bad.

    I'm not trying to pick on Python here, I pick it because Python is something I'm actively using, and so I have a vested interest in the project *not* being AI-vulnerable.

    But it's not good, chat. It's very far from good, in fact.

    xgranade@wandering.shopX This user is from outside of this forum
    xgranade@wandering.shopX This user is from outside of this forum
    xgranade@wandering.shop
    wrote last edited by
    #46

    As an addendum, I'm using Python as an example here because it's near and dear to my heart. This is not "Python in particular is exceptionally bad," this is "a very bad thing has been happening in OSS *in general* and Python is now in that blast radius, which makes it harder for me to personally ignore."

    xgranade@wandering.shopX 1 Reply Last reply
    0
    • clayote@peoplemaking.gamesC clayote@peoplemaking.games

      @xgranade @ireneista Keep an eye on MicroPython; https://pyscript.net supports it as a backend, where it has the obvious benefit of, well, being small

      clayote@peoplemaking.gamesC This user is from outside of this forum
      clayote@peoplemaking.gamesC This user is from outside of this forum
      clayote@peoplemaking.games
      wrote last edited by
      #47

      @xgranade @ireneista Huh, maybe even https://brython.info/ ?

      I thought that project had fizzled out, but no, it supports 3.14

      clayote@peoplemaking.gamesC 1 Reply Last reply
      0
      • xgranade@wandering.shopX xgranade@wandering.shop

        @MissingClara I agree it's a hard problem, but it's one that is quickly eroding norms and trust in open source, and I think it's worth taking a firm stance on that?

        Even if people lie and ignore that stance, that still sets a community value and prevents casual usage, plus gives a clear path towards banning those contributors who lie about their own usage?

        missingclara@chaos.socialM This user is from outside of this forum
        missingclara@chaos.socialM This user is from outside of this forum
        missingclara@chaos.social
        wrote last edited by
        #48

        @xgranade I agree, but it's not up to me 🫤

        xgranade@wandering.shopX 1 Reply Last reply
        0
        • xgranade@wandering.shopX xgranade@wandering.shop

          This is bad. This is very, very bad.

          I'm not trying to pick on Python here, I pick it because Python is something I'm actively using, and so I have a vested interest in the project *not* being AI-vulnerable.

          But it's not good, chat. It's very far from good, in fact.

          reillypascal@hachyderm.ioR This user is from outside of this forum
          reillypascal@hachyderm.ioR This user is from outside of this forum
          reillypascal@hachyderm.io
          wrote last edited by
          #49

          @xgranade I also saw this on Neovim and Wezterm, both of which I really love. On those projects, it seems to be extremely minor stuff, but it's still extremely depressing.

          I was just getting into Python lately too! I started with JavaScript, and then went right to C++/C/Rust since I wanted to do realtime DSP. There's a Python library called Abjad for manipulating Lilypond musical notation that's really cool to play with, but this puts a bit of a damper on that excitement.

          xgranade@wandering.shopX 1 Reply Last reply
          0
          • missingclara@chaos.socialM missingclara@chaos.social

            @xgranade I agree, but it's not up to me 🫤

            xgranade@wandering.shopX This user is from outside of this forum
            xgranade@wandering.shopX This user is from outside of this forum
            xgranade@wandering.shop
            wrote last edited by
            #50

            @MissingClara No, that's completely fair, and it's why I'm not out to pick on Python in particular here (wrote a follow up to try and make that very clear, sorry if I wasn't clear from the get-go). This is a problem across OSS in general, and doesn't have easy solutions... I just also don't want to give up because it's difficult? But I recognize that it's a messy problem for something as large as Python, especially.

            1 Reply Last reply
            0
            • reillypascal@hachyderm.ioR reillypascal@hachyderm.io

              @xgranade I also saw this on Neovim and Wezterm, both of which I really love. On those projects, it seems to be extremely minor stuff, but it's still extremely depressing.

              I was just getting into Python lately too! I started with JavaScript, and then went right to C++/C/Rust since I wanted to do realtime DSP. There's a Python library called Abjad for manipulating Lilypond musical notation that's really cool to play with, but this puts a bit of a damper on that excitement.

              xgranade@wandering.shopX This user is from outside of this forum
              xgranade@wandering.shopX This user is from outside of this forum
              xgranade@wandering.shop
              wrote last edited by
              #51

              @reillypascal To be fair, the number of commits on CPython itself seems to be rather limited at this point. But it's more that I don't see the opposition needed to contain the problem to those commits. As I said in another thread, I see this more as a very bad leading indicator rather than immediately catastrophic.

              1 Reply Last reply
              0
              • ireneista@adhd.irenes.spaceI ireneista@adhd.irenes.space

                @xgranade @glyph we will absolutely figure out what we need to do to be eligible to vote, and vote for you, if it comes to that

                xgranade@wandering.shopX This user is from outside of this forum
                xgranade@wandering.shopX This user is from outside of this forum
                xgranade@wandering.shop
                wrote last edited by
                #52

                @ireneista @glyph I hope it doesn't, if only because I want to be focusing on my specfic and screenplays, but if it does come to that, I very very much so appreciate your support. ♥

                cthos@mastodon.cthos.devC 1 Reply Last reply
                0
                • xgranade@wandering.shopX xgranade@wandering.shop

                  This is bad. This is very, very bad.

                  I'm not trying to pick on Python here, I pick it because Python is something I'm actively using, and so I have a vested interest in the project *not* being AI-vulnerable.

                  But it's not good, chat. It's very far from good, in fact.

                  aparrish@friend.campA This user is from outside of this forum
                  aparrish@friend.campA This user is from outside of this forum
                  aparrish@friend.camp
                  wrote last edited by
                  #53

                  @xgranade ugh ugh UGH

                  1 Reply Last reply
                  0
                  • xgranade@wandering.shopX xgranade@wandering.shop

                    This is bad. This is very, very bad.

                    I'm not trying to pick on Python here, I pick it because Python is something I'm actively using, and so I have a vested interest in the project *not* being AI-vulnerable.

                    But it's not good, chat. It's very far from good, in fact.

                    joelle@social.joelle.usJ This user is from outside of this forum
                    joelle@social.joelle.usJ This user is from outside of this forum
                    joelle@social.joelle.us
                    wrote last edited by
                    #54

                    @xgranade
                    Looks like about a dozen commits reference Claude in the commit message or authorship. Note to others: you have to do a bit more work than just "grep -i claude", as there are humans that are named Claude too. But the Anthropic Claude is definitely in there, which raises some legal questions about copyright I think.

                    xgranade@wandering.shopX 1 Reply Last reply
                    0
                    • joelle@social.joelle.usJ joelle@social.joelle.us

                      @xgranade
                      Looks like about a dozen commits reference Claude in the commit message or authorship. Note to others: you have to do a bit more work than just "grep -i claude", as there are humans that are named Claude too. But the Anthropic Claude is definitely in there, which raises some legal questions about copyright I think.

                      xgranade@wandering.shopX This user is from outside of this forum
                      xgranade@wandering.shopX This user is from outside of this forum
                      xgranade@wandering.shop
                      wrote last edited by
                      #55

                      @joelle Yeah, at least one list of commits that I saw also grepped for anthropic.com, but that's a very good point.

                      Anyway, with respect to it being about a dozen, yes, this is fairly limited in its impact so far, but what worries me is that Python itself is in the blast radius of Anthropic's efforts to enclose OSS at *all*, and with seemingly no processes in place to limit that exposure.

                      It's part of why I've taken to referring to this kind of problem as "AI-vulnerable."

                      1 Reply Last reply
                      0
                      • xgranade@wandering.shopX xgranade@wandering.shop

                        As an addendum, I'm using Python as an example here because it's near and dear to my heart. This is not "Python in particular is exceptionally bad," this is "a very bad thing has been happening in OSS *in general* and Python is now in that blast radius, which makes it harder for me to personally ignore."

                        xgranade@wandering.shopX This user is from outside of this forum
                        xgranade@wandering.shopX This user is from outside of this forum
                        xgranade@wandering.shop
                        wrote last edited by
                        #56

                        As a second addendum, since this has come up in several reply threads, the number of commits is limited so far, and doesn't date back past December 5, 2025 so far as I'm aware of.

                        The Python-specific part of that broader problem is, at least to my mind, that there's not a mechanism that I see for limiting that exposure to those commits, to preventing further and more expansive commits in the future.

                        1 Reply Last reply
                        0
                        • clayote@peoplemaking.gamesC clayote@peoplemaking.games

                          @xgranade @ireneista Huh, maybe even https://brython.info/ ?

                          I thought that project had fizzled out, but no, it supports 3.14

                          clayote@peoplemaking.gamesC This user is from outside of this forum
                          clayote@peoplemaking.gamesC This user is from outside of this forum
                          clayote@peoplemaking.games
                          wrote last edited by
                          #57

                          @xgranade @ireneista Well, MicroPython has an advantage in that it's still written in C, and it is therefore possible to port C extension modules to it, though there aren't that many which really support it yet

                          1 Reply Last reply
                          0
                          • xgranade@wandering.shopX xgranade@wandering.shop

                            This is bad. This is very, very bad.

                            I'm not trying to pick on Python here, I pick it because Python is something I'm actively using, and so I have a vested interest in the project *not* being AI-vulnerable.

                            But it's not good, chat. It's very far from good, in fact.

                            srtcd424@mas.toS This user is from outside of this forum
                            srtcd424@mas.toS This user is from outside of this forum
                            srtcd424@mas.to
                            wrote last edited by
                            #58

                            @xgranade
                            Huh, back to perl then I guess? 😞

                            xgranade@wandering.shopX 1 Reply Last reply
                            0
                            • xgranade@wandering.shopX xgranade@wandering.shop

                              @SnoopJ @theorangetheme No, absolutely. I see this as the leading indicator rather than the damage itself, if that makes sense?

                              I keep using the term "AI-vulnerable" to try and point to that there isn't necessarily an actual direct impact, so much as a dramatically increased vulnerability surface area.

                              dave@alvarado.socialD This user is from outside of this forum
                              dave@alvarado.socialD This user is from outside of this forum
                              dave@alvarado.social
                              wrote last edited by
                              #59

                              @xgranade @SnoopJ @theorangetheme I'm curious--how is Claude directly able to do commits? Why is it not "Claude on behalf of Dave Alvarado"? I understand somebody ran an agent against the code base, but someBODY ran the agent against the code base. Somebody prompted it saying "go find security vulnerabilities in Python".

                              It sure would be nice to know who, not just "Claude".

                              snoopj@hachyderm.ioS 1 Reply Last reply
                              0
                              • xgranade@wandering.shopX xgranade@wandering.shop

                                @ireneista @glyph I hope it doesn't, if only because I want to be focusing on my specfic and screenplays, but if it does come to that, I very very much so appreciate your support. ♥

                                cthos@mastodon.cthos.devC This user is from outside of this forum
                                cthos@mastodon.cthos.devC This user is from outside of this forum
                                cthos@mastodon.cthos.dev
                                wrote last edited by
                                #60

                                @xgranade @ireneista @glyph *quickly scribbles out a short story involving a fantastical run for the PSF*

                                1 Reply Last reply
                                0
                                • dave@alvarado.socialD dave@alvarado.social

                                  @xgranade @SnoopJ @theorangetheme I'm curious--how is Claude directly able to do commits? Why is it not "Claude on behalf of Dave Alvarado"? I understand somebody ran an agent against the code base, but someBODY ran the agent against the code base. Somebody prompted it saying "go find security vulnerabilities in Python".

                                  It sure would be nice to know who, not just "Claude".

                                  snoopj@hachyderm.ioS This user is from outside of this forum
                                  snoopj@hachyderm.ioS This user is from outside of this forum
                                  snoopj@hachyderm.io
                                  wrote last edited by
                                  #61

                                  @dave @xgranade @theorangetheme I'm not sure I really understand the question. In the commits above, it's a co-author rather than a primary author.

                                  But in the general case, it's able to do it by running the command that adds a commit, in a context where the configured name/email for use with `git` will be the name/email associated with the model (the author metadata includes the specific model as well)

                                  Creating such commits without indication of the human involvement (wherever it originated, since Rube Goldberg contraptions are all the rage right now) is IMO unethical but far from unimaginable.

                                  dave@alvarado.socialD 1 Reply Last reply
                                  0
                                  • srtcd424@mas.toS srtcd424@mas.to

                                    @xgranade
                                    Huh, back to perl then I guess? 😞

                                    xgranade@wandering.shopX This user is from outside of this forum
                                    xgranade@wandering.shopX This user is from outside of this forum
                                    xgranade@wandering.shop
                                    wrote last edited by
                                    #62

                                    @srtcd424 If that's what's useful to you? But I don't personally recommend moving away from Python, nor do I think that's an effective tactic for dealing with the problem.

                                    As mentioned, this is a broad problem in OSS *in general*, and Python is now in the blast radius of that problem. Trying to create a dependency path that doesn't include any AI-vulnerable code is very difficult right now.

                                    srtcd424@mas.toS 1 Reply Last reply
                                    0
                                    • snoopj@hachyderm.ioS snoopj@hachyderm.io

                                      @dave @xgranade @theorangetheme I'm not sure I really understand the question. In the commits above, it's a co-author rather than a primary author.

                                      But in the general case, it's able to do it by running the command that adds a commit, in a context where the configured name/email for use with `git` will be the name/email associated with the model (the author metadata includes the specific model as well)

                                      Creating such commits without indication of the human involvement (wherever it originated, since Rube Goldberg contraptions are all the rage right now) is IMO unethical but far from unimaginable.

                                      dave@alvarado.socialD This user is from outside of this forum
                                      dave@alvarado.socialD This user is from outside of this forum
                                      dave@alvarado.social
                                      wrote last edited by
                                      #63

                                      @SnoopJ @xgranade @theorangetheme gotcha. On second look, I see that you were grepping, I misunderstood what I was reading there.

                                      As I've thought about it some more, I think I'm standing by my take. IMO the fact that you contributed with Claude is barely more interesting than the fact that you contributed with VS Code. I think that "oh I used an LLM/Agent" is not a defense against, well, anything.

                                      dave@alvarado.socialD xgranade@wandering.shopX 2 Replies Last reply
                                      0
                                      • dave@alvarado.socialD dave@alvarado.social

                                        @SnoopJ @xgranade @theorangetheme gotcha. On second look, I see that you were grepping, I misunderstood what I was reading there.

                                        As I've thought about it some more, I think I'm standing by my take. IMO the fact that you contributed with Claude is barely more interesting than the fact that you contributed with VS Code. I think that "oh I used an LLM/Agent" is not a defense against, well, anything.

                                        dave@alvarado.socialD This user is from outside of this forum
                                        dave@alvarado.socialD This user is from outside of this forum
                                        dave@alvarado.social
                                        wrote last edited by
                                        #64

                                        @SnoopJ @xgranade @theorangetheme I don't think we should be personifying LLMs by calling them "co-authors". Claude didn't author, it recursively autocompleted.

                                        xgranade@wandering.shopX 1 Reply Last reply
                                        0
                                        • dave@alvarado.socialD dave@alvarado.social

                                          @SnoopJ @xgranade @theorangetheme gotcha. On second look, I see that you were grepping, I misunderstood what I was reading there.

                                          As I've thought about it some more, I think I'm standing by my take. IMO the fact that you contributed with Claude is barely more interesting than the fact that you contributed with VS Code. I think that "oh I used an LLM/Agent" is not a defense against, well, anything.

                                          xgranade@wandering.shopX This user is from outside of this forum
                                          xgranade@wandering.shopX This user is from outside of this forum
                                          xgranade@wandering.shop
                                          wrote last edited by
                                          #65

                                          @dave @SnoopJ @theorangetheme It's not interesting, but it is important as part of understanding the vulnerability surface introduced by that code. There are many things about code that are simultaneously boring as fuck and also critically important.

                                          dave@alvarado.socialD 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups