Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. This is bad.

This is bad.

Scheduled Pinned Locked Moved Uncategorized
84 Posts 20 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • xgranade@wandering.shopX xgranade@wandering.shop

    As an addendum, I'm using Python as an example here because it's near and dear to my heart. This is not "Python in particular is exceptionally bad," this is "a very bad thing has been happening in OSS *in general* and Python is now in that blast radius, which makes it harder for me to personally ignore."

    xgranade@wandering.shopX This user is from outside of this forum
    xgranade@wandering.shopX This user is from outside of this forum
    xgranade@wandering.shop
    wrote last edited by
    #56

    As a second addendum, since this has come up in several reply threads, the number of commits is limited so far, and doesn't date back past December 5, 2025 so far as I'm aware of.

    The Python-specific part of that broader problem is, at least to my mind, that there's not a mechanism that I see for limiting that exposure to those commits, to preventing further and more expansive commits in the future.

    1 Reply Last reply
    0
    • clayote@peoplemaking.gamesC clayote@peoplemaking.games

      @xgranade @ireneista Huh, maybe even https://brython.info/ ?

      I thought that project had fizzled out, but no, it supports 3.14

      clayote@peoplemaking.gamesC This user is from outside of this forum
      clayote@peoplemaking.gamesC This user is from outside of this forum
      clayote@peoplemaking.games
      wrote last edited by
      #57

      @xgranade @ireneista Well, MicroPython has an advantage in that it's still written in C, and it is therefore possible to port C extension modules to it, though there aren't that many which really support it yet

      1 Reply Last reply
      0
      • xgranade@wandering.shopX xgranade@wandering.shop

        This is bad. This is very, very bad.

        I'm not trying to pick on Python here, I pick it because Python is something I'm actively using, and so I have a vested interest in the project *not* being AI-vulnerable.

        But it's not good, chat. It's very far from good, in fact.

        srtcd424@mas.toS This user is from outside of this forum
        srtcd424@mas.toS This user is from outside of this forum
        srtcd424@mas.to
        wrote last edited by
        #58

        @xgranade
        Huh, back to perl then I guess? 😞

        xgranade@wandering.shopX 1 Reply Last reply
        0
        • xgranade@wandering.shopX xgranade@wandering.shop

          @SnoopJ @theorangetheme No, absolutely. I see this as the leading indicator rather than the damage itself, if that makes sense?

          I keep using the term "AI-vulnerable" to try and point to that there isn't necessarily an actual direct impact, so much as a dramatically increased vulnerability surface area.

          dave@alvarado.socialD This user is from outside of this forum
          dave@alvarado.socialD This user is from outside of this forum
          dave@alvarado.social
          wrote last edited by
          #59

          @xgranade @SnoopJ @theorangetheme I'm curious--how is Claude directly able to do commits? Why is it not "Claude on behalf of Dave Alvarado"? I understand somebody ran an agent against the code base, but someBODY ran the agent against the code base. Somebody prompted it saying "go find security vulnerabilities in Python".

          It sure would be nice to know who, not just "Claude".

          snoopj@hachyderm.ioS 1 Reply Last reply
          0
          • xgranade@wandering.shopX xgranade@wandering.shop

            @ireneista @glyph I hope it doesn't, if only because I want to be focusing on my specfic and screenplays, but if it does come to that, I very very much so appreciate your support. ♥

            cthos@mastodon.cthos.devC This user is from outside of this forum
            cthos@mastodon.cthos.devC This user is from outside of this forum
            cthos@mastodon.cthos.dev
            wrote last edited by
            #60

            @xgranade @ireneista @glyph *quickly scribbles out a short story involving a fantastical run for the PSF*

            1 Reply Last reply
            0
            • dave@alvarado.socialD dave@alvarado.social

              @xgranade @SnoopJ @theorangetheme I'm curious--how is Claude directly able to do commits? Why is it not "Claude on behalf of Dave Alvarado"? I understand somebody ran an agent against the code base, but someBODY ran the agent against the code base. Somebody prompted it saying "go find security vulnerabilities in Python".

              It sure would be nice to know who, not just "Claude".

              snoopj@hachyderm.ioS This user is from outside of this forum
              snoopj@hachyderm.ioS This user is from outside of this forum
              snoopj@hachyderm.io
              wrote last edited by
              #61

              @dave @xgranade @theorangetheme I'm not sure I really understand the question. In the commits above, it's a co-author rather than a primary author.

              But in the general case, it's able to do it by running the command that adds a commit, in a context where the configured name/email for use with `git` will be the name/email associated with the model (the author metadata includes the specific model as well)

              Creating such commits without indication of the human involvement (wherever it originated, since Rube Goldberg contraptions are all the rage right now) is IMO unethical but far from unimaginable.

              dave@alvarado.socialD 1 Reply Last reply
              0
              • srtcd424@mas.toS srtcd424@mas.to

                @xgranade
                Huh, back to perl then I guess? 😞

                xgranade@wandering.shopX This user is from outside of this forum
                xgranade@wandering.shopX This user is from outside of this forum
                xgranade@wandering.shop
                wrote last edited by
                #62

                @srtcd424 If that's what's useful to you? But I don't personally recommend moving away from Python, nor do I think that's an effective tactic for dealing with the problem.

                As mentioned, this is a broad problem in OSS *in general*, and Python is now in the blast radius of that problem. Trying to create a dependency path that doesn't include any AI-vulnerable code is very difficult right now.

                srtcd424@mas.toS 1 Reply Last reply
                0
                • snoopj@hachyderm.ioS snoopj@hachyderm.io

                  @dave @xgranade @theorangetheme I'm not sure I really understand the question. In the commits above, it's a co-author rather than a primary author.

                  But in the general case, it's able to do it by running the command that adds a commit, in a context where the configured name/email for use with `git` will be the name/email associated with the model (the author metadata includes the specific model as well)

                  Creating such commits without indication of the human involvement (wherever it originated, since Rube Goldberg contraptions are all the rage right now) is IMO unethical but far from unimaginable.

                  dave@alvarado.socialD This user is from outside of this forum
                  dave@alvarado.socialD This user is from outside of this forum
                  dave@alvarado.social
                  wrote last edited by
                  #63

                  @SnoopJ @xgranade @theorangetheme gotcha. On second look, I see that you were grepping, I misunderstood what I was reading there.

                  As I've thought about it some more, I think I'm standing by my take. IMO the fact that you contributed with Claude is barely more interesting than the fact that you contributed with VS Code. I think that "oh I used an LLM/Agent" is not a defense against, well, anything.

                  dave@alvarado.socialD xgranade@wandering.shopX 2 Replies Last reply
                  0
                  • dave@alvarado.socialD dave@alvarado.social

                    @SnoopJ @xgranade @theorangetheme gotcha. On second look, I see that you were grepping, I misunderstood what I was reading there.

                    As I've thought about it some more, I think I'm standing by my take. IMO the fact that you contributed with Claude is barely more interesting than the fact that you contributed with VS Code. I think that "oh I used an LLM/Agent" is not a defense against, well, anything.

                    dave@alvarado.socialD This user is from outside of this forum
                    dave@alvarado.socialD This user is from outside of this forum
                    dave@alvarado.social
                    wrote last edited by
                    #64

                    @SnoopJ @xgranade @theorangetheme I don't think we should be personifying LLMs by calling them "co-authors". Claude didn't author, it recursively autocompleted.

                    xgranade@wandering.shopX 1 Reply Last reply
                    0
                    • dave@alvarado.socialD dave@alvarado.social

                      @SnoopJ @xgranade @theorangetheme gotcha. On second look, I see that you were grepping, I misunderstood what I was reading there.

                      As I've thought about it some more, I think I'm standing by my take. IMO the fact that you contributed with Claude is barely more interesting than the fact that you contributed with VS Code. I think that "oh I used an LLM/Agent" is not a defense against, well, anything.

                      xgranade@wandering.shopX This user is from outside of this forum
                      xgranade@wandering.shopX This user is from outside of this forum
                      xgranade@wandering.shop
                      wrote last edited by
                      #65

                      @dave @SnoopJ @theorangetheme It's not interesting, but it is important as part of understanding the vulnerability surface introduced by that code. There are many things about code that are simultaneously boring as fuck and also critically important.

                      dave@alvarado.socialD 1 Reply Last reply
                      0
                      • dave@alvarado.socialD dave@alvarado.social

                        @SnoopJ @xgranade @theorangetheme I don't think we should be personifying LLMs by calling them "co-authors". Claude didn't author, it recursively autocompleted.

                        xgranade@wandering.shopX This user is from outside of this forum
                        xgranade@wandering.shopX This user is from outside of this forum
                        xgranade@wandering.shop
                        wrote last edited by
                        #66

                        @dave @SnoopJ @theorangetheme I don't even disagree, but that's the signal that Claude gives us, and there's no Git metadata for "this code was extruded by $x slop machine."

                        1 Reply Last reply
                        0
                        • astraluma@tacobelllabs.netA astraluma@tacobelllabs.net

                          @xgranade oh, it looks like the warning is complicated?

                          https://github.com/python/cpython/commits?author=claude shows no commits

                          so idk what exactly the warning is saying

                          nausicaa@xoxo.zoneN This user is from outside of this forum
                          nausicaa@xoxo.zoneN This user is from outside of this forum
                          nausicaa@xoxo.zone
                          wrote last edited by
                          #67

                          @astraluma @xgranade If you search for 'claude' you can find the commits where Claude is a "co-author" https://github.com/search?q=repo%3Apython%2Fcpython+claude&type=commits

                          xgranade@wandering.shopX 1 Reply Last reply
                          0
                          • nausicaa@xoxo.zoneN nausicaa@xoxo.zone

                            @astraluma @xgranade If you search for 'claude' you can find the commits where Claude is a "co-author" https://github.com/search?q=repo%3Apython%2Fcpython+claude&type=commits

                            xgranade@wandering.shopX This user is from outside of this forum
                            xgranade@wandering.shopX This user is from outside of this forum
                            xgranade@wandering.shop
                            wrote last edited by
                            #68

                            @nausicaa @astraluma As @joelle pointed out, Claude is also a name that real people have. @SnoopJ's cantrip is going to be less susceptible to false positives by filtering on "anthropic.com" as well.

                            SnoopJ (@SnoopJ@hachyderm.io)

                            @theorangetheme@en.osm.town @xgranade@wandering.shop here are the commits on `main` where it's explicitly a co-author: (Edit: I missed a few commits because I hadn't pulled :picardfacepalm:) ``` $ git log --oneline -i --grep "Co-authored-by: Claude.*anthropic\.com" 300de1e98ac gh-86519: Add prefixmatch APIs to the re module (GH-31137) ac8b5b68900 gh-143650: Fix importlib race condition on import failure (GH-143651) 9b8d59c136c gh-72798: Add mapping example to str.translate documentation (#144454) 34e5a63f145 gh-141444: Replace dead URL in urllib.robotparser example (GH-144443) 59f247e43bc gh-115952: Fix a potential virtual memory allocation denial of service in pickle (GH-119204) 5b1862bdd80 gh-87512: Fix `subprocess` using `timeout=` on Windows blocking with a large `input=` (GH-142058) cc6bc4c97f7 GH-134453: Fix subprocess memoryview input handling on POSIX (GH-134949) 532c37695d0 gh-137134: Update SQLite to 3.50.4 for binary releases (GH-137135) ```

                            favicon

                            Hachyderm.io (hachyderm.io)

                            joelle@social.joelle.usJ nausicaa@xoxo.zoneN 2 Replies Last reply
                            0
                            • xgranade@wandering.shopX xgranade@wandering.shop

                              @srtcd424 If that's what's useful to you? But I don't personally recommend moving away from Python, nor do I think that's an effective tactic for dealing with the problem.

                              As mentioned, this is a broad problem in OSS *in general*, and Python is now in the blast radius of that problem. Trying to create a dependency path that doesn't include any AI-vulnerable code is very difficult right now.

                              srtcd424@mas.toS This user is from outside of this forum
                              srtcd424@mas.toS This user is from outside of this forum
                              srtcd424@mas.to
                              wrote last edited by
                              #69

                              @xgranade
                              Yeah, sorry, it was dark humour. I'm honestly terrified about where all this heading 😞 Not personally a python fan probably due to my vintage but it's used for a frightening proportion of software I rely on.

                              xgranade@wandering.shopX 1 Reply Last reply
                              0
                              • xgranade@wandering.shopX xgranade@wandering.shop

                                @dave @SnoopJ @theorangetheme It's not interesting, but it is important as part of understanding the vulnerability surface introduced by that code. There are many things about code that are simultaneously boring as fuck and also critically important.

                                dave@alvarado.socialD This user is from outside of this forum
                                dave@alvarado.socialD This user is from outside of this forum
                                dave@alvarado.social
                                wrote last edited by
                                #70

                                @xgranade @SnoopJ @theorangetheme yeah I've been thinking about that, and I'm not sure I agree. The outputted code is the outputted code. "y = x + 1" doesn't gain additional attack surface because Claude autocompleted it.

                                I think there are all sorts of *human* exploits that can happen and are happening, but those are all based on our laziness checking Claude's work, not Claude's output itself. Things like maintainers going "Jesus take the wheel" when Claude writes commits because it's easier

                                dave@alvarado.socialD xgranade@wandering.shopX 2 Replies Last reply
                                0
                                • srtcd424@mas.toS srtcd424@mas.to

                                  @xgranade
                                  Yeah, sorry, it was dark humour. I'm honestly terrified about where all this heading 😞 Not personally a python fan probably due to my vintage but it's used for a frightening proportion of software I rely on.

                                  xgranade@wandering.shopX This user is from outside of this forum
                                  xgranade@wandering.shopX This user is from outside of this forum
                                  xgranade@wandering.shop
                                  wrote last edited by
                                  #71

                                  @srtcd424 No need to apologize, I just want to be clear about my own views on this rather than inadvertently implying criticism of Python *in particular* that I neither mean nor want to make.

                                  srtcd424@mas.toS 1 Reply Last reply
                                  0
                                  • dave@alvarado.socialD dave@alvarado.social

                                    @xgranade @SnoopJ @theorangetheme yeah I've been thinking about that, and I'm not sure I agree. The outputted code is the outputted code. "y = x + 1" doesn't gain additional attack surface because Claude autocompleted it.

                                    I think there are all sorts of *human* exploits that can happen and are happening, but those are all based on our laziness checking Claude's work, not Claude's output itself. Things like maintainers going "Jesus take the wheel" when Claude writes commits because it's easier

                                    dave@alvarado.socialD This user is from outside of this forum
                                    dave@alvarado.socialD This user is from outside of this forum
                                    dave@alvarado.social
                                    wrote last edited by
                                    #72

                                    @xgranade @SnoopJ @theorangetheme please don't read any of this as my endorsement of slop, I can't stand it. I'm just trying to pick apart how code autocompleted by Claude is different from the moral hazard of trusting Claude in the first place.

                                    1 Reply Last reply
                                    0
                                    • dave@alvarado.socialD dave@alvarado.social

                                      @xgranade @SnoopJ @theorangetheme yeah I've been thinking about that, and I'm not sure I agree. The outputted code is the outputted code. "y = x + 1" doesn't gain additional attack surface because Claude autocompleted it.

                                      I think there are all sorts of *human* exploits that can happen and are happening, but those are all based on our laziness checking Claude's work, not Claude's output itself. Things like maintainers going "Jesus take the wheel" when Claude writes commits because it's easier

                                      xgranade@wandering.shopX This user is from outside of this forum
                                      xgranade@wandering.shopX This user is from outside of this forum
                                      xgranade@wandering.shop
                                      wrote last edited by
                                      #73

                                      @dave @SnoopJ @theorangetheme My views here are complicated, but let me try and give a somewhat accurate condensed version?

                                      First, to your `y = x + 1` example, if the code is simple enough, that vulnerability can be mitigated by human review — the problem is still there, I contend, but was contained by review. The problem is that humans *suck* at scanning for that kind of problem. Take the TSA looking for guns in x-ray scans... they keep failing at that, and incredibly badly.

                                      xgranade@wandering.shopX 1 Reply Last reply
                                      0
                                      • xgranade@wandering.shopX xgranade@wandering.shop

                                        @srtcd424 No need to apologize, I just want to be clear about my own views on this rather than inadvertently implying criticism of Python *in particular* that I neither mean nor want to make.

                                        srtcd424@mas.toS This user is from outside of this forum
                                        srtcd424@mas.toS This user is from outside of this forum
                                        srtcd424@mas.to
                                        wrote last edited by
                                        #74

                                        @xgranade
                                        Yeah, fair. It feels like we're fish trapped in a pool of trustworthy software that's rapidly drying up & shrinking 😞

                                        1 Reply Last reply
                                        0
                                        • xgranade@wandering.shopX xgranade@wandering.shop

                                          @nausicaa @astraluma As @joelle pointed out, Claude is also a name that real people have. @SnoopJ's cantrip is going to be less susceptible to false positives by filtering on "anthropic.com" as well.

                                          SnoopJ (@SnoopJ@hachyderm.io)

                                          @theorangetheme@en.osm.town @xgranade@wandering.shop here are the commits on `main` where it's explicitly a co-author: (Edit: I missed a few commits because I hadn't pulled :picardfacepalm:) ``` $ git log --oneline -i --grep "Co-authored-by: Claude.*anthropic\.com" 300de1e98ac gh-86519: Add prefixmatch APIs to the re module (GH-31137) ac8b5b68900 gh-143650: Fix importlib race condition on import failure (GH-143651) 9b8d59c136c gh-72798: Add mapping example to str.translate documentation (#144454) 34e5a63f145 gh-141444: Replace dead URL in urllib.robotparser example (GH-144443) 59f247e43bc gh-115952: Fix a potential virtual memory allocation denial of service in pickle (GH-119204) 5b1862bdd80 gh-87512: Fix `subprocess` using `timeout=` on Windows blocking with a large `input=` (GH-142058) cc6bc4c97f7 GH-134453: Fix subprocess memoryview input handling on POSIX (GH-134949) 532c37695d0 gh-137134: Update SQLite to 3.50.4 for binary releases (GH-137135) ```

                                          favicon

                                          Hachyderm.io (hachyderm.io)

                                          joelle@social.joelle.usJ This user is from outside of this forum
                                          joelle@social.joelle.usJ This user is from outside of this forum
                                          joelle@social.joelle.us
                                          wrote last edited by
                                          #75

                                          @xgranade @nausicaa @astraluma @SnoopJ

                                          Also sometimes it's in the *commit message* that Claude helped, rather than in the user or first line of the commit, so --oneline probably isn't what you want either.

                                          xgranade@wandering.shopX 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups