Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise.

My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise.

Scheduled Pinned Locked Moved Uncategorized
44 Posts 24 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

    @krig which is why we also make bikes and scooters – convenient tools that can be used by all ages and abilities

    krig@goto.liten.appK This user is from outside of this forum
    krig@goto.liten.appK This user is from outside of this forum
    krig@goto.liten.app
    wrote last edited by
    #18

    @jonathanhogg good point! I think I see what you meant now. I miss the old visual basic and how easy it was to make tools using it without knowing any programming, really.

    1 Reply Last reply
    0
    • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

      I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

      dasgrueneblatt@wien.rocksD This user is from outside of this forum
      dasgrueneblatt@wien.rocksD This user is from outside of this forum
      dasgrueneblatt@wien.rocks
      wrote last edited by
      #19

      @jonathanhogg No, it's still difficult to program something so that it's exactly how you want it to be. It's apparently been underestimated how often that doesn't matter ("mostly working app" where getting it to working is more effort than starting from scratch), but we will see how that develops in the long run. Maybe plausible deniability is really enough for many things.

      Nobody is gatekeeping clear, testable requirements and communication without misunderstandings. People usually just can't do that.

      jonathanhogg@mastodon.socialJ 1 Reply Last reply
      0
      • michael@toot.mynameismwd.orgM michael@toot.mynameismwd.org

        @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

        Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

        tobyjaffey@mastodon.me.ukT This user is from outside of this forum
        tobyjaffey@mastodon.me.ukT This user is from outside of this forum
        tobyjaffey@mastodon.me.uk
        wrote last edited by
        #20

        @michael @jarkman @jonathanhogg (IMO) we can't have more DSLs because everything useful is now plumbed together from a series of heterogenous parts and we've somehow decided they can only interoperate at the (barbaric) C ABI level, or the (absurdly inefficient) web level. So, we rely on general purpose languages using specialised libraries, instead of the other way around.
        I think fixing this boundary/contract problem would fix a lot in s/w engineering.

        1 Reply Last reply
        0
        • dasgrueneblatt@wien.rocksD dasgrueneblatt@wien.rocks

          @jonathanhogg No, it's still difficult to program something so that it's exactly how you want it to be. It's apparently been underestimated how often that doesn't matter ("mostly working app" where getting it to working is more effort than starting from scratch), but we will see how that develops in the long run. Maybe plausible deniability is really enough for many things.

          Nobody is gatekeeping clear, testable requirements and communication without misunderstandings. People usually just can't do that.

          jonathanhogg@mastodon.socialJ This user is from outside of this forum
          jonathanhogg@mastodon.socialJ This user is from outside of this forum
          jonathanhogg@mastodon.social
          wrote last edited by
          #21

          @dasgrueneblatt I have now spent 40 years programming commercially in dozens of different languages; I have taught programming to CS students, art students and little kids and my experience is that most programming is hard because we have made it so. I absolutely understand the frustration of people who know what their problem is, but don't feel equipped to solve it because the tools available to them are too big and confusing. Vibe coding is our own fault

          dasgrueneblatt@wien.rocksD 1 Reply Last reply
          0
          • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

            @dasgrueneblatt I have now spent 40 years programming commercially in dozens of different languages; I have taught programming to CS students, art students and little kids and my experience is that most programming is hard because we have made it so. I absolutely understand the frustration of people who know what their problem is, but don't feel equipped to solve it because the tools available to them are too big and confusing. Vibe coding is our own fault

            dasgrueneblatt@wien.rocksD This user is from outside of this forum
            dasgrueneblatt@wien.rocksD This user is from outside of this forum
            dasgrueneblatt@wien.rocks
            wrote last edited by
            #22

            @jonathanhogg Well yes, but vibe coding does not solve that, or does it? People kind of know what they want, but they still cannot get it. Just something that looks like it and is really hard to debug. That's got be even more frustrating? Maybe I misunderstood you. I'm definitely not arguing that programming (what's the other one called now? the non-vibe programming. Does it have a name yet?) is easy and fun and the tools are good, oh no.

            I'm honestly very surprised by the love for chat interfaces. I don't get it. But apparently that's an amazing way to for example search the web. Not keyword -> list of links, but full question -> long answer text -> follow-up question -> even more text, etc. I thought people don't like to read long texts? But apparently the key is something in the wording. Make it say "i" and "talk" to me and add emotions.

            Maybe we'll get better tools out of this in the long run? Harness the power of the ball of statistics to create not the subtly wrong full app, but parts, smaller, clearly delineated building blocks of well-known, testable code that are easy to put together to create the whole thing? Okay, that's libraries, aehm, but with a different interface? Scratch/blockly but as a chat?

            jonathanhogg@mastodon.socialJ 1 Reply Last reply
            0
            • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

              We seem to have largely stopped innovating on trying to lower barriers to programming in favour of creating endless new frameworks and libraries for a vanishingly small number of near-identical languages. It is the mid-2020s and people are wringing their hands over Rust as if it was some inexplicable new thing rather than a C-derivative that incorporates decades old type theory. You know what I consider to be genuinely ground-breaking programming tools? VisiCalc, HyperCard and Scratch.

              jonathanhogg@mastodon.socialJ This user is from outside of this forum
              jonathanhogg@mastodon.socialJ This user is from outside of this forum
              jonathanhogg@mastodon.social
              wrote last edited by
              #23

              You know what? HyperCard was a glorious moment in time that I dearly miss: an army of non-experts were bashing together and sharing weird and wonderful stacks that were part 'zine, part adventure game and part database. Instead of laughing at vibe-coders, maybe we should ask ourselves why the current state-of-the-art in beginner-friendly programming tools is a planet-boiling roulette wheel.

              ireneista@adhd.irenes.spaceI pikesley@mastodon.me.ukP staceycornelius@zeroes.caS raganwald@social.bau-ha.usR jonathanhogg@mastodon.socialJ 8 Replies Last reply
              1
              0
              • dasgrueneblatt@wien.rocksD dasgrueneblatt@wien.rocks

                @jonathanhogg Well yes, but vibe coding does not solve that, or does it? People kind of know what they want, but they still cannot get it. Just something that looks like it and is really hard to debug. That's got be even more frustrating? Maybe I misunderstood you. I'm definitely not arguing that programming (what's the other one called now? the non-vibe programming. Does it have a name yet?) is easy and fun and the tools are good, oh no.

                I'm honestly very surprised by the love for chat interfaces. I don't get it. But apparently that's an amazing way to for example search the web. Not keyword -> list of links, but full question -> long answer text -> follow-up question -> even more text, etc. I thought people don't like to read long texts? But apparently the key is something in the wording. Make it say "i" and "talk" to me and add emotions.

                Maybe we'll get better tools out of this in the long run? Harness the power of the ball of statistics to create not the subtly wrong full app, but parts, smaller, clearly delineated building blocks of well-known, testable code that are easy to put together to create the whole thing? Okay, that's libraries, aehm, but with a different interface? Scratch/blockly but as a chat?

                jonathanhogg@mastodon.socialJ This user is from outside of this forum
                jonathanhogg@mastodon.socialJ This user is from outside of this forum
                jonathanhogg@mastodon.social
                wrote last edited by
                #24

                @dasgrueneblatt I think you have misunderstood me: I think vibe coding is a horrendous problem, but it is a symptom of an industry failing. That people are trying to steer a tank with a speak'n'spell is because we have not made decent bikes.

                dasgrueneblatt@wien.rocksD 1 Reply Last reply
                0
                • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                  @dasgrueneblatt I think you have misunderstood me: I think vibe coding is a horrendous problem, but it is a symptom of an industry failing. That people are trying to steer a tank with a speak'n'spell is because we have not made decent bikes.

                  dasgrueneblatt@wien.rocksD This user is from outside of this forum
                  dasgrueneblatt@wien.rocksD This user is from outside of this forum
                  dasgrueneblatt@wien.rocks
                  wrote last edited by
                  #25

                  @jonathanhogg That's a great picture, thank you. Yes, vibe coding as a symptom.

                  I need to think about this. Thank you for starting it.

                  1 Reply Last reply
                  0
                  • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                    @michael @jarkman Fuck yes! I want a thousand languages to bloom. It seems like once everyone used to write their own language and we fell out of the habit. The Dragon Book used to be required reading for CS…

                    thatsten@hachyderm.ioT This user is from outside of this forum
                    thatsten@hachyderm.ioT This user is from outside of this forum
                    thatsten@hachyderm.io
                    wrote last edited by
                    #26

                    @jonathanhogg @michael @jarkman I once asked a very senior HPC developer at Red Hat what keeps him up at night and he said, paraphrasing and pulling from memory that's about 15 years old now, "we haven't created new computer science since the 1960s and I fear we'll exhaust what we know before we discover anything new," and I think about that a lot these days.

                    1 Reply Last reply
                    0
                    • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                      You know what? HyperCard was a glorious moment in time that I dearly miss: an army of non-experts were bashing together and sharing weird and wonderful stacks that were part 'zine, part adventure game and part database. Instead of laughing at vibe-coders, maybe we should ask ourselves why the current state-of-the-art in beginner-friendly programming tools is a planet-boiling roulette wheel.

                      ireneista@adhd.irenes.spaceI This user is from outside of this forum
                      ireneista@adhd.irenes.spaceI This user is from outside of this forum
                      ireneista@adhd.irenes.space
                      wrote last edited by
                      #27

                      @jonathanhogg well put

                      1 Reply Last reply
                      0
                      • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                        You know what? HyperCard was a glorious moment in time that I dearly miss: an army of non-experts were bashing together and sharing weird and wonderful stacks that were part 'zine, part adventure game and part database. Instead of laughing at vibe-coders, maybe we should ask ourselves why the current state-of-the-art in beginner-friendly programming tools is a planet-boiling roulette wheel.

                        pikesley@mastodon.me.ukP This user is from outside of this forum
                        pikesley@mastodon.me.ukP This user is from outside of this forum
                        pikesley@mastodon.me.uk
                        wrote last edited by
                        #28

                        @jonathanhogg

                        "planet-boiling roulette wheel" is the name of my upcoming experimental jazzcore EP

                        thechaoszone@chaos.socialT 1 Reply Last reply
                        0
                        • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                          We seem to have largely stopped innovating on trying to lower barriers to programming in favour of creating endless new frameworks and libraries for a vanishingly small number of near-identical languages. It is the mid-2020s and people are wringing their hands over Rust as if it was some inexplicable new thing rather than a C-derivative that incorporates decades old type theory. You know what I consider to be genuinely ground-breaking programming tools? VisiCalc, HyperCard and Scratch.

                          ireneista@adhd.irenes.spaceI This user is from outside of this forum
                          ireneista@adhd.irenes.spaceI This user is from outside of this forum
                          ireneista@adhd.irenes.space
                          wrote last edited by
                          #29

                          @jonathanhogg you're right, but also, it's more than that - today's tooling is worse for non-experts than the stuff that used to exist

                          because it's designed around corporate priorities, not individual ones. it's the factory looms problem.

                          emily_s@mastodon.me.ukE 1 Reply Last reply
                          0
                          • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                            You know what? HyperCard was a glorious moment in time that I dearly miss: an army of non-experts were bashing together and sharing weird and wonderful stacks that were part 'zine, part adventure game and part database. Instead of laughing at vibe-coders, maybe we should ask ourselves why the current state-of-the-art in beginner-friendly programming tools is a planet-boiling roulette wheel.

                            staceycornelius@zeroes.caS This user is from outside of this forum
                            staceycornelius@zeroes.caS This user is from outside of this forum
                            staceycornelius@zeroes.ca
                            wrote last edited by
                            #30

                            @jonathanhogg HyperCard was great.

                            1 Reply Last reply
                            0
                            • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                              You know what? HyperCard was a glorious moment in time that I dearly miss: an army of non-experts were bashing together and sharing weird and wonderful stacks that were part 'zine, part adventure game and part database. Instead of laughing at vibe-coders, maybe we should ask ourselves why the current state-of-the-art in beginner-friendly programming tools is a planet-boiling roulette wheel.

                              raganwald@social.bau-ha.usR This user is from outside of this forum
                              raganwald@social.bau-ha.usR This user is from outside of this forum
                              raganwald@social.bau-ha.us
                              wrote last edited by
                              #31

                              @jonathanhogg A quarter-century ago, we were developing a new version of JProbe, and as we got close to the day we had to send the golden master to the factory to manufacture CDs, we were short a settings configuration tool.

                              The team were told to skip the GUI editor and work on mission-critical features. Meanwhile, the program manager spent a weekend writing the editor in HyperCard, packaged with Metacard, a tool now known as LiveCode: https://en.wikipedia.org/wiki/LiveCode_(company)

                              We shipped it.

                              Link Preview Image
                              raganwald@social.bau-ha.usR 1 Reply Last reply
                              0
                              • ireneista@adhd.irenes.spaceI ireneista@adhd.irenes.space

                                @jonathanhogg you're right, but also, it's more than that - today's tooling is worse for non-experts than the stuff that used to exist

                                because it's designed around corporate priorities, not individual ones. it's the factory looms problem.

                                emily_s@mastodon.me.ukE This user is from outside of this forum
                                emily_s@mastodon.me.ukE This user is from outside of this forum
                                emily_s@mastodon.me.uk
                                wrote last edited by
                                #32

                                @ireneista @jonathanhogg this. It effects small businesses too. What works for a thousand or even 100 engineers doesn't work for 5.

                                1 Reply Last reply
                                0
                                • raganwald@social.bau-ha.usR raganwald@social.bau-ha.us

                                  @jonathanhogg A quarter-century ago, we were developing a new version of JProbe, and as we got close to the day we had to send the golden master to the factory to manufacture CDs, we were short a settings configuration tool.

                                  The team were told to skip the GUI editor and work on mission-critical features. Meanwhile, the program manager spent a weekend writing the editor in HyperCard, packaged with Metacard, a tool now known as LiveCode: https://en.wikipedia.org/wiki/LiveCode_(company)

                                  We shipped it.

                                  Link Preview Image
                                  raganwald@social.bau-ha.usR This user is from outside of this forum
                                  raganwald@social.bau-ha.usR This user is from outside of this forum
                                  raganwald@social.bau-ha.us
                                  wrote last edited by
                                  #33

                                  @jonathanhogg Afterward:

                                  The program manager eventually left the company, and the team immediately rewrote the editor in Java/Swing. It took a summer, but now the company could brag that it used Java exclusively to write tools for Java.

                                  I certainly never met a customer who cared whether the editor was written in Java. For that matter, nobody cared that the core analysis engine was written in C++.

                                  Programming is a pop culture.

                                  1 Reply Last reply
                                  0
                                  • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                                    You know what? HyperCard was a glorious moment in time that I dearly miss: an army of non-experts were bashing together and sharing weird and wonderful stacks that were part 'zine, part adventure game and part database. Instead of laughing at vibe-coders, maybe we should ask ourselves why the current state-of-the-art in beginner-friendly programming tools is a planet-boiling roulette wheel.

                                    jonathanhogg@mastodon.socialJ This user is from outside of this forum
                                    jonathanhogg@mastodon.socialJ This user is from outside of this forum
                                    jonathanhogg@mastodon.social
                                    wrote last edited by
                                    #34

                                    On the gripping hand, if you're a trained programmer using vibe-coding because of a perceived increase in your productivity, or pressure from management to increase your productivity, I would refer you to my first post in this thread…

                                    1 Reply Last reply
                                    0
                                    • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                                      You know what? HyperCard was a glorious moment in time that I dearly miss: an army of non-experts were bashing together and sharing weird and wonderful stacks that were part 'zine, part adventure game and part database. Instead of laughing at vibe-coders, maybe we should ask ourselves why the current state-of-the-art in beginner-friendly programming tools is a planet-boiling roulette wheel.

                                      fozztexx@mastodon.fozztexx.comF This user is from outside of this forum
                                      fozztexx@mastodon.fozztexx.comF This user is from outside of this forum
                                      fozztexx@mastodon.fozztexx.com
                                      wrote last edited by
                                      #35

                                      @jonathanhogg HyperCard was *amazing* and I don't understand why there's nothing like it anymore. It was like building programs with Lego. Just snap things together, write your program in a very natural language, and do incredible things. It was so easy to double click on something and add a few lines of code. I remember also having fun with the flexibility of the language and constantly trying to see what different syntax I could get away with.

                                      1 Reply Last reply
                                      0
                                      • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                                        You know what? HyperCard was a glorious moment in time that I dearly miss: an army of non-experts were bashing together and sharing weird and wonderful stacks that were part 'zine, part adventure game and part database. Instead of laughing at vibe-coders, maybe we should ask ourselves why the current state-of-the-art in beginner-friendly programming tools is a planet-boiling roulette wheel.

                                        requiem@masto.hackers.townR This user is from outside of this forum
                                        requiem@masto.hackers.townR This user is from outside of this forum
                                        requiem@masto.hackers.town
                                        wrote last edited by
                                        #36

                                        @jonathanhogg this is my central response to the "AI makes software development accessible" argument.

                                        Once upon a time anyone could program their personal computer using a book that came with it. We taught it to all the kids in my tiny town's elementary school. My shopkeep neighbor and our local mechanic wrote their own custom software with no CS background.

                                        BASIC, Hypercard, personal computers, printed manuals > LLM's.

                                        1 Reply Last reply
                                        0
                                        • R relay@relay.infosec.exchange shared this topic
                                        • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                                          My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise. So I don't worry about us creating super-intelligent AI, I worry about us allowing that expertise to atrophy through laziness and greed. I refuse to use LLMs not because I'm scared of how clever they are, but because I do not wish to become stupider.

                                          tobiaspatton@cosocial.caT This user is from outside of this forum
                                          tobiaspatton@cosocial.caT This user is from outside of this forum
                                          tobiaspatton@cosocial.ca
                                          wrote last edited by
                                          #37

                                          @jonathanhogg this is nicely put.

                                          1 Reply Last reply
                                          0
                                          • R relay@relay.mycrowd.ca shared this topic
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups