Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise.

My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise.

Scheduled Pinned Locked Moved Uncategorized
44 Posts 24 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

    My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise. So I don't worry about us creating super-intelligent AI, I worry about us allowing that expertise to atrophy through laziness and greed. I refuse to use LLMs not because I'm scared of how clever they are, but because I do not wish to become stupider.

    coldclimate@hachyderm.ioC This user is from outside of this forum
    coldclimate@hachyderm.ioC This user is from outside of this forum
    coldclimate@hachyderm.io
    wrote last edited by
    #3

    @jonathanhogg belter

    1 Reply Last reply
    0
    • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

      My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise. So I don't worry about us creating super-intelligent AI, I worry about us allowing that expertise to atrophy through laziness and greed. I refuse to use LLMs not because I'm scared of how clever they are, but because I do not wish to become stupider.

      kbm0@mastodon.socialK This user is from outside of this forum
      kbm0@mastodon.socialK This user is from outside of this forum
      kbm0@mastodon.social
      wrote last edited by
      #4

      @jonathanhogg Someone was on R4 a couple of days back, I think it was prof. Joshua Bengio, going on about the dangers of AI becoming sentient and taking over. I think this sort of talk just fires politicians up that they want to be in on it. It makes AI feel like nuclear weapons: Exceptionally dangerous but every government seems to want them.

      1 Reply Last reply
      0
      • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

        My experience with generative-AI has been that, at its very best, it is subtly wrong in ways that only an expert in the relevant subject would recognise. So I don't worry about us creating super-intelligent AI, I worry about us allowing that expertise to atrophy through laziness and greed. I refuse to use LLMs not because I'm scared of how clever they are, but because I do not wish to become stupider.

        jonathanhogg@mastodon.socialJ This user is from outside of this forum
        jonathanhogg@mastodon.socialJ This user is from outside of this forum
        jonathanhogg@mastodon.social
        wrote last edited by
        #5

        I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

        bit101@mstdn.socialB jonathanhogg@mastodon.socialJ krig@goto.liten.appK dasgrueneblatt@wien.rocksD dietasse@floss.socialD 5 Replies Last reply
        0
        • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

          I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

          bit101@mstdn.socialB This user is from outside of this forum
          bit101@mstdn.socialB This user is from outside of this forum
          bit101@mstdn.social
          wrote last edited by
          #6

          @jonathanhogg I'd add that everything is built on frameworks now. Programming has mostly become configuring the framework and coming up with the correct business logic and decent UX / styling. And since most apps these days do the same kind of things, with different data, AI's job should be easy. Humans still manage to mess up the important bits like security, privacy, performance. And AI is even worse at those things.

          jonathanhogg@mastodon.socialJ 1 Reply Last reply
          0
          • bit101@mstdn.socialB bit101@mstdn.social

            @jonathanhogg I'd add that everything is built on frameworks now. Programming has mostly become configuring the framework and coming up with the correct business logic and decent UX / styling. And since most apps these days do the same kind of things, with different data, AI's job should be easy. Humans still manage to mess up the important bits like security, privacy, performance. And AI is even worse at those things.

            jonathanhogg@mastodon.socialJ This user is from outside of this forum
            jonathanhogg@mastodon.socialJ This user is from outside of this forum
            jonathanhogg@mastodon.social
            wrote last edited by
            #7

            @bit101 hold on, I've got another post incoming on exactly this… 😉

            bit101@mstdn.socialB 1 Reply Last reply
            0
            • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

              I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

              jonathanhogg@mastodon.socialJ This user is from outside of this forum
              jonathanhogg@mastodon.socialJ This user is from outside of this forum
              jonathanhogg@mastodon.social
              wrote last edited by
              #8

              We seem to have largely stopped innovating on trying to lower barriers to programming in favour of creating endless new frameworks and libraries for a vanishingly small number of near-identical languages. It is the mid-2020s and people are wringing their hands over Rust as if it was some inexplicable new thing rather than a C-derivative that incorporates decades old type theory. You know what I consider to be genuinely ground-breaking programming tools? VisiCalc, HyperCard and Scratch.

              jarkman@chaos.socialJ jonathanhogg@mastodon.socialJ ireneista@adhd.irenes.spaceI 3 Replies Last reply
              0
              • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

                krig@goto.liten.appK This user is from outside of this forum
                krig@goto.liten.appK This user is from outside of this forum
                krig@goto.liten.app
                wrote last edited by
                #9

                @jonathanhogg Actually think you have that backwards. Making something dangerous and broken has been easy for ages, that's why a certain level of gatekeeping is actually a good thing. Like, driving a car isn't that hard. A six year old can do it with a few minutes of training. Driving a car safely on the other hand

                jonathanhogg@mastodon.socialJ 1 Reply Last reply
                0
                • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                  @bit101 hold on, I've got another post incoming on exactly this… 😉

                  bit101@mstdn.socialB This user is from outside of this forum
                  bit101@mstdn.socialB This user is from outside of this forum
                  bit101@mstdn.social
                  wrote last edited by
                  #10

                  @jonathanhogg sorry if I spoiled it! 🙂

                  1 Reply Last reply
                  0
                  • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                    We seem to have largely stopped innovating on trying to lower barriers to programming in favour of creating endless new frameworks and libraries for a vanishingly small number of near-identical languages. It is the mid-2020s and people are wringing their hands over Rust as if it was some inexplicable new thing rather than a C-derivative that incorporates decades old type theory. You know what I consider to be genuinely ground-breaking programming tools? VisiCalc, HyperCard and Scratch.

                    jarkman@chaos.socialJ This user is from outside of this forum
                    jarkman@chaos.socialJ This user is from outside of this forum
                    jarkman@chaos.social
                    wrote last edited by
                    #11

                    @jonathanhogg That's the kind of talk you usually hear just before someone invents themselves a new language. Just saying.

                    jonathanhogg@mastodon.socialJ michael@toot.mynameismwd.orgM 2 Replies Last reply
                    0
                    • krig@goto.liten.appK krig@goto.liten.app

                      @jonathanhogg Actually think you have that backwards. Making something dangerous and broken has been easy for ages, that's why a certain level of gatekeeping is actually a good thing. Like, driving a car isn't that hard. A six year old can do it with a few minutes of training. Driving a car safely on the other hand

                      jonathanhogg@mastodon.socialJ This user is from outside of this forum
                      jonathanhogg@mastodon.socialJ This user is from outside of this forum
                      jonathanhogg@mastodon.social
                      wrote last edited by
                      #12

                      @krig which is why we also make bikes and scooters – convenient tools that can be used by all ages and abilities

                      krig@goto.liten.appK 1 Reply Last reply
                      0
                      • jarkman@chaos.socialJ jarkman@chaos.social

                        @jonathanhogg That's the kind of talk you usually hear just before someone invents themselves a new language. Just saying.

                        jonathanhogg@mastodon.socialJ This user is from outside of this forum
                        jonathanhogg@mastodon.socialJ This user is from outside of this forum
                        jonathanhogg@mastodon.social
                        wrote last edited by
                        #13

                        @jarkman Heh! Most of my programming these days involves creating or using my own languages 😆

                        jarkman@chaos.socialJ 1 Reply Last reply
                        0
                        • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                          @jarkman Heh! Most of my programming these days involves creating or using my own languages 😆

                          jarkman@chaos.socialJ This user is from outside of this forum
                          jarkman@chaos.socialJ This user is from outside of this forum
                          jarkman@chaos.social
                          wrote last edited by
                          #14

                          @jonathanhogg 🙂 I would like to hear more about that sometime.

                          jonathanhogg@mastodon.socialJ 1 Reply Last reply
                          0
                          • jarkman@chaos.socialJ jarkman@chaos.social

                            @jonathanhogg 🙂 I would like to hear more about that sometime.

                            jonathanhogg@mastodon.socialJ This user is from outside of this forum
                            jonathanhogg@mastodon.socialJ This user is from outside of this forum
                            jonathanhogg@mastodon.social
                            wrote last edited by
                            #15

                            @jarkman I can absolutely bend your ear at EMF, but conveniently I also recently gave a talk about it at Alpaca! 😀

                            - YouTube

                            Auf YouTube findest du die angesagtesten Videos und Tracks. Außerdem kannst du eigene Inhalte hochladen und mit Freunden oder gleich der ganzen Welt teilen.

                            favicon

                            (www.youtube.com)

                            gklyne@indieweb.socialG jarkman@chaos.socialJ 2 Replies Last reply
                            0
                            • jarkman@chaos.socialJ jarkman@chaos.social

                              @jonathanhogg That's the kind of talk you usually hear just before someone invents themselves a new language. Just saying.

                              michael@toot.mynameismwd.orgM This user is from outside of this forum
                              michael@toot.mynameismwd.orgM This user is from outside of this forum
                              michael@toot.mynameismwd.org
                              wrote last edited by
                              #16

                              @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

                              Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

                              jonathanhogg@mastodon.socialJ tobyjaffey@mastodon.me.ukT 2 Replies Last reply
                              0
                              • michael@toot.mynameismwd.orgM michael@toot.mynameismwd.org

                                @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

                                Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

                                jonathanhogg@mastodon.socialJ This user is from outside of this forum
                                jonathanhogg@mastodon.socialJ This user is from outside of this forum
                                jonathanhogg@mastodon.social
                                wrote last edited by
                                #17

                                @michael @jarkman Fuck yes! I want a thousand languages to bloom. It seems like once everyone used to write their own language and we fell out of the habit. The Dragon Book used to be required reading for CS…

                                thatsten@hachyderm.ioT 1 Reply Last reply
                                0
                                • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                                  @krig which is why we also make bikes and scooters – convenient tools that can be used by all ages and abilities

                                  krig@goto.liten.appK This user is from outside of this forum
                                  krig@goto.liten.appK This user is from outside of this forum
                                  krig@goto.liten.app
                                  wrote last edited by
                                  #18

                                  @jonathanhogg good point! I think I see what you meant now. I miss the old visual basic and how easy it was to make tools using it without knowing any programming, really.

                                  1 Reply Last reply
                                  0
                                  • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                                    I will say one thing for generative AI: since these tools function by remixing/translating existing information, that vibe programming is so popular demonstrates a colossal failure on the part of our industry in not making this stuff easier. If a giant ball of statistics can mostly knock up a working app in minutes, this shows not that gen-AI is insanely clever, but that most of the work in making an app has always been stupid. We have gatekeeped programming behind vast walls of nonsense.

                                    dasgrueneblatt@wien.rocksD This user is from outside of this forum
                                    dasgrueneblatt@wien.rocksD This user is from outside of this forum
                                    dasgrueneblatt@wien.rocks
                                    wrote last edited by
                                    #19

                                    @jonathanhogg No, it's still difficult to program something so that it's exactly how you want it to be. It's apparently been underestimated how often that doesn't matter ("mostly working app" where getting it to working is more effort than starting from scratch), but we will see how that develops in the long run. Maybe plausible deniability is really enough for many things.

                                    Nobody is gatekeeping clear, testable requirements and communication without misunderstandings. People usually just can't do that.

                                    jonathanhogg@mastodon.socialJ 1 Reply Last reply
                                    0
                                    • michael@toot.mynameismwd.orgM michael@toot.mynameismwd.org

                                      @jarkman @jonathanhogg I get the broader point here, but at the same time, as computers have moved to encompass more and more of the human sphere, is it actually reasonable to exect any languge to be actually general purpose?

                                      Perhaps for some uses cases it's the right choice, but when I look at data-science code written by vernacular developers (experts whose expertise is in a domain other than computer science) I feel the freedom from those languages just gives more scope for error/mistake/poor style that will bite them later). Why can't we embrace more DSLs?

                                      tobyjaffey@mastodon.me.ukT This user is from outside of this forum
                                      tobyjaffey@mastodon.me.ukT This user is from outside of this forum
                                      tobyjaffey@mastodon.me.uk
                                      wrote last edited by
                                      #20

                                      @michael @jarkman @jonathanhogg (IMO) we can't have more DSLs because everything useful is now plumbed together from a series of heterogenous parts and we've somehow decided they can only interoperate at the (barbaric) C ABI level, or the (absurdly inefficient) web level. So, we rely on general purpose languages using specialised libraries, instead of the other way around.
                                      I think fixing this boundary/contract problem would fix a lot in s/w engineering.

                                      1 Reply Last reply
                                      0
                                      • dasgrueneblatt@wien.rocksD dasgrueneblatt@wien.rocks

                                        @jonathanhogg No, it's still difficult to program something so that it's exactly how you want it to be. It's apparently been underestimated how often that doesn't matter ("mostly working app" where getting it to working is more effort than starting from scratch), but we will see how that develops in the long run. Maybe plausible deniability is really enough for many things.

                                        Nobody is gatekeeping clear, testable requirements and communication without misunderstandings. People usually just can't do that.

                                        jonathanhogg@mastodon.socialJ This user is from outside of this forum
                                        jonathanhogg@mastodon.socialJ This user is from outside of this forum
                                        jonathanhogg@mastodon.social
                                        wrote last edited by
                                        #21

                                        @dasgrueneblatt I have now spent 40 years programming commercially in dozens of different languages; I have taught programming to CS students, art students and little kids and my experience is that most programming is hard because we have made it so. I absolutely understand the frustration of people who know what their problem is, but don't feel equipped to solve it because the tools available to them are too big and confusing. Vibe coding is our own fault

                                        dasgrueneblatt@wien.rocksD 1 Reply Last reply
                                        0
                                        • jonathanhogg@mastodon.socialJ jonathanhogg@mastodon.social

                                          @dasgrueneblatt I have now spent 40 years programming commercially in dozens of different languages; I have taught programming to CS students, art students and little kids and my experience is that most programming is hard because we have made it so. I absolutely understand the frustration of people who know what their problem is, but don't feel equipped to solve it because the tools available to them are too big and confusing. Vibe coding is our own fault

                                          dasgrueneblatt@wien.rocksD This user is from outside of this forum
                                          dasgrueneblatt@wien.rocksD This user is from outside of this forum
                                          dasgrueneblatt@wien.rocks
                                          wrote last edited by
                                          #22

                                          @jonathanhogg Well yes, but vibe coding does not solve that, or does it? People kind of know what they want, but they still cannot get it. Just something that looks like it and is really hard to debug. That's got be even more frustrating? Maybe I misunderstood you. I'm definitely not arguing that programming (what's the other one called now? the non-vibe programming. Does it have a name yet?) is easy and fun and the tools are good, oh no.

                                          I'm honestly very surprised by the love for chat interfaces. I don't get it. But apparently that's an amazing way to for example search the web. Not keyword -> list of links, but full question -> long answer text -> follow-up question -> even more text, etc. I thought people don't like to read long texts? But apparently the key is something in the wording. Make it say "i" and "talk" to me and add emotions.

                                          Maybe we'll get better tools out of this in the long run? Harness the power of the ball of statistics to create not the subtly wrong full app, but parts, smaller, clearly delineated building blocks of well-known, testable code that are easy to put together to create the whole thing? Okay, that's libraries, aehm, but with a different interface? Scratch/blockly but as a chat?

                                          jonathanhogg@mastodon.socialJ 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups