Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. I would like to give an update on "federation" on Bluesky.

I would like to give an update on "federation" on Bluesky.

Scheduled Pinned Locked Moved Uncategorized
342 Posts 109 Posters 884 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • mcc@mastodon.socialM mcc@mastodon.social

    @gbargoud Sure. You could do that. I'm aware of a patch to the PDS (backend) software that allows it to flat out publish via ActivityPub. I haven't seen a *frontend* that merges the streams yet though.

    There's also the problem that you can't reeeallly monitor *just part* of the Bluesky network. To follow part of it you're supposed to drink the entire firehose and filter out the parts you care about.

    swetland@chaos.socialS This user is from outside of this forum
    swetland@chaos.socialS This user is from outside of this forum
    swetland@chaos.social
    wrote on last edited by
    #22

    @mcc @gbargoud It would seem like maybe this could be mitigated a bit by a (hosted) service that operates a filtered relay feed -- which drinks from the full network firehose, but lets downstream users small instances/servers subscribe to a subset view of that (based on accounts/hashtags/filters to observe).

    msh@coales.coM 1 Reply Last reply
    0
    • groupnebula563@mastodon.socialG groupnebula563@mastodon.social

      @mcc it really is a shame that there was all that racism happening. I've been seeing less and less of it, and hopefully it gets taken care of altogether soon so everyone (except bigots, they can fuck right off) feels welcome on fedi

      jef@mastodon.socialJ This user is from outside of this forum
      jef@mastodon.socialJ This user is from outside of this forum
      jef@mastodon.social
      wrote on last edited by
      #23

      @GroupNebula563 @mcc Would be nice! Won't happen though.

      groupnebula563@mastodon.socialG 1 Reply Last reply
      0
      • mcc@mastodon.socialM mcc@mastodon.social

        I would like to give an update on "federation" on Bluesky.

        My expectation was it was unlikely we'd ever see this happen because "federation" on ATProto means basically reproducing the entirety of the Bluesky software stack. In old Big Data terms, on ActivityPub your instance is a "horizontal shard" of the network; ATProto forces full DB replicas only.

        Still, we're seeing movement on this front, which I'd split into two categories:

        1. Your fault (you reading this)
        2. Aaron Rodericks's fault

        txtechnician@mastodon.socialT This user is from outside of this forum
        txtechnician@mastodon.socialT This user is from outside of this forum
        txtechnician@mastodon.social
        wrote on last edited by
        #24

        @mcc Bluesky is a venture capital shit show in the making. The rug pull will happen in the next decade.

        I did not know about the fighting between black devs and the queer community.??? What is the lore there.

        Cuz it sux that they went the way of atproto over activity pub.

        benroyce@mastodon.socialB lienrag@mastodon.tedomum.netL 2 Replies Last reply
        0
        • lritter@mastodon.gamedev.placeL lritter@mastodon.gamedev.place

          @mcc technically mastodon dot social could grow big enough to also become this kind of dickface. but i'm talking hypothetical, you're talking reality. with more fragmentation, bsky would become stronger as a network. this is a message we can push on bsky central itself.

          mcc@mastodon.socialM This user is from outside of this forum
          mcc@mastodon.socialM This user is from outside of this forum
          mcc@mastodon.social
          wrote on last edited by
          #25

          @lritter I think this happening with m.s is a real risk, but the thing I'd point to to say it hasn't happened in practice is that m.s is probably the most blocked instance and none of the instances blocking m.s seem unhappy!

          1 Reply Last reply
          0
          • mcc@mastodon.socialM mcc@mastodon.social

            If you sign up with https://blacksky.community you get:

            - Blacksky's "appview"/web frontend
            - Optionally, Blacksky's PDS
            - Blacksky's moderation layer (and you can optionally enable Bluesky's too)

            Almost-complete independence! What I'm not clear on is to whether, or to what degree Blacksky relies on Bluesky's "relay":

            (EDIT 2: There was an edit here with corrections, but I've removed that because the corrections may have been less correct than the original.)

            jdp23@neuromatch.socialJ This user is from outside of this forum
            jdp23@neuromatch.socialJ This user is from outside of this forum
            jdp23@neuromatch.social
            wrote on last edited by
            #26

            @mcc Right now, its only Blacksky's feeds that are using their own relay.

            They're not currently running their own AppView (although a lot of people are confused about this -- I even saw Masnick get it wrong) .

            EDIT: although maybe I got it wrong too, and they actually are? See the discussions.

            ANOTHER EDIT, 10/7: it now seems like I was corrrect. whew. But it really is a confusing situation!

            They're working on this and saying it should be out fairly soon, at which point I believe the plan is to have blacksky.community switch over (or maybe offer the choice of which AppView to use, the way deer.social currently does). I assume their AppView will use their own Relay but haven't verified this.

            Another current dependency is on Bluesky's platform-level moderation, the automatied scanning for CSAM, malware, and spam. At the technical level it's easily replaceable -- Bluesky outsources it -- but it's not cheap (especially since video is supported); Rudy estimated $160,000/year.

            mcc@mastodon.socialM nlupo@amikejo.xyzN 2 Replies Last reply
            0
            • jrose@social.belkadan.comJ jrose@social.belkadan.com

              @mcc For my own understanding: while the server architecture is different, the same thing could happen on the Fediverse, right? (Except portability is worse.) The only thing saving it is that mastodon.social is only the plurality of users, maybe a majority, but not the overwhelming majority?

              mcc@mastodon.socialM This user is from outside of this forum
              mcc@mastodon.socialM This user is from outside of this forum
              mcc@mastodon.social
              wrote on last edited by
              #27

              @jrose I mean, observably, a *lot* of servers are outright blocking mastodon.social and the users seem entirely happy.

              The question is whether a non mothership community can be viable without the mothership. That's the case on Mastodon. Bluesky isn't close and we're only now starting to see *movement toward* it getting close. The difference between 51% and 99.9% is meaningful.

              megmac@social.treehouse.systemsM 1 Reply Last reply
              0
              • alter_kaker@hachyderm.ioA alter_kaker@hachyderm.io

                @mcc I'm curious, but I haven't had any time to look into this, so if you know off the top of your head, cost aside, how much work/knowledge does it take to stand up the whole stack at this point? Does Blacksky, for example, or Northsky, have their software available and documented? I think that it would be fun to try to try, but I have limited time and this isn't really my specialization.

                mcc@mastodon.socialM This user is from outside of this forum
                mcc@mastodon.socialM This user is from outside of this forum
                mcc@mastodon.social
                wrote on last edited by
                #28

                @alter_kaker I'm not the person to ask. I would join the Bluesky API Touchers discord (yes, it's really named that) and ask there.

                Blacksky has all their software on GitHub (they are using a mix of original Bluesky software and their own stuff) but not instructions on how to deploy it as a whole stack.

                1 Reply Last reply
                0
                • jdp23@neuromatch.socialJ jdp23@neuromatch.social

                  @mcc Right now, its only Blacksky's feeds that are using their own relay.

                  They're not currently running their own AppView (although a lot of people are confused about this -- I even saw Masnick get it wrong) .

                  EDIT: although maybe I got it wrong too, and they actually are? See the discussions.

                  ANOTHER EDIT, 10/7: it now seems like I was corrrect. whew. But it really is a confusing situation!

                  They're working on this and saying it should be out fairly soon, at which point I believe the plan is to have blacksky.community switch over (or maybe offer the choice of which AppView to use, the way deer.social currently does). I assume their AppView will use their own Relay but haven't verified this.

                  Another current dependency is on Bluesky's platform-level moderation, the automatied scanning for CSAM, malware, and spam. At the technical level it's easily replaceable -- Bluesky outsources it -- but it's not cheap (especially since video is supported); Rudy estimated $160,000/year.

                  mcc@mastodon.socialM This user is from outside of this forum
                  mcc@mastodon.socialM This user is from outside of this forum
                  mcc@mastodon.social
                  wrote on last edited by
                  #29

                  @jdp23 "They're not even running their own appview"

                  I don't understand. What is the website I have been using to access bluesky for the last month, then?

                  jdp23@neuromatch.socialJ 1 Reply Last reply
                  0
                  • mcc@mastodon.socialM mcc@mastodon.social

                    And that's why I say, TLDR:

                    - I am legitimately excited about the work being done by Blacksky Algorithms! I am using their frontend and happy with it.

                    - Northsky is an interesting development to watch

                    - If you're on a Bluesky PDS, I recommend migrating off with one of these tools https://bsky.app/profile/did:plc:ii5jchdzlmcojjw4dqczcgkh/post/3lyt6t6qfa22u

                    - Everything Sucks. A LOT of things would have to change at a social level for *any* entity other than Bluesky to have power or independence in the ATP ecosystem. I still don't trust Bluesky.

                    aeva@mastodon.gamedev.placeA This user is from outside of this forum
                    aeva@mastodon.gamedev.placeA This user is from outside of this forum
                    aeva@mastodon.gamedev.place
                    wrote on last edited by
                    #30

                    @mcc do you think this work (on Blacksky or northsky's part) will lead to more independent atproto towers showing up in the future?

                    mcc@mastodon.socialM 1 Reply Last reply
                    0
                    • mcc@mastodon.socialM mcc@mastodon.social

                      @jdp23 "They're not even running their own appview"

                      I don't understand. What is the website I have been using to access bluesky for the last month, then?

                      jdp23@neuromatch.socialJ This user is from outside of this forum
                      jdp23@neuromatch.socialJ This user is from outside of this forum
                      jdp23@neuromatch.social
                      wrote on last edited by
                      #31

                      @mcc it's a client (aka app) that uses an appview -- currently the Bluesky appview

                      mcc@mastodon.socialM 1 Reply Last reply
                      0
                      • aeva@mastodon.gamedev.placeA aeva@mastodon.gamedev.place

                        @mcc do you think this work (on Blacksky or northsky's part) will lead to more independent atproto towers showing up in the future?

                        mcc@mastodon.socialM This user is from outside of this forum
                        mcc@mastodon.socialM This user is from outside of this forum
                        mcc@mastodon.social
                        wrote on last edited by
                        #32

                        @aeva "Tower", that's a good word for it.

                        I think observably, the fact blacksky exists as a full stack (or at least end to end) example *is* inspiring more towers to stand up, and I'd put northsky as the example. (Or so I assume, I don't know for a fact the order of events.)

                        mcc@mastodon.socialM 1 Reply Last reply
                        0
                        • mcc@mastodon.socialM mcc@mastodon.social

                          @aeva "Tower", that's a good word for it.

                          I think observably, the fact blacksky exists as a full stack (or at least end to end) example *is* inspiring more towers to stand up, and I'd put northsky as the example. (Or so I assume, I don't know for a fact the order of events.)

                          mcc@mastodon.socialM This user is from outside of this forum
                          mcc@mastodon.socialM This user is from outside of this forum
                          mcc@mastodon.social
                          wrote on last edited by
                          #33

                          @aeva The question as always with ATP though is "why?". That is *why* would anyone bother splitting from bluesky. What we've seen so far is two demographic communities with reasons to distrust platforms they don't operate themselves.

                          So like who else would bother? You wouldn't see like, a fishing community standing up their own tower because they have no reason to expect Bluesky will target them specifically, and it costs so much more than running a Mastodon instance.

                          cthos@mastodon.cthos.devC swetland@chaos.socialS jdp23@neuromatch.socialJ 3 Replies Last reply
                          0
                          • jdp23@neuromatch.socialJ jdp23@neuromatch.social

                            @mcc it's a client (aka app) that uses an appview -- currently the Bluesky appview

                            mcc@mastodon.socialM This user is from outside of this forum
                            mcc@mastodon.socialM This user is from outside of this forum
                            mcc@mastodon.social
                            wrote on last edited by
                            #34

                            @jdp23 oh dear.

                            jdp23@neuromatch.socialJ 1 Reply Last reply
                            0
                            • mcc@mastodon.socialM mcc@mastodon.social

                              @jrose I mean, observably, a *lot* of servers are outright blocking mastodon.social and the users seem entirely happy.

                              The question is whether a non mothership community can be viable without the mothership. That's the case on Mastodon. Bluesky isn't close and we're only now starting to see *movement toward* it getting close. The difference between 51% and 99.9% is meaningful.

                              megmac@social.treehouse.systemsM This user is from outside of this forum
                              megmac@social.treehouse.systemsM This user is from outside of this forum
                              megmac@social.treehouse.systems
                              wrote on last edited by
                              #35

                              @mcc @jrose and I'm pretty sure m.s isn't even close to 51% anyways, whether in terms of total accounts or active accounts. I think it's more like 30%ish eyeballing fedidb.com's stats.

                              There are over 30k distinct activitypub servers out there, all with their own moderation policies, for better or worse.

                              mcc@mastodon.socialM 1 Reply Last reply
                              0
                              • megmac@social.treehouse.systemsM megmac@social.treehouse.systems

                                @mcc @jrose and I'm pretty sure m.s isn't even close to 51% anyways, whether in terms of total accounts or active accounts. I think it's more like 30%ish eyeballing fedidb.com's stats.

                                There are over 30k distinct activitypub servers out there, all with their own moderation policies, for better or worse.

                                mcc@mastodon.socialM This user is from outside of this forum
                                mcc@mastodon.socialM This user is from outside of this forum
                                mcc@mastodon.social
                                wrote on last edited by
                                #36

                                @megmac @jrose I think the interesting question to me is whether the mastodon ggmbh "market share" of the fediverse is going up or down over time. If they're at 30% now that sounds like they're trending down.

                                megmac@social.treehouse.systemsM 1 Reply Last reply
                                0
                                • mcc@mastodon.socialM mcc@mastodon.social

                                  @aeva The question as always with ATP though is "why?". That is *why* would anyone bother splitting from bluesky. What we've seen so far is two demographic communities with reasons to distrust platforms they don't operate themselves.

                                  So like who else would bother? You wouldn't see like, a fishing community standing up their own tower because they have no reason to expect Bluesky will target them specifically, and it costs so much more than running a Mastodon instance.

                                  cthos@mastodon.cthos.devC This user is from outside of this forum
                                  cthos@mastodon.cthos.devC This user is from outside of this forum
                                  cthos@mastodon.cthos.dev
                                  wrote on last edited by
                                  #37

                                  @mcc @aeva Is there a good breakdown of the overall costs? Like I saw a lightweight AppView implementation still has to store roughly 2 gb of data per day, indefinitely, and...that's a _lot_ of storage.

                                  I assume there's also a fair amount of bandwidth and other cost involved.

                                  mcc@mastodon.socialM 1 Reply Last reply
                                  0
                                  • alter_kaker@hachyderm.ioA alter_kaker@hachyderm.io

                                    @mcc I'm curious, but I haven't had any time to look into this, so if you know off the top of your head, cost aside, how much work/knowledge does it take to stand up the whole stack at this point? Does Blacksky, for example, or Northsky, have their software available and documented? I think that it would be fun to try to try, but I have limited time and this isn't really my specialization.

                                    E This user is from outside of this forum
                                    E This user is from outside of this forum
                                    esoteric_programmer@social.stealthy.club
                                    wrote on last edited by
                                    #38

                                    @alter_kaker @mcc hmm, apparently not that much knowledge is required, and the cost dropped significantly, I still don't trust any of it though

                                    Link Preview Image
                                    A Full-Network Relay for $34 a Month | bryan newbold

                                    This is an update to a Summer 2024 blog post. At the time, atproto relays required a cache of the full network on local disk to validate data structures. With the Sync v1.1 updates, relays don't need all that disk I/O. What impact does that have on hosting setup and operating costs? Turns out the d...

                                    favicon

                                    (whtwnd.com)

                                    alter_kaker@hachyderm.ioA ikuturso@mastodon.socialI 2 Replies Last reply
                                    0
                                    • mcc@mastodon.socialM mcc@mastodon.social

                                      @megmac @jrose I think the interesting question to me is whether the mastodon ggmbh "market share" of the fediverse is going up or down over time. If they're at 30% now that sounds like they're trending down.

                                      megmac@social.treehouse.systemsM This user is from outside of this forum
                                      megmac@social.treehouse.systemsM This user is from outside of this forum
                                      megmac@social.treehouse.systems
                                      wrote on last edited by
                                      #39

                                      @mcc @jrose I suspect their share goes up when there's a mass migration event and goes down otherwise, because in a mass migration event people want the easy answer and that's the easy answer the Mastodon website gives them. But otherwise there's probably a lot of accounts on m.s that don't stick around, while people on other instances might be more sticky (at least unless their instance shuts down).

                                      It's been a while since one of those migrations came here so I think overall that's probably correct.

                                      mcc@mastodon.socialM ikuturso@mastodon.socialI 2 Replies Last reply
                                      0
                                      • mcc@mastodon.socialM mcc@mastodon.social

                                        @aeva The question as always with ATP though is "why?". That is *why* would anyone bother splitting from bluesky. What we've seen so far is two demographic communities with reasons to distrust platforms they don't operate themselves.

                                        So like who else would bother? You wouldn't see like, a fishing community standing up their own tower because they have no reason to expect Bluesky will target them specifically, and it costs so much more than running a Mastodon instance.

                                        swetland@chaos.socialS This user is from outside of this forum
                                        swetland@chaos.socialS This user is from outside of this forum
                                        swetland@chaos.social
                                        wrote on last edited by
                                        #40

                                        @mcc @aeva I continue to be annoyed that whenever anyone brings up legitimate gripes with how bsky is operated, the staff claim "open protocol", "federation", and "user freedom", when the reality is that with only a handful of alternate towers that represent maybe a single digit percentage of users at best, for all intents and purposes it is not federated in any way that brings meaningful choice to the average user.

                                        benroyce@mastodon.socialB mcc@mastodon.socialM ikuturso@mastodon.socialI 3 Replies Last reply
                                        0
                                        • cthos@mastodon.cthos.devC cthos@mastodon.cthos.dev

                                          @mcc @aeva Is there a good breakdown of the overall costs? Like I saw a lightweight AppView implementation still has to store roughly 2 gb of data per day, indefinitely, and...that's a _lot_ of storage.

                                          I assume there's also a fair amount of bandwidth and other cost involved.

                                          mcc@mastodon.socialM This user is from outside of this forum
                                          mcc@mastodon.socialM This user is from outside of this forum
                                          mcc@mastodon.social
                                          wrote on last edited by
                                          #41

                                          @cthos @aeva I don't have an answer to this question. I've seen various claimed attempts to ballpark this number, but I expect it will change month to month, so even if I trusted the numbers I saw (I don't) there's no guarantee they're still accurate.

                                          The Big Problem as I see it is since every "tower" contains the entire network, if the amount of traffic on bluesky doubles, the operating costs of each tower doubles. The "oh shit this is harder than I thought" problem is even worse than fedi.

                                          mcc@mastodon.socialM swetland@chaos.socialS 2 Replies Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups