Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Fediverse
  3. Fedi
  4. I have deeply mixed feelings about #ActivityPub's adoption of JSON-LD, as someone who's spent way too long dealing with it while building #Fedify.

I have deeply mixed feelings about #ActivityPub's adoption of JSON-LD, as someone who's spent way too long dealing with it while building #Fedify.

Scheduled Pinned Locked Moved Fedi
fedifyjsonldfedidevactivitypub
115 Posts 26 Posters 469 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • sl007@digitalcourage.socialS sl007@digitalcourage.social

    @julian

    Can you specify "threadiverse" software cause like all properties which are not marked as "functional" in the ActivityPub Spec, `context` is an Array and I do not see any problem …

    sl007@digitalcourage.socialS This user is from outside of this forum
    sl007@digitalcourage.socialS This user is from outside of this forum
    sl007@digitalcourage.social
    wrote last edited by
    #74

    @julian

    ^ what I mean :

    "context": [
    "https://threadiversesoftware.example.org/thread/123",
    "https://www.wikidata.org/wiki/Special:EntityData/Q64 "
    ];

    then says:
    "Hi machine, I am in the context of thread 123 about Berlin."

    1 Reply Last reply
    0
    • julian@activitypub.spaceJ julian@activitypub.space

      @sl007@digitalcourage.social eh? You use context?

      ForumWG decided to use context to represent threads in threadiverse software (and Mastodon too, now).

      Just FYI.

      sl007@digitalcourage.socialS This user is from outside of this forum
      sl007@digitalcourage.socialS This user is from outside of this forum
      sl007@digitalcourage.social
      wrote last edited by
      #75

      @julian

      Is there a W3C minutes or kind of a meeting-protocol|spec. about this use of context?

      julian@activitypub.spaceJ 1 Reply Last reply
      0
      • sl007@digitalcourage.socialS sl007@digitalcourage.social

        @julian

        Is there a W3C minutes or kind of a meeting-protocol|spec. about this use of context?

        julian@activitypub.spaceJ This user is from outside of this forum
        julian@activitypub.spaceJ This user is from outside of this forum
        julian@activitypub.space
        wrote last edited by
        #76

        @sl007@digitalcourage.social FEPs 7888 and f228 details the use of context and one use case of it, to backfill conversations.

        sl007@digitalcourage.socialS 1 Reply Last reply
        0
        • julian@activitypub.spaceJ julian@activitypub.space

          @silverpill@mitra.social POSTing that inbox sends a 404?

          ? Offline
          ? Offline
          Guest
          wrote last edited by
          #77

          @julian Yes, POST to personal inbox sends a 404, POST to group inbox sends a 202 (I guess group inbox is how we communicate now).

          julian@activitypub.spaceJ 1 Reply Last reply
          0
          • julian@activitypub.spaceJ julian@activitypub.space

            @sl007@digitalcourage.social FEPs 7888 and f228 details the use of context and one use case of it, to backfill conversations.

            sl007@digitalcourage.socialS This user is from outside of this forum
            sl007@digitalcourage.socialS This user is from outside of this forum
            sl007@digitalcourage.social
            wrote last edited by
            #78

            @julian

            well, but that is _exactly_ the same of the official Social CG meetings !

            "This context property is the URL of the NodeBB topic."
            vs.
            "The context property should be used to identify the context in which the object appears in, form a common topic or group content. This can be a well known JSON-LD vocabulary or any ActivityPub Object useful for the implementation."
            vs
            https://www.w3.org/TR/activitystreams-vocabulary/#dfn-context :

            „Identifies the context within which the object exists or an activity was performed.
            The notion of "context" used is intentionally vague. The intended function is to serve as a means of grouping objects and activities that share a common originating context or purpose. An example could be all activities relating to a common project or event. “

            and I am glad cause, as said
            "context": [
            "https://threadiversesoftware.example.org/thread/123",
            "https://www.wikidata.org/wiki/Special:EntityData/Q64 "
            ];
            then says:
            "Hi machine, I am in the context of thread 123 about Berlin."

            and then

            🧵 1/2

            sl007@digitalcourage.socialS 1 Reply Last reply
            0
            • sl007@digitalcourage.socialS sl007@digitalcourage.social

              @julian

              well, but that is _exactly_ the same of the official Social CG meetings !

              "This context property is the URL of the NodeBB topic."
              vs.
              "The context property should be used to identify the context in which the object appears in, form a common topic or group content. This can be a well known JSON-LD vocabulary or any ActivityPub Object useful for the implementation."
              vs
              https://www.w3.org/TR/activitystreams-vocabulary/#dfn-context :

              „Identifies the context within which the object exists or an activity was performed.
              The notion of "context" used is intentionally vague. The intended function is to serve as a means of grouping objects and activities that share a common originating context or purpose. An example could be all activities relating to a common project or event. “

              and I am glad cause, as said
              "context": [
              "https://threadiversesoftware.example.org/thread/123",
              "https://www.wikidata.org/wiki/Special:EntityData/Q64 "
              ];
              then says:
              "Hi machine, I am in the context of thread 123 about Berlin."

              and then

              🧵 1/2

              sl007@digitalcourage.socialS This user is from outside of this forum
              sl007@digitalcourage.socialS This user is from outside of this forum
              sl007@digitalcourage.social
              wrote last edited by
              #79

              @julian

              and then
              1) machine gets thread (cause is JSON-LD by known/allowed `generator`)
              2) machine fetches or gets cached wikidata entry about Berlin and displays the card (kind of "infobox" then).
              .. from the named "SpecialEntitiyData" of wikidata which is JSON-LD as well.
              3) machine is happy

              apart from our tools, I need to credit Max Lath who is doing inventaire, the federated book library and did a lot of previous work for wiki JSON-LD like the wonderful https://github.com/maxlath/wikibase-sdk

              sl007@digitalcourage.socialS 1 Reply Last reply
              0
              • sl007@digitalcourage.socialS sl007@digitalcourage.social

                @julian

                and then
                1) machine gets thread (cause is JSON-LD by known/allowed `generator`)
                2) machine fetches or gets cached wikidata entry about Berlin and displays the card (kind of "infobox" then).
                .. from the named "SpecialEntitiyData" of wikidata which is JSON-LD as well.
                3) machine is happy

                apart from our tools, I need to credit Max Lath who is doing inventaire, the federated book library and did a lot of previous work for wiki JSON-LD like the wonderful https://github.com/maxlath/wikibase-sdk

                sl007@digitalcourage.socialS This user is from outside of this forum
                sl007@digitalcourage.socialS This user is from outside of this forum
                sl007@digitalcourage.social
                wrote last edited by
                #80

                @julian

                PS - just btw;
                about inventaire I am sharing currently photobooks for free rent in Dortmund, Germany
                https://inventaire.io/users/sl007
                they have also nice use for JSON-LD re. books /authors etc. https://data.inventaire.io/ like so many software in fedi.
                If you ask the redaktor Service Actor for Place (`Question`) to find you a waffle restaurant in Amsterdam serving blue syrup near a train station then we do also use SPARQL like them - without the AI bullshit - just cause millions of friendly humans contributing to wd and OSM …

                1 Reply Last reply
                0
                • hongminhee@hollo.socialH hongminhee@hollo.social

                  I have deeply mixed feelings about #ActivityPub's adoption of JSON-LD, as someone who's spent way too long dealing with it while building #Fedify.

                  Part of me wishes it had never happened. A lot of developers jump into ActivityPub development without really understanding JSON-LD, and honestly, can you blame them? The result is a growing number of implementations producing technically invalid JSON-LD. It works, sort of, because everyone's just pattern-matching against what Mastodon does, but it's not correct. And even developers who do take the time to understand JSON-LD often end up hardcoding their documents anyway, because proper JSON-LD processor libraries simply don't exist for many languages. No safety net, no validation, just vibes and hoping you got the @context right. Naturally, mistakes creep in.

                  But then the other part of me thinks: well, we're stuck with JSON-LD now. There's no going back. So wouldn't it be nice if people actually used it properly? Process the documents, normalize them, do the compaction and expansion dance the way the spec intended. That's what Fedify does.

                  Here's the part that really gets to me, though. Because Fedify actually processes JSON-LD correctly, it's more likely to break when talking to implementations that produce malformed documents. From the end user's perspective, Fedify looks like the fragile one. “Why can't I follow this person?” Well, because their server is emitting garbage JSON-LD that happens to work with implementations that just treat it as a regular JSON blob. Every time I get one of these bug reports, I feel a certain injustice. Like being the only person in the group project who actually read the assignment.

                  To be fair, there are real practical reasons why most people don't bother with proper JSON-LD processing. Implementing a full processor is genuinely a lot of work. It leans on the entire Linked Data stack, which is bigger than most people expect going in. And the performance cost isn't trivial either. Fedify uses some tricks to keep things fast, and I'll be honest, that code isn't my proudest work.

                  Anyway, none of this is going anywhere. Just me grumbling into the void. If you're building an ActivityPub implementation, maybe consider using a JSON-LD processor if one's available for your language. And if you're not going to, at least test your output against implementations that do.

                  #JSONLD #fedidev

                  mcc@mastodon.socialM This user is from outside of this forum
                  mcc@mastodon.socialM This user is from outside of this forum
                  mcc@mastodon.social
                  wrote last edited by
                  #81

                  @hongminhee How hard would it be for a future version of ActivityPub to simply back out JSON-LD support? Would there be a downside to this?

                  julian@activitypub.spaceJ hongminhee@hollo.socialH cochise@social.subversida.deC 3 Replies Last reply
                  0
                  • mcc@mastodon.socialM mcc@mastodon.social

                    @hongminhee How hard would it be for a future version of ActivityPub to simply back out JSON-LD support? Would there be a downside to this?

                    julian@activitypub.spaceJ This user is from outside of this forum
                    julian@activitypub.spaceJ This user is from outside of this forum
                    julian@activitypub.space
                    wrote last edited by
                    #82

                    @mcc@mastodon.social asking the important questions 🤣

                    @hongminhee@hollo.social

                    1 Reply Last reply
                    0
                    • raphael@mastodon.communick.comR This user is from outside of this forum
                      raphael@mastodon.communick.comR This user is from outside of this forum
                      raphael@mastodon.communick.com
                      wrote last edited by
                      #83

                      @silverpill @hongminhee @mariusor

                      I don't remember the details, but
                      Mastodon and Takahe were definitely giving responses in different shapes for a question object.

                      raphael@mastodon.communick.comR 1 Reply Last reply
                      0
                      • ? Guest

                        @julian Yes, POST to personal inbox sends a 404, POST to group inbox sends a 202 (I guess group inbox is how we communicate now).

                        julian@activitypub.spaceJ This user is from outside of this forum
                        julian@activitypub.spaceJ This user is from outside of this forum
                        julian@activitypub.space
                        wrote last edited by
                        #84

                        @silverpill@mitra.social okay! That's a little concerning because all of those routes just end up going to the same controller... but this gives me enough to debug, so thank you!

                        1 Reply Last reply
                        0
                        • raphael@mastodon.communick.comR raphael@mastodon.communick.com

                          @silverpill @hongminhee @mariusor

                          I don't remember the details, but
                          Mastodon and Takahe were definitely giving responses in different shapes for a question object.

                          raphael@mastodon.communick.comR This user is from outside of this forum
                          raphael@mastodon.communick.comR This user is from outside of this forum
                          raphael@mastodon.communick.com
                          wrote last edited by
                          #85

                          @silverpill @hongminhee @mariusor

                          > There might be small variations in how a protocol feature (such as polls) is implemented, but they are not difficult to deal with.

                          This becomes a matter of opinion. You say "not hard to deal with" and "dealing with JSON-LD is a burden".

                          I think that being able to throw (valid) json-ld in any shape and letting the processor deal with it and have only one set of class to represent the types is well off the trade off of having a few extra bytes.

                          raphael@mastodon.communick.comR 1 Reply Last reply
                          0
                          • raphael@mastodon.communick.comR raphael@mastodon.communick.com

                            @silverpill @hongminhee @mariusor

                            > There might be small variations in how a protocol feature (such as polls) is implemented, but they are not difficult to deal with.

                            This becomes a matter of opinion. You say "not hard to deal with" and "dealing with JSON-LD is a burden".

                            I think that being able to throw (valid) json-ld in any shape and letting the processor deal with it and have only one set of class to represent the types is well off the trade off of having a few extra bytes.

                            raphael@mastodon.communick.comR This user is from outside of this forum
                            raphael@mastodon.communick.comR This user is from outside of this forum
                            raphael@mastodon.communick.com
                            wrote last edited by
                            #86

                            @silverpill @hongminhee @mariusor

                            > To be honest, I can't even imagine how JSON-LD could help with that instead of making it harder.

                            References and Context Models - Django ActivityPub ToolKit

                            favicon

                            (activitypub.mushroomlabs.com)

                            1 Reply Last reply
                            0
                            • mcc@mastodon.socialM mcc@mastodon.social

                              @hongminhee How hard would it be for a future version of ActivityPub to simply back out JSON-LD support? Would there be a downside to this?

                              hongminhee@hollo.socialH This user is from outside of this forum
                              hongminhee@hollo.socialH This user is from outside of this forum
                              hongminhee@hollo.social
                              wrote last edited by
                              #87

                              @mcc@mastodon.social I'm not sure, but that would break some ActivityPub implementations relying on JSON-LD processors. 🤔

                              1 Reply Last reply
                              0
                              • mcc@mastodon.socialM mcc@mastodon.social

                                @hongminhee How hard would it be for a future version of ActivityPub to simply back out JSON-LD support? Would there be a downside to this?

                                cochise@social.subversida.deC This user is from outside of this forum
                                cochise@social.subversida.deC This user is from outside of this forum
                                cochise@social.subversida.de
                                wrote last edited by
                                #88

                                @mcc @hongminhee Mastodon, Fedify and other implementations that treat LD as mandatory (MUST) even if it's optional (SHOULD) will be non conformant. As Mastodon is the biggest implementation by far margin, deprecating it is no small feat.

                                mcc@mastodon.socialM 1 Reply Last reply
                                0
                                • cochise@social.subversida.deC cochise@social.subversida.de

                                  @mcc @hongminhee Mastodon, Fedify and other implementations that treat LD as mandatory (MUST) even if it's optional (SHOULD) will be non conformant. As Mastodon is the biggest implementation by far margin, deprecating it is no small feat.

                                  mcc@mastodon.socialM This user is from outside of this forum
                                  mcc@mastodon.socialM This user is from outside of this forum
                                  mcc@mastodon.social
                                  wrote last edited by
                                  #89

                                  @cochise @hongminhee But Mastodon famously doesn't actually *support* LD right? That's the point of the thread? So wouldn't they be the easiest to convince to stop supporting the thing they never supported?

                                  cochise@social.subversida.deC 1 Reply Last reply
                                  0
                                  • mcc@mastodon.socialM mcc@mastodon.social

                                    @cochise @hongminhee But Mastodon famously doesn't actually *support* LD right? That's the point of the thread? So wouldn't they be the easiest to convince to stop supporting the thing they never supported?

                                    cochise@social.subversida.deC This user is from outside of this forum
                                    cochise@social.subversida.deC This user is from outside of this forum
                                    cochise@social.subversida.de
                                    wrote last edited by
                                    #90

                                    @mcc @hongminhee Don't really support, but discards activities without @context anyway.

                                    I suspect JSON-LD was a way to have extensibility and escape XMPP's XEP hell with servers and clients not supporting or disabling features in an infinite matrix.
                                    But seems community favors FEPs describing JSON schemas and hardcoding it over getting them from a server and mapping the object at runtime.

                                    trwnh@mastodon.socialT 1 Reply Last reply
                                    0
                                    • kanru@g0v.socialK This user is from outside of this forum
                                      kanru@g0v.socialK This user is from outside of this forum
                                      kanru@g0v.social
                                      wrote last edited by
                                      #91

                                      @hongminhee I had a similar realization early on when implementing Pinka. I almost went full JSON-LD but found that to properly expand the document I might need to make network calls. I stopped worrying about unknown terms and just hard coded a list of well-known AS and APub terms for interoperability.

                                      trwnh@mastodon.socialT 1 Reply Last reply
                                      0
                                      • incentiveI incentive moved this topic from Uncategorized
                                      • trwnh@mastodon.socialT This user is from outside of this forum
                                        trwnh@mastodon.socialT This user is from outside of this forum
                                        trwnh@mastodon.social
                                        wrote last edited by
                                        #92

                                        @hongminhee what i have found necessary (sadly) is to sometimes ignore what @\context a software produces and simply inject a corrected @\context describing what they *actually* meant instead of what they said they meant. x_x

                                        Link Preview Image
                                        the "incorrect" mastodon context in use right now (or equivalent), which can be swapped out for the "correct" mastodon context to be more compatible with generic json-ld (and more semantically correct)

                                        the "incorrect" mastodon context in use right now (or equivalent), which can be swapped out for the "correct" mastodon context to be more compatible with generic json-ld (and more semantically correct) - mastodon-context-correct.jsonld

                                        favicon

                                        Gist (gist.github.com)

                                        it would be an Exercise to sit down and map out the actual contexts of softwares like mastodon 4.5, mastodon 4.4, misskey 2025.12, akkoma 3.10.2, and so on...

                                        for all else, there's shacl i guess, if you want to beat things into the correct shapes.

                                        julian@activitypub.spaceJ 1 Reply Last reply
                                        0
                                        • kanru@g0v.socialK kanru@g0v.social

                                          @hongminhee I had a similar realization early on when implementing Pinka. I almost went full JSON-LD but found that to properly expand the document I might need to make network calls. I stopped worrying about unknown terms and just hard coded a list of well-known AS and APub terms for interoperability.

                                          trwnh@mastodon.socialT This user is from outside of this forum
                                          trwnh@mastodon.socialT This user is from outside of this forum
                                          trwnh@mastodon.social
                                          wrote last edited by
                                          #93

                                          @kanru @hongminhee ironically this is what you're supposed to do! preload the terms you understand into local contexts. newer jsonld-adjacent specs (vc, cid, and so on) tell you that you MUST NOT fetch the contexts over the network at runtime, and instead MUST treat them as already fetched with a given sha256sum. https://www.w3.org/TR/cid-1.0/#json-ld-context

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups