CIRCLE WITH A DOT

@fuchsiii

@malwareminigun @nik is an IP address PII if it's NAT'ed? Surely not since numerous individuals could have that IP:port pair over a period of time. Would IPv6 count if not-NAT'ed? While it certainly can be used to get to a specific machine an IP with MAC address embedded (from SLAAC) hardly identifies the person on it's own. IANAL so I'm trying to be sensible, I accept that legal garbage might not be!

@rotnroll666

@glitzersachen @ricmac fair point

@bms48

@ricmac I don't think grep deserves to have some perverse AI failure named after it! That aside, having found out what that term means, it just lends more credibility to the idea that humans and real intelligence are just better at this. LLMs are just for corporations to make money without producing any of their own value.

If you need an actual answer, as the person who wrote the code the LLM was trained on. Don't burn through tokens (in a way that isn't transparent) to come up with slop.

@ricmac How much does handling 12000 (or 6000 for that matter) tokens cost? Do they need to submit the entire thing each time to get some sort of result: a fix, a change, extra code, reformatting, etc? What happens if you send an LLM just a tiny section of code without context? Does that work (I would assume either not at all or not very well) ... so does that mean that people using AI are burning through 1000's of tokens at time as they iterate through development? That sounds crazy expensive and wasteful!

@fabio @mayintoronto @aral WOW! 8Gb memory is fairly steep 100Gb disk is less worrying (though still clearly a bit steep). A year or so ago 64Gb memory was around $200 or a little less. A small Mini PC could be had for $300 with maybe 512Gb SSD.

I guess today things are likely completely out of reach and not practical due to insane costs for memory/storage/other hardware.

That said, maybe there are people with kit they already own that could manage to fit and instance in a mini PC? I have some Raspberry Pi 5s with 16Gb memory and some 512Gb NVMe drives (all of these are things I bought an few years ago for work I was doing for a client and they are now surplus to requirements). I wonder if that setup could cope?

The other hope is that a group of very smart people are re-writing Mastodon in Rust or carrying out some other optimisations (ObFlameWarAvoidance: I have nothing against Ruby, lovely language)

@aral @mayintoronto I keep wondering if something like the FreedomBox blend of Debian https://www.freedombox.org/download/debian/ could include a setup for a home mastodon and if this would be a good idea?

I like that a family/community could have control of their own data and have their own identity and ethos.

On the other hand I suspect that there could be alot more fediblock-ing activity as these individual instances may not follow decent moderation approaches.