<![CDATA[Damn those Mythos benchmarks seem very promising]]>Damn those Mythos benchmarks seem very promising

]]>https://board.circlewithadot.net/topic/1729f588-bfc4-4fb4-be07-d51ce437bbdf/damn-those-mythos-benchmarks-seem-very-promisingRSS for NodeSat, 02 May 2026 19:22:52 GMTTue, 07 Apr 2026 20:52:49 GMT60<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 13:47:59 GMT]]>
CC: @justin@toot.io
]]>https://board.circlewithadot.net/post/https://hj.9fs.net/ori/p/1775656079.937365https://board.circlewithadot.net/post/https://hj.9fs.net/ori/p/1775656079.937365Wed, 08 Apr 2026 13:47:59 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 13:44:58 GMT]]>@pojntfx nod. it does have me thinking hard about other forms of baked-in safety. i'll admit this is the first point in my career where i've ever taken elixir seriously.

(well, ok, not really... @abnv ran a team at nilenso that did some amazing work with it for an quiz app that ran in parallel to a tv show. but i've never previously been tempted to learn it.)

]]>https://board.circlewithadot.net/post/https://fantastic.earth/users/deobald/statuses/116369384956721332https://board.circlewithadot.net/post/https://fantastic.earth/users/deobald/statuses/116369384956721332Wed, 08 Apr 2026 13:44:58 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 13:41:20 GMT]]>@pojntfx are you using nanobot for hacking or were you just pointing me to the provider section?

]]>https://board.circlewithadot.net/post/https://fantastic.earth/users/deobald/statuses/116369370657032720https://board.circlewithadot.net/post/https://fantastic.earth/users/deobald/statuses/116369370657032720Wed, 08 Apr 2026 13:41:20 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 13:33:34 GMT]]>@pojntfx @deobald You found glm 5.1 was better than opus4.6 at coding?? Want to split an h200 ?

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/purpleidea/statuses/116369340146244840https://board.circlewithadot.net/post/https://mastodon.social/users/purpleidea/statuses/116369340146244840Wed, 08 Apr 2026 13:33:34 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 07:23:27 GMT]]>@deobald If you'e like to try for yourself I've documented it here: https://gist.github.com/pojntfx/5916ceb7ec35eb010010400447e9c034

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116367884771239435https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116367884771239435Wed, 08 Apr 2026 07:23:27 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 07:22:29 GMT]]>@deobald I'm pretty happy about mostly working with higher-level, memory-safe languages

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116367880988804739https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116367880988804739Wed, 08 Apr 2026 07:22:29 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 07:21:42 GMT]]>@deobald And yeah re:Mythos I'll believe it when I see it, but current-gen models except free is already a massive value IMHO. Sonnet etc. is still very useful despite the other models existing

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116367877896992197https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116367877896992197Wed, 08 Apr 2026 07:21:42 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 07:20:24 GMT]]>@deobald Yup, I used Qwen 3.6 with Nanobot via OpenRouter, Alibaba was providing it for free for testing until yesterday. Switched to GLM 5.1 earlier - same thing, beats Opus. GLM's weights are even MIT-licensed

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116367872813830921https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116367872813830921Wed, 08 Apr 2026 07:20:24 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 07:16:45 GMT]]>@pojntfx have you actually seen qwen perform this well? or are you basing that comment on benchmarks?

i think the mythos benchmarks only have to be "some amount better" at finding 0days than the current public models to justify them waiting on ga... quite a few maintainers are already swamped.

]]>https://board.circlewithadot.net/post/https://fantastic.earth/users/deobald/statuses/116367858403845787https://board.circlewithadot.net/post/https://fantastic.earth/users/deobald/statuses/116367858403845787Wed, 08 Apr 2026 07:16:45 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 00:34:04 GMT]]>@justin Idk this argument has been had like a million times on here and at this point it's getting tiring. It's useful in some contexts. Can be the opposite of that in others. It's being used by more and more projects and people every day with pretty good success lately.

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366274998543909https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366274998543909Wed, 08 Apr 2026 00:34:04 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 00:32:33 GMT]]>@justin Degradation of creativity is a real problem, yes, but "why are you painting a picture of me when you can just take a photo" is nothing new

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366269053731788https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366269053731788Wed, 08 Apr 2026 00:32:33 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 00:32:00 GMT]]>@justin I don't believe in IP, there is no such thing as "theft" of intellectual "property". Copyleft was a means to get to this at some point and might still be a way to get there but times are changing

"garbage AI causes FOSS to deal with on a daily basis" - again, something changed here. It's not useless slop AI security reports anymore like a few months ago. systemd uses it, curl uses, Linux uses because it's useful

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366266861217745https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366266861217745Wed, 08 Apr 2026 00:32:00 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 00:30:12 GMT]]>@pojntfx useful doesn't excuse theft, degradation of creativity and the amount of garbage that AI causes FOSS to deal with on a daily basis.

]]>https://board.circlewithadot.net/post/https://toot.io/users/justin/statuses/116366259812371863https://board.circlewithadot.net/post/https://toot.io/users/justin/statuses/116366259812371863Wed, 08 Apr 2026 00:30:12 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 00:29:58 GMT]]>@justin Meh, the abolition of copyright is a nice side effect

Endless slop polluting clean datasources is a big problem, yes, but not using LLMs for something that is _not_ that won't change it

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366258864807221https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366258864807221Wed, 08 Apr 2026 00:29:58 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 00:29:05 GMT]]>@justin Something changed, either in the harness or the models idk but something changed ~Nov of last year, maybe ~Feb this year I'm not sure, but it's gone from "useless" to "useful" pretty quickly.

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366255433261013https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366255433261013Wed, 08 Apr 2026 00:29:05 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 00:28:28 GMT]]>@pojntfx AI has far more issues than just energy use.

]]>https://board.circlewithadot.net/post/https://toot.io/users/justin/statuses/116366253022312003https://board.circlewithadot.net/post/https://toot.io/users/justin/statuses/116366253022312003Wed, 08 Apr 2026 00:28:28 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 00:27:55 GMT]]>@justin The fix isn't to not use useful tools it's to a) deregulate clean energy infrastructure so that we expand them China-style and b) make sure that the models are open so you can run them on clean energy right now

This is the same argument like with EVs "but the grid is dirty" like yes. Fix that. Don't be anti-EV because of it

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366250824772203https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116366250824772203Wed, 08 Apr 2026 00:27:55 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Wed, 08 Apr 2026 00:21:45 GMT]]>@pojntfx I really don't get the excitement around tech that destroys the earth more than we as humanity have in our history so far?

]]>https://board.circlewithadot.net/post/https://toot.io/users/justin/statuses/116366226589876530https://board.circlewithadot.net/post/https://toot.io/users/justin/statuses/116366226589876530Wed, 08 Apr 2026 00:21:45 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Tue, 07 Apr 2026 20:53:46 GMT]]>Qwen 3.6 is essentially the same as Opus 4.6 now so I guess we'll see how the new generation stacks up?

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116365408781936419https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116365408781936419Tue, 07 Apr 2026 20:53:46 GMT<![CDATA[Reply to Damn those Mythos benchmarks seem very promising on Tue, 07 Apr 2026 20:53:18 GMT]]>Wild that they don't seem to be making it GA, makes me suspect it's probably actually not as good as they say

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116365406933731032https://board.circlewithadot.net/post/https://mastodon.social/users/pojntfx/statuses/116365406933731032Tue, 07 Apr 2026 20:53:18 GMT