i'm at a loss of words after reading a paper about reformatting code using an ML model that has a measured statistical quantity A_c which says how often the reformatted code behaves the same as the original

[whitequark@social.treehouse.systems]

@SRAZKVT @lu_leipzig there is a more real problem of "some people bounce off contributing if you ask them to fix style"

[ingalovinde@embracing.space]

@sabik @xgranade @whitequark @porglezomp but they also changed the boundaries! "Input" checks all values from 2 to i+2 inclusive; but "ground truth" just trows i+2 iteration out.

[illybytes@shrimp.imsofucking.gay]

@hennichodernich @danlyke @whitequark @deborahh @nxskok but like wouldn't that be easy to implement?
like

for(expression;bool expression; affectation) that would turn into
expression; while (bool) { //every possible branch inside while would get affectation }

[sabik@rants.au]

@IngaLovinde @xgranade @whitequark @porglezomp
`i` starts from 1 in the "ground truth" version

[ingalovinde@embracing.space]

@sabik @xgranade @whitequark @porglezomp ah I see, so the new i is just the old one + 1

[benjamineskola@hachyderm.io]

@mc @whitequark do they actually even recognise it as a negative result though?

They seem to be presenting it as a positive one (looking at the abstract and conclusion) — but I admit I'm not familiar with the norms for writing this sort of paper.

[dasgrueneblatt@wien.rocks]

@whitequark amazing

[teilweise@layer8.space]

@whitequark Looking at https://upload.whitequark.org/1774306843-Duetcs_Code_Style_Transfer_through_Generation_and_Retrieval.pdf, Fig. 6:

Look at `bool ok, count = false;`: This leaves “ok” at an undefined value.
In any case that should print “YES”, the `ok = false;` line is never called, it’s undefined whether it prints “YES” or ”NO” (might even be different for each invocation).

Neither the input nor the ground truth had that bug.

It looks like the researches did not notice it and considered it correct.
(64.2% …)

It was obvious to me, would you have caught it?

[srazkvt@tech.lgbt]

@whitequark @lu_leipzig yea, such as: the code being shit

[c0dec0dec0de@hachyderm.io]

@SRAZKVT @whitequark @lu_leipzig in general, I agree, but I almost wish I could have just told the software teams that I worked with a couple years ago “this is style for this language, just drank with it” instead of having hours of meetings about clang-format settings.

[whitequark@social.treehouse.systems]

@c0dec0dec0de @SRAZKVT @lu_leipzig I think it's different for corporate. I don't really care about most corporate code I touch (that isn't already OSS I maintain that is), it's completely whatever. I care a lot about this in projects I'm invested in success of

[sammy@cherrykitten.gay]

@disorderlyf @whitequark i think "ideal" here means "the best case scenario that we encountered under ideal conditions", as opposed to a target for how it should be

[c0dec0dec0de@hachyderm.io]

@whitequark @SRAZKVT @lu_leipzig I get that. At the end of it, I was just like pick something, I don’t care. This will make your code more readable regardless what you pick and minimize diffs in some cases.

[numerfolt@kirche.social]

@whitequark Uh, that's crazy O.o

[disorderlyf@todon.eu]

@urixturing @whitequark I initially thought IEEE was like a standards body specifically for networking, like a hardware W3C. Regardless of who did the research, I thought this was their conclusion. It sounds like I was wrong on both parts

[disorderlyf@todon.eu]

@sammy @whitequark I hope you're right

[urixturing@hachyderm.io]

@disorderlyf @whitequark that would be the IETF, who publishes the RFCs (networking standards like email or HTTP)

[urixturing@hachyderm.io]

@disorderlyf @whitequark but honestly I understand why it's very confusing

[markus@toot.orchid-cottage.uk]

@whitequark They also solved the halting problem?