User avatar
xena-the-serverneobot_flag_trans Polyphony Cyberwitchery & Software asparklessparkles_pink @polyphonychat@amazonawaws.com
1mo
The scoring system in slopscore has been completely re-done! foxjump

First: The way signals are tracked stays the same. If a repository had 25 AI-generated commits detected before, that'll still be just the same. The only thing that was touched was the way the score (100 (S)–0 (F)) gets calculated.

Instead of treating every detected AI/slop signal equally, slopscore now tracks the share of tainted commits across a repository.

This means: It now makes a significant impact whether the repository is made up of slop commits to 1% or, say, 50%. Repositories with lower slop-densities get gentler penalties, while high-density repos get scored significantly harsher. It just didn't feel right that 10 slop commits got scored the same, whether the repo only had 15 commits, or already had 10000 commits.

This feature has been in beta for a while and the new scoring curve has been tested for a while before it finally got merged and deployed today.
ablobcat_bounce

Do feel very free to check out the changes by re-scanning repositories you are curious about, and leave feedback either here, on
Zulip or as an issue on the repository! ablobcatwave2_rev
❤️1
8
25
29
1
User avatar
hexa- @hexa@chaos.social
1mo
@polyphonychat nixpkgs has over a million commits and 1237 signals. it gets a score of E+.
1237/1076794
0.001148780546696954

slopscore.ava.pet/repo/https://github.com/nixos/nixpkgs
github.com/NixOS/nixpkgs
1
0
0
0
User avatar
xena-the-serverneobot_flag_trans Polyphony Cyberwitchery & Software asparklessparkles_pink @polyphonychat@amazonawaws.com
1mo
@hexa All of these are just factual statements. What is it that you are appealing to?
1
0
1
0

User avatar
hexa- @hexa@chaos.social
1mo
@polyphonychat I am not appealing for anything. I just point to a big repo to understand if the rating is as intended with the given ratio.
1
0
0
0
User avatar
xena-the-serverneobot_flag_trans Polyphony Cyberwitchery & Software asparklessparkles_pink @polyphonychat@amazonawaws.com
1mo
@hexa Yes. For this ratio, penalties are being reduced to 4% of their original value. While that is a 96% reduction, this still stacks, of course. The rating is as expected.

codeberg.org/polyphony/slopscore/src/commit/7773dc9fc8c3881c58799cdc0dfdb9825f3ac234/src/signals.rs#L213
0
0
2
0