User avatar
xena-the-serverneobot_flag_trans Polyphony Cyberwitchery & Software asparklessparkles_pink @polyphonychat@amazonawaws.com
1mo
The scoring system in slopscore has been completely re-done! foxjump

First: The way signals are tracked stays the same. If a repository had 25 AI-generated commits detected before, that'll still be just the same. The only thing that was touched was the way the score (100 (S)–0 (F)) gets calculated.

Instead of treating every detected AI/slop signal equally, slopscore now tracks the share of tainted commits across a repository.

This means: It now makes a significant impact whether the repository is made up of slop commits to 1% or, say, 50%. Repositories with lower slop-densities get gentler penalties, while high-density repos get scored significantly harsher. It just didn't feel right that 10 slop commits got scored the same, whether the repo only had 15 commits, or already had 10000 commits.

This feature has been in beta for a while and the new scoring curve has been tested for a while before it finally got merged and deployed today.
ablobcat_bounce

Do feel very free to check out the changes by re-scanning repositories you are curious about, and leave feedback either here, on
Zulip or as an issue on the repository! ablobcatwave2_rev
❤️1
8
25
29
1
User avatar
Firstyear @firstyear@infosec.exchange
1mo
@polyphonychat Thanks, such a great tool! I will say its a tough one but slopscore.ava.pet/repo/https://github.com/kanidm/kanidm the agents.md is there to stop ais working, but did cause a penalty for us. Hard to know how to fix that though? Perhaps if agents.md has the refusal string then it doesnt cause a score loss?
1
0
1
0
User avatar
xena-the-serverneobot_flag_trans Polyphony Cyberwitchery & Software asparklessparkles_pink @polyphonychat@amazonawaws.com
1mo
@firstyear Thank you very much for the encouragement! c:

Yeah; we want to tackle this problem somehow, but we are not quite sure on how to best do that yet. It's something that is being actively discussed right now, and that we are hoping to solve some time soon :)
1
0
3
0

User avatar
Steven Reed @srtcd424@mas.to
1mo
@polyphonychat @firstyear a magic char sequence to indicate it's an anti-AI file? The projects that care about such things probably wouldn't mind a small hoop to jump through, and I doubt the boosters would bother to game just that one signal, at least on its own?
1
0
0
0
User avatar
Firstyear @firstyear@infosec.exchange
1mo
@srtcd424 @polyphonychat Yeah agreed, thats why I thought the refusal string would work well here as a booster wouldnt try to game that :)
0
0
1
0