User avatar
Lilly heart_transgender @lilly@mstd.ink
10mo
meta i guess Using captchas (or similar measures) to prevent crawling is just as effective as changing your SSH port. Yes it will stop the script kiddie. No, it will not stop anyone else. Solving capchas costs 1$/1K it is not a big barrier, at least not for the ppl you want to keep out.

I respect robot.txt, some may not. If something is in the public internet, it will be crawled. If you don't wan't your code to be used to train AI moddels, don't make it publicly available.
3
0
0
0
User avatar
celeste_hearts_lesbianceleste_hearts_transceleste_hearts_demisexual flori_ava_star:~cursor_blinking @star@amazonawaws.com
10mo
meta i guess @lilly I agree with everything but
If you don't wan't your code to be used to train AI moddels, don't make it publicly available.
I just don't think that's right
1
0
1
0
User avatar
Lilly heart_transgender @lilly@mstd.ink
10mo
meta i guess @star It isn't. I agree.

But that does not change the current reality, in which this is the status quo.

If your stuff is available to the public. It has been crawled, it will be used in datasets.

I fear that ppl feel a false sense of secruity from when using these "protections"

In this imperfect world we have to work with these conditions, no amount of legislation, wishing, or whatever will change this sadly.
0
0
0
0