

Right I must have just blanket banned the whole /8 to be sure alibaba cloud is included. Did some time ago so I forgot
Right I must have just blanket banned the whole /8 to be sure alibaba cloud is included. Did some time ago so I forgot
I am planning to try it out, but for caddy users I came up with a solution that works after being bombarded by AI crawlers for weeks.
It is a custom caddy CEL expression filter coupled with caddy-ratelimit and caddy-defender.
Now here’s the fun part, the defender plugin can produce garbage as response so when a matching AI crawler fits it will poison their training dataset.
Originally I only relied on the rate limiter and noticed that AI bots kept trying whenever the limit was reset. Once I introduced data poisoning they all stopped :)
git.blob42.xyz {
@bot <<CEL
header({'Accept-Language': 'zh-CN'}) || header_regexp('User-Agent', '(?i:(.*bot.*|.*crawler.*|.*meta.*|.*google.*|.*microsoft.*|.*spider.*))')
CEL
abort @bot
defender garbage {
ranges aws azurepubliccloud deepseek gcloud githubcopilot openai 47.0.0.0/8
}
rate_limit {
zone dynamic_botstop {
match {
method GET
# to use with defender
#header X-RateLimit-Apply true
#not header LetMeThrough 1
}
key {remote_ip}
events 1500
window 30s
#events 10
#window 1m
}
}
reverse_proxy upstream.server:4242
handle_errors 429 {
respond "429: Rate limit exceeded."
}
}
If I am not mistaken the 47.0.0.0/8 ip block is for Alibaba cloud
Not yet, it manages snaps but I can add flatpaks as well. I made it so all definitions are in a single file so that people can easily contribute by testing. I will update the documentation to reflect this.
I am not sure I understand the use case but as it stands now you can select a profile and run Gosuki once, it will import everything from said profile or even all profiles if you prefer.
Right now it’s not yet built-in but it’s on the high priority list of features and should be fairly easy to add soon. It will be either a self hosted sync server or a replicated architecture.
For mobile it can be achieved with the autoimport feature and Syncthing
deleted by creator
Haha I literally had no idea even that Pocket was shutting down !! I guess one more argument to avoid subscription services.
Yes that’s exactly how it works. It’s the most difficult part of the project especially for Mozilla browsers.
I figured this is the last place browser vendors didn’t dare yet to lock us out from it.
IMO Despite some unjustified rumors Arch is a very stable distro. For me it feels the same as Debian stability wise while still being on the cutting edge side. The Arch wiki is the second most important reason.
On your HD in a portable sqlite database. It is a fully offline solution.
We need a decentralized community owned cloudflare alternative. Anubis looks on good track.