Dear all,
As you’ve probably noticed, our platform’s availability has been very inconsistent over the past two weeks. At times, it has been unavailable for hours.
The problem is caused by AI bots and other scrapers that voraciously harvest all sources of useful information: GitLab (source code), the website (documentation), and the forum (discussions and code snippets).
I am currently implementing various measures to address this issue. One of the easiest steps I took was to limit the amount of information available to bots by reducing the visibility of all forks of the reference projects. I changed their status from “public” to “internal.” This means that users who are authenticated on our platform can access them, but bots that crawl our platform without authenticating cannot.