diff options
| author | Philipp Tanlak <philipp.tanlak@gmail.com> | 2025-11-24 20:54:57 +0100 |
|---|---|---|
| committer | Philipp Tanlak <philipp.tanlak@gmail.com> | 2025-11-24 20:57:48 +0100 |
| commit | b1e2c8fd5cb5dfa46bc440a12eafaf56cd844b1c (patch) | |
| tree | 49d360fd6cbc6a2754efe93524ac47ff0fbe0f7d /content/docs/configuration/rate-limiting.md | |
Docs
Diffstat (limited to 'content/docs/configuration/rate-limiting.md')
| -rw-r--r-- | content/docs/configuration/rate-limiting.md | 15 |
1 files changed, 15 insertions, 0 deletions
diff --git a/content/docs/configuration/rate-limiting.md b/content/docs/configuration/rate-limiting.md new file mode 100644 index 0000000..4b5bf9c --- /dev/null +++ b/content/docs/configuration/rate-limiting.md @@ -0,0 +1,15 @@ +--- +title: 'Rate Limiting' +weight: 6 +--- + +The `rate` config option allows you to specify at which rate the scraper should send out requests. The rate is measured in _Requests per Minute_ (RPM). + +When no `rate` is specified, rate limiting is disabled and the scraper will send out requests as fast as it can. + +```javascript {filename="Configuration"} +export const options = { + url: "http://example.com/", + rate: 100, +}; +``` |