diff options
Diffstat (limited to 'content/docs/configuration/concurrency.md')
| -rw-r--r-- | content/docs/configuration/concurrency.md | 18 |
1 files changed, 18 insertions, 0 deletions
diff --git a/content/docs/configuration/concurrency.md b/content/docs/configuration/concurrency.md new file mode 100644 index 0000000..0e5e181 --- /dev/null +++ b/content/docs/configuration/concurrency.md @@ -0,0 +1,18 @@ +--- +title: 'Concurrency' +weight: 6 +--- + +The concurrency setting controls the number of simultaneous requests that the scraper can make. This is specified in the configuration object of your scraping script. + +```javascript +export const config = { + // Specify the number of concurrent requests. + concurrency: 5, +}; +``` + +In the above example, the scraper will make up to 5 requests at the same time. + +If the concurrency setting is not specified, there is no limit to the number of concurrent requests. + |