blob: cabb0fa81f8e6f2678f892e13ff1725af124a16a (
plain) (
blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
|
# Depth
The `depth` config option allows you to specify how deep the scraping process should follow links from the initial URL.
When no value is provided or `depth` is set to `0` link following is disabled and it will only scrape the initial URL.
Example:
```javascript
export const config = {
url: "http://example.com/",
depth: 2,
// ...
};
```
With the config provided in the example the scraper would follow links like this:
```
http://example.com/ (depth = 0, initial URL)
↳ http://example.com/deeply (depth = 1)
↳ http://example.com/deeply/nested (depth = 2)
```
|