blob: 6b60d7ebd4e78b320fa4d5940a1b08ab3c338ebc (
plain) (
blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
|
---
title: 'Starting URL'
weight: 1
prev: '/docs/configuration'
---
The `url` config option allows you to specify the initial URL at which the scraper should start its scraping process.
```javascript {filename="Configuration"}
export const config = {
url: "http://example.com/",
// ...
};
```
## Multiple starting URLs
In case you have more than one URL you want to scrape (or to start from) you can specify them with the `urls` config option.
```javascript {filename="Configuration"}
export const config = {
urls: [
"http://example.com/",
"http://anothersite.com/",
"http://yetanothersite.com/",
],
// ...
};
```
|