summaryrefslogtreecommitdiff
path: root/content/docs/configuration/starting-url.md
diff options
context:
space:
mode:
Diffstat (limited to 'content/docs/configuration/starting-url.md')
-rw-r--r--content/docs/configuration/starting-url.md29
1 files changed, 29 insertions, 0 deletions
diff --git a/content/docs/configuration/starting-url.md b/content/docs/configuration/starting-url.md
new file mode 100644
index 0000000..6b60d7e
--- /dev/null
+++ b/content/docs/configuration/starting-url.md
@@ -0,0 +1,29 @@
+---
+title: 'Starting URL'
+weight: 1
+prev: '/docs/configuration'
+---
+
+The `url` config option allows you to specify the initial URL at which the scraper should start its scraping process.
+
+```javascript {filename="Configuration"}
+export const config = {
+ url: "http://example.com/",
+ // ...
+};
+```
+
+## Multiple starting URLs
+
+In case you have more than one URL you want to scrape (or to start from) you can specify them with the `urls` config option.
+
+```javascript {filename="Configuration"}
+export const config = {
+ urls: [
+ "http://example.com/",
+ "http://anothersite.com/",
+ "http://yetanothersite.com/",
+ ],
+ // ...
+};
+```