summaryrefslogtreecommitdiff
path: root/docs/configuration/link-following.md
diff options
context:
space:
mode:
Diffstat (limited to 'docs/configuration/link-following.md')
-rw-r--r--docs/configuration/link-following.md29
1 files changed, 0 insertions, 29 deletions
diff --git a/docs/configuration/link-following.md b/docs/configuration/link-following.md
deleted file mode 100644
index 6522ce8..0000000
--- a/docs/configuration/link-following.md
+++ /dev/null
@@ -1,29 +0,0 @@
-# Link Following
-
-The `follow` config option allows you to specify a list of CSS selectors that determine which links the scraper should follow.
-
-When no value is provided the scraper will follow all links found with the `a[href]` selector.
-
-Example:
-
-```javascript
-export const config = {
- url: "http://example.com/",
- follow: [".pagination > a[href]", ".nav a[href]"],
- // ...
-};
-```
-
-### Following non `href` attributes
-
-For special cases where the link is not to be found in the `href`, you specify a selector with a different ending attribute.
-
-Example:
-
-```javascript
-export const config = {
- url: "http://example.com/",
- follow: [".articles > div[data-url]"],
- // ...
-};
-```