summaryrefslogtreecommitdiff
path: root/docs/configuration/link-following.md
diff options
context:
space:
mode:
authorPhilipp Tanlak <philipp.tanlak@gmail.com>2023-11-13 22:36:15 +0100
committerGitHub <noreply@github.com>2023-11-13 22:36:15 +0100
commit190056ee8d6a4eca61d92a79cc25aad645e69d4a (patch)
tree423cb3dfb7ca92e4c1c48c1070f553bbadc4d890 /docs/configuration/link-following.md
parenteae10426cd805ecc0a0459b61639e48e6cd913ad (diff)
Move docs to flyscrape.com (#11)
Diffstat (limited to 'docs/configuration/link-following.md')
-rw-r--r--docs/configuration/link-following.md29
1 files changed, 0 insertions, 29 deletions
diff --git a/docs/configuration/link-following.md b/docs/configuration/link-following.md
deleted file mode 100644
index 6522ce8..0000000
--- a/docs/configuration/link-following.md
+++ /dev/null
@@ -1,29 +0,0 @@
-# Link Following
-
-The `follow` config option allows you to specify a list of CSS selectors that determine which links the scraper should follow.
-
-When no value is provided the scraper will follow all links found with the `a[href]` selector.
-
-Example:
-
-```javascript
-export const config = {
- url: "http://example.com/",
- follow: [".pagination > a[href]", ".nav a[href]"],
- // ...
-};
-```
-
-### Following non `href` attributes
-
-For special cases where the link is not to be found in the `href`, you specify a selector with a different ending attribute.
-
-Example:
-
-```javascript
-export const config = {
- url: "http://example.com/",
- follow: [".articles > div[data-url]"],
- // ...
-};
-```