diff options
| author | Philipp Tanlak <philipp.tanlak@gmail.com> | 2023-11-13 22:36:15 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-11-13 22:36:15 +0100 |
| commit | 190056ee8d6a4eca61d92a79cc25aad645e69d4a (patch) | |
| tree | 423cb3dfb7ca92e4c1c48c1070f553bbadc4d890 /docs/configuration/link-following.md | |
| parent | eae10426cd805ecc0a0459b61639e48e6cd913ad (diff) | |
Move docs to flyscrape.com (#11)
Diffstat (limited to 'docs/configuration/link-following.md')
| -rw-r--r-- | docs/configuration/link-following.md | 29 |
1 files changed, 0 insertions, 29 deletions
diff --git a/docs/configuration/link-following.md b/docs/configuration/link-following.md deleted file mode 100644 index 6522ce8..0000000 --- a/docs/configuration/link-following.md +++ /dev/null @@ -1,29 +0,0 @@ -# Link Following - -The `follow` config option allows you to specify a list of CSS selectors that determine which links the scraper should follow. - -When no value is provided the scraper will follow all links found with the `a[href]` selector. - -Example: - -```javascript -export const config = { - url: "http://example.com/", - follow: [".pagination > a[href]", ".nav a[href]"], - // ... -}; -``` - -### Following non `href` attributes - -For special cases where the link is not to be found in the `href`, you specify a selector with a different ending attribute. - -Example: - -```javascript -export const config = { - url: "http://example.com/", - follow: [".articles > div[data-url]"], - // ... -}; -``` |