index
:
flyscrape
docs
golib
master
Flyscrape is a command-line web scraping tool designed for those without advanced programming skills.
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
modules
Age
Commit message (
Expand
)
Author
2024-02-09
Add 403 Forbidden as retryable HTTP status code
v0.7.1
Philipp Tanlak
2024-02-07
Add retry module and change rate to requests per minute (#37)
v0.7.0
Philipp Tanlak
2024-01-10
Fix addition of invalid proxy url
Philipp Tanlak
2024-01-10
Add single proxy support (#30)
Philipp Tanlak
2023-12-04
Make output file and format configurable (#24)
Philipp Tanlak
2023-11-23
Add custom request header (#18)
Rafi Ramadhana
2023-11-20
Gracefully handle NaN and Inf values (#21)
Philipp Tanlak
2023-11-15
Add file download functionality
Philipp Tanlak
2023-11-15
Add multiple starting URLs
rafiramadhana
2023-10-30
Refactor to prepare for builtin JS functions
Philipp Tanlak
2023-10-19
Avoid caching of rate limited or errored paged
Philipp Tanlak
2023-10-17
Add HTTP(S) Proxy support
Philipp Tanlak
2023-10-17
Allow configuration of links to follow
Philipp Tanlak
2023-10-11
Implement file based caching
Philipp Tanlak
2023-10-11
Fix jsonprint output in dev mode
Philipp Tanlak
2023-10-05
Refactor codebase into modules
Philipp Tanlak
2023-09-24
clean up modules
Philipp Tanlak
2023-09-23
refactor scraper into modules
Philipp Tanlak