summaryrefslogtreecommitdiff
path: root/scrape.go
AgeCommit message (Expand)Author
2024-02-21Remove the setup function while we canPhilipp Tanlak
2024-02-17Make urls more fault tolerantv0.7.2Philipp Tanlak
2024-02-17Increase url queue sizePhilipp Tanlak
2024-02-17Mark non 2XX status code as errorsPhilipp Tanlak
2023-12-04Make output file and format configurable (#24)Philipp Tanlak
2023-11-02Refactor stdlib to more generic functionsPhilipp Tanlak
2023-11-01Add login functionalityPhilipp Tanlak
2023-10-30Refactor to prepare for builtin JS functionsPhilipp Tanlak
2023-10-11Implement file based cachingPhilipp Tanlak
2023-10-05Refactor codebase into modulesPhilipp Tanlak
2023-09-24clean up modulesPhilipp Tanlak
2023-09-23refactor scraper into modulesPhilipp Tanlak
2023-08-27rename allow and block fieldsPhilipp Tanlak
2023-08-27add tests and allow urlsPhilipp Tanlak
2023-08-27add Mozilla Public License 2.0Philipp Tanlak
2023-08-17refactorPhilipp Tanlak
2023-08-17add timestampPhilipp Tanlak
2023-08-17omit empty scrape resultsPhilipp Tanlak
2023-08-17change rate to requests per secondPhilipp Tanlak
2023-08-16add allowed domains featurePhilipp Tanlak
2023-08-16create cliPhilipp Tanlak
2023-08-11simplify project structurePhilipp Tanlak
generated by cgit v1.2.3 (git 2.25.1) at 2025-12-06 17:05:17 +0000