Week 07 2026 Changelog
Added
- Added a new shell script
hnb-book-crawler/run_crawler_cron.shto help automate running the crawler on a schedule. - Created a
TODO.mdfile to track upcoming tasks and improvements.
Changed
- Updated crawler-related files including
hnb-book-crawler/newsletter/helpers.pyto improve comment and newsletter helper functions. - Modified
scripts/latest_social_posts.jsonto update or add recent social media post data. - Improved
scripts/backfill_authors_books.pyto better handle author and book data backfilling.
Infra/CI
- Made changes to the crawler’s Dockerfile (
hnb-book-crawler/Dockerfile.cron) and crontab (hnb-book-crawler/crontab.crawler) to enhance scheduled crawling and automation workflows.