8d5750b1d1
- Created unit tests for BaseScraper with mocking - Added integration tests for parallel processing - Created end-to-end tests with realistic mock data - Fixed initialization order in BaseScraper (logger before user agent) - Fixed orchestrator method name (archive_current_file) - Added tenacity dependency for retry logic - Validated parallel processing performance and overlap detection - Confirmed spec-compliant markdown formatting in tests Tests cover: - Base scraper functionality (state, markdown, retry logic, media downloads) - Parallel vs sequential execution timing - Error isolation between scrapers - Directory structure creation - State management across runs - Full workflow with realistic data 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_base_scraper.py | ||
| test_end_to_end.py | ||
| test_instagram_scraper.py | ||
| test_integration_simple.py | ||
| test_orchestrator.py | ||
| test_orchestrator_integration.py | ||
| test_rss_scraper.py | ||
| test_tiktok_scraper.py | ||
| test_wordpress_scraper.py | ||
| test_youtube_scraper.py | ||