2edc359b5e
Major Updates:
- Added image downloading for Instagram, YouTube, and Podcast scrapers
- Implemented cumulative markdown system for maintaining single source-of-truth files
- Deployed production services with automatic NAS sync for images
- Standardized file naming conventions per project specification
New Features:
- Instagram: Downloads all post images, carousel images, and video thumbnails
- YouTube: Downloads video thumbnails (highest quality available)
- Podcast: Downloads episode artwork/thumbnails
- Consistent image naming: {source}_{item_id}_{type}.{ext}
- Cumulative markdown updates to prevent file proliferation
- Automatic media sync to NAS at /mnt/nas/hvacknowitall/media/
Production Deployment:
- New systemd services: hvac-content-images-8am and hvac-content-images-12pm
- Runs twice daily at 8 AM and 12 PM Atlantic time
- Comprehensive rsync for both markdown and media files
File Structure Compliance:
- Renamed Instagram backlog to spec-compliant format
- Archived legacy directory structures
- Ensured all new files follow <brandName>_<source>_<dateTime>.md format
Testing:
- Successfully captured Instagram posts 1-1000 with images
- Launched next batch (posts 1001-2000) currently in progress
- Verified thumbnail downloads for YouTube and Podcast content
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
18 lines
No EOL
550 B
Desktop File
18 lines
No EOL
550 B
Desktop File
[Unit]
|
|
Description=HVAC Content Aggregation with Images - 12 PM Run
|
|
After=network.target
|
|
|
|
[Service]
|
|
Type=oneshot
|
|
User=ben
|
|
Group=ben
|
|
WorkingDirectory=/home/ben/dev/hvac-kia-content
|
|
Environment="PATH=/home/ben/.local/bin:/usr/local/bin:/usr/bin:/bin"
|
|
Environment="DISPLAY=:0"
|
|
Environment="XAUTHORITY=/run/user/1000/.mutter-Xwaylandauth.90WDB3"
|
|
ExecStart=/usr/bin/bash -c 'source /home/ben/dev/hvac-kia-content/.venv/bin/activate && python run_production_with_images.py'
|
|
StandardOutput=journal
|
|
StandardError=journal
|
|
|
|
[Install]
|
|
WantedBy=multi-user.target |