siftlode/backend/app/sync
npeter83 6eb552fa04 feat(scheduler): report progress from every job + parallelize RSS polling
Every background job now reports progress, so the dashboard can show a live
bar for any run (not only enrich/backfill/shorts/maintenance): rss_poll and
subscriptions (runner), autotag, and playlist_sync gained progress.report
calls over their loops.

RSS polling now fetches the channel feeds concurrently (16 workers) instead
of one-at-a-time — a slow/unreachable feed no longer blocks the rest, cutting
a full poll of the catalogue from minutes to seconds. Feed fetches are
network-bound and run in the pool; DB inserts stay on the session's thread
(SQLAlchemy sessions aren't thread-safe), applied as each fetch completes.
Split the DB-write half of poll_rss_channel into apply_rss_feed so the fetch
and apply phases compose cleanly.
2026-06-19 02:43:37 +02:00
..
__init__.py feat: M2 (part 1) — subscription import, YouTube client, quota guard 2026-06-11 01:22:07 +02:00
autotag.py feat(scheduler): report progress from every job + parallelize RSS polling 2026-06-19 02:43:37 +02:00
maintenance.py feat(scheduler): admin-tunable maintenance re-validation batch size 2026-06-18 04:37:08 +02:00
playlists.py feat(scheduler): report progress from every job + parallelize RSS polling 2026-06-19 02:43:37 +02:00
runner.py feat(scheduler): report progress from every job + parallelize RSS polling 2026-06-19 02:43:37 +02:00
subscriptions.py chore: structured timestamped logging across the backend 2026-06-11 04:26:18 +02:00
videos.py feat(scheduler): report progress from every job + parallelize RSS polling 2026-06-19 02:43:37 +02:00