Files
crawler/docker-compose.yml
primal 75835d771d Add AT Protocol publishing, media support, and SQLite stability
Publishing:
- Add publisher.go for posting feed items to AT Protocol PDS
- Support deterministic rkeys from SHA256(guid + discoveredAt)
- Handle multiple URLs in posts with facets for each link
- Image embed support (app.bsky.embed.images) for up to 4 images
- External embed with thumbnail fallback
- Podcast/audio enclosure URLs included in post text

Media extraction:
- Parse RSS enclosures (audio, video, images)
- Extract Media RSS content and thumbnails
- Extract images from HTML content in descriptions
- Store enclosure and imageUrls in items table

SQLite stability improvements:
- Add synchronous=NORMAL and wal_autocheckpoint pragmas
- Connection pool tuning (idle conns, max lifetime)
- Periodic WAL checkpoint every 5 minutes
- Hourly integrity checks with PRAGMA quick_check
- Daily hot backup via VACUUM INTO
- Docker stop_grace_period: 30s for graceful shutdown

Dashboard:
- Feed publishing UI and API endpoints
- Account creation with invite codes

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-28 15:30:02 -05:00

35 lines
1.3 KiB
YAML

services:
app-1440-news:
build: .
container_name: app-1440-news
restart: unless-stopped
stop_grace_period: 30s
env_file:
- pds.env
volumes:
- ./feeds:/app/feeds
- ./vertices.txt.gz:/app/vertices.txt.gz:ro
networks:
- proxy
labels:
- "traefik.enable=true"
# Production: HTTPS with Let's Encrypt
- "traefik.http.routers.app-1440-news.rule=Host(`app.1440.news`)"
- "traefik.http.routers.app-1440-news.entrypoints=https"
- "traefik.http.routers.app-1440-news.tls.certresolver=letsencrypt-dns"
# Production: HTTP to HTTPS redirect
- "traefik.http.routers.app-1440-news-redirect.rule=Host(`app.1440.news`)"
- "traefik.http.routers.app-1440-news-redirect.entrypoints=http"
- "traefik.http.routers.app-1440-news-redirect.middlewares=https-redirect"
- "traefik.http.middlewares.https-redirect.redirectscheme.scheme=https"
- "traefik.http.middlewares.https-redirect.redirectscheme.permanent=true"
# Local development: HTTP only
- "traefik.http.routers.app-1440-news-local.rule=Host(`app.1440.localhost`)"
- "traefik.http.routers.app-1440-news-local.entrypoints=http"
# Shared service
- "traefik.http.services.app-1440-news.loadbalancer.server.port=4321"
networks:
proxy:
external: true