crawler

primal 798f79bfe9 Auto-deny feeds that are not RSS or Atom type

Feeds with type other than 'rss' or 'atom' (e.g., 'unknown') are now
automatically denied on discovery. Also updated 164 existing feeds.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-01-29 13:13:22 -05:00

static

Add sort toggle for domain list (A-Z vs feed count)

2026-01-29 13:09:31 -05:00

.dockerignore

Add Docker support and refactor data layer

2026-01-26 16:02:05 -05:00

.gitignore

Add PDS credentials env file for service auth

2026-01-26 19:38:36 -05:00

CLAUDE.md

Migrate from SQLite to PostgreSQL

2026-01-28 20:38:13 -05:00

crawler.go

Optimize stats and TLD queries for performance

2026-01-29 13:00:13 -05:00

dashboard.go

Add sort toggle for domain list (A-Z vs feed count)

2026-01-29 13:09:31 -05:00

db.go

Add URL shortener for link tracking and shorter posts

2026-01-28 22:43:42 -05:00

docker-compose.yml

Use url.1440.news for shorter URLs (28 chars vs 32)

2026-01-28 22:52:45 -05:00

Dockerfile

Add Docker support and refactor data layer

2026-01-26 16:02:05 -05:00

domain.go

Enable all TLDs for import and auto-deny spam domains

2026-01-29 12:49:52 -05:00

feed.go

Auto-deny feeds that are not RSS or Atom type

2026-01-29 13:13:22 -05:00

html.go

Migrate from SQLite to PostgreSQL

2026-01-28 20:38:13 -05:00

main.go

Enable .com domain import from vertices.txt.gz

2026-01-28 21:59:14 -05:00

parser.go

Add AT Protocol publishing, media support, and SQLite stability

2026-01-28 15:30:02 -05:00

pds.env.example

Add PDS credentials env file for service auth

2026-01-26 19:38:36 -05:00

publisher.go

Add rich text links, language filter, and domain deny feature

2026-01-29 12:36:58 -05:00

shortener.go

Use url.1440.news for shorter URLs (28 chars vs 32)

2026-01-28 22:52:45 -05:00

util.go

Add PebbleDB storage, domain tracking, and web dashboard

2026-01-22 16:29:00 -05:00