crawler

primal 959abf06c0 Enable .com domain import from vertices.txt.gz

Filter imported domains to only .com TLD for now.
Re-enabled the import loop that was disabled for testing.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-01-28 21:59:14 -05:00

static

Migrate from SQLite to PostgreSQL

2026-01-28 20:38:13 -05:00

.dockerignore

Add Docker support and refactor data layer

2026-01-26 16:02:05 -05:00

.gitignore

Add PDS credentials env file for service auth

2026-01-26 19:38:36 -05:00

CLAUDE.md

Migrate from SQLite to PostgreSQL

2026-01-28 20:38:13 -05:00

crawler.go

Fix image embeds and rkey collisions

2026-01-28 21:24:35 -05:00

dashboard.go

Use PubDate for TID/rkey generation for consistent ordering

2026-01-28 21:32:07 -05:00

db.go

Migrate from SQLite to PostgreSQL

2026-01-28 20:38:13 -05:00

docker-compose.yml

Migrate from SQLite to PostgreSQL

2026-01-28 20:38:13 -05:00

Dockerfile

Add Docker support and refactor data layer

2026-01-26 16:02:05 -05:00

domain.go

Enable .com domain import from vertices.txt.gz

2026-01-28 21:59:14 -05:00

feed.go

Migrate from SQLite to PostgreSQL

2026-01-28 20:38:13 -05:00

html.go

Migrate from SQLite to PostgreSQL

2026-01-28 20:38:13 -05:00

main.go

Enable .com domain import from vertices.txt.gz

2026-01-28 21:59:14 -05:00

parser.go

Add AT Protocol publishing, media support, and SQLite stability

2026-01-28 15:30:02 -05:00

pds.env.example

Add PDS credentials env file for service auth

2026-01-26 19:38:36 -05:00

publisher.go

Upgrade BBC images from 240px to 800px for better quality

2026-01-28 21:49:11 -05:00

util.go

Add PebbleDB storage, domain tracking, and web dashboard

2026-01-22 16:29:00 -05:00