nico/metalfrom.eu
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
Metal from Europe — carte interactive des groupes de metal européens (frontend statique + API Node.js + PostgreSQL/PostGIS + geocoder)
23 commits 2 branches 0 tags 4.4 MiB
JavaScript 52.3%
HTML 20.2%
CSS 16.3%
Python 9.9%
PLpgSQL 0.8%
Other 0.5%
Find a file
Nicolas Fryder 260200e251 feat(crawler): nouveau service crawler server-side via FlareSolverr 
- apps/crawler/ : service Python complet, remplace les scripts locaux
  - FlareSolverr pour bypasser Cloudflare (cookies CF → session requests)
  - Crawl incrémental : /archives/band-list/by/created et /by/modified
  - Crawl complet Europe : pagination AJAX /browse/ajax-country/
  - Enrichissement : pages individuelles de bands (themes, membres, label, hash)
  - Écriture directe en DB (upserts bulk, idempotents)
  - Scheduler intégré (schedule library) : incrémental 4h, enrich 2h, full le 1er du mois
  - Tracking via crawl_run et crawl_checkpoint (migration 004)
- docker-compose.dev.yml : flaresolverr + crawler ajoutés
  Full crawl désactivé en dev (CRAWLER_SCHED_FULL_DAY=0)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-27 15:15:29 +02:00
apps feat(crawler): nouveau service crawler server-side via FlareSolverr 2026-06-27 15:15:29 +02:00
infra feat(db): système de migrations SQL + refonte schéma 2026-06-27 15:09:35 +02:00
.gitignore fix: exclure .claude du tracking git 2026-06-27 11:35:14 +02:00
docker-compose.dev.yml feat(crawler): nouveau service crawler server-side via FlareSolverr 2026-06-27 15:15:29 +02:00
docker-compose.yml fix: revenir aux labels Traefik hardcodés + docker-compose.dev.yml 2026-06-27 12:49:28 +02:00
README.md test deploy 4 2026-06-27 14:05:50 +02:00

README.md

Stack metalfrom.eu

test 4