ADE data pipeline

ADE Master Scraper

Run the full Amsterdam Dance Event pipeline: fetch artists and events, parse lineups, link appearances, capture official pages, and enrich everything with Spotify insights.

Standing byStage 1 of 9
Need granular control?

Pipeline timeline

Follow every chapter in this run

Sync ADE artists

Pull the latest roster direct from the ADE API.

Queued

Sync events & venues

Import every event slot and location update.

Queued

Parse lineups

Break down event lineups into individual artists.

Queued

Link artists ↔ events

Match performers with every appearance across ADE.

Queued

Scrape artist pages

Capture Spotify and social metadata from ADE pages.

Queued

Enrich on Spotify

Pull audio features, popularity, and profile insights.

Queued

Analyze quality

Detect gaps, retries, and missing entities.

Queued

Generate stats

Roll up dashboards and reporting snapshots.

Queued

Pipeline complete

Everything refreshed and stored in Supabase.

Queued

Now processing

Sync ADE artists

0% complete

Kick off the master run to watch live progress here.

Live payloads

What we are capturing

Awaiting run

Launch a run to watch artists, events, and Spotify data appear in real time.

Activity feed

Latest events

Kick off the pipeline to populate the feed.

Database Statistics
Artists Database