Docker Compose pipeline that streams Polymarket order book, trade and comment data into Kafka, archives raw events to Parquet, rebuilds order books in memory, computes real-time metrics, models history with dbt-duckdb, and serves a Grafana dashboard. Paper trading and replay backtesting are listed as next steps; real-money trading is out of scope.
Last updated · source link verified
Docker Compose pipeline that streams Polymarket order book, trade and comment data into Kafka, archives raw events to Parquet, rebuilds order books in memory, computes real-time metrics, models history with dbt-duckdb, and serves a Grafana dashboard. Paper trading and replay backtesting are listed as next steps; real-money trading is out of scope. See the source for setup, usage and current status.
Tools: PythonKafkaParquet+3
Difficulty: advanced
Platforms: Polymarket
Docker Compose pipeline that streams Polymarket order book, trade and comment data into Kafka, archives raw events to Parquet, rebuilds order books in memory, computes real-time metrics, models history with dbt-duckdb, and serves a Grafana dashboard. Paper trading and replay backtesting are listed as next steps; real-money trading is out of scope. It is listed under Data & analytics in this directory.
According to its source, it works with Polymarket.
The source lists: Python, Kafka, Parquet, dbt-duckdb, Grafana, Docker Compose.
It was published by xuh5. The public source is at github.com/xuh5/polymarket-Fuzzy-Cognitive-Map.
This directory rates it advanced (beginner, intermediate or advanced).
It had 0 GitHub stars as of Oct 22, 2026.
The repository was last updated on Oct 22, 2026, as checked on Oct 23, 2026. Check the source for current status.
Compare all data & analytics tools → · How to build a Polymarket bot
More data: Prediction market datasets and free Kalshi JSON downloads
Framework for collecting and analyzing prediction-market data, including a large public Kalshi prediction market dataset.
Dataset stat Becker Kalshi dataset: 7.68M markets; 23.9% of settled markets resolved YES. Method on detail page.
Scripts to collect Polymarket market and trade data for analysis.
Student research notebook (Rennes School of Business graduating project) that compares the probability distribution implied by SPXW and NDX option prices, using a fitted SVI smile, with the distribution quoted by Kalshi's S&P 500 and Nasdaq-100 range contracts for the same expiry. Uses Yahoo Finance option data and the Kalshi public API, with a saved snapshot in the repo. Findings are self-reported and based on a single snapshot.
New bots weekly. One email, no spam.
Form not loading? Subscribe on beehiiv. Handled by beehiiv; see privacy. Unsubscribe any time.