Skip to content

Techemax/crypto-looker-demo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

26 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

📊 Crypto Looker Demo

A complete cryptocurrency data pipeline project that connects:

  1. Automated ingestion from the public CoinGecko API.
  2. Storage in a TiDB/MySQL database.
  3. Interactive visualization in Looker Studio.
  4. Real-time notifications via Telegram Bot.

🚀 End-to-End Circuit

🔄 1. Data Ingestion

  • The ingest.py script queries CoinGecko for the Top 10 cryptocurrencies by market capitalization.
  • It filters out stablecoins and stores:
    • assets → ranking and market cap.
    • spot_24h → prices, 24h % change, volume.
    • klines_1m → OHLC candlesticks and 1-minute volume.

🗄️ 2. Database

  • Engine: TiDB/MySQL.
  • Main tables:
    • subscribers → Telegram bot users.
    • assets → cryptos and their ranking.
    • spot_24h → snapshots of prices and variations.
    • klines_1m → 1-minute candlesticks.

📊 3. Looker Dashboard

  • Displays all information in a single panel:
    • Users → current subscribers and weekly growth.
    • Market → Top 10 by market cap, prices, % change, volumes, highlighted prices (BTC, ETH, BNB).
    • Candles → OHLC chart and live volume with symbol filter.

👉 🔗 Open Dashboard in Looker


🤖 4. Telegram Bot

  • Users can subscribe with /start.
  • They receive Top 10 crypto market cap summaries directly in Telegram.
  • They can unsubscribe anytime with /stop.

👉 🤖 Try the Telegram Bot
This bot delivers crypto alerts (price thresholds) from my public data project.


🔗 Data Flow

flowchart LR
    A[🌐 CoinGecko API] -->|Top 10 cryptos, prices, candles| B[(🗄️ TiDB/MySQL)]
    B --> C[📊 Looker Studio Dashboard]
    B --> D[🤖 Telegram Bot]

    C -->|Real-time visualization| U[👤 User]
    D -->|Top 10 notifications| U
Loading

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Packages

 
 
 

Contributors

Languages