Advanced productivity tracking and context optimization for AI-assisted development

Current Version: 0.3.0 | Python: 3.9+ | Status: Production/Stable

Context Cleaner is a comprehensive productivity tracking tool designed specifically for developers using AI coding assistants like Claude Code. It provides intelligent context health monitoring, performance analytics, and optimization recommendations to maximize development productivity.

• Before/after metrics with quantifiable productivity improvements
• User satisfaction tracking with 1-5 rating system and feedback collection
• Strategy effectiveness analysis across Conservative/Balanced/Aggressive/Focus modes
• ROI demonstration with time-saved calculations and optimization impact
• Export capabilities for comprehensive analytics data backup and analysis

• Multi-strategy optimization with Conservative, Balanced, Aggressive, and Focus modes
• Context health scoring (0-100 scale) based on size, structure, and complexity
• Interactive optimization with operation approval/rejection workflow
• Performance correlation analysis between context optimization and productivity
• Real-time context monitoring with automatic boundary detection

• Comprehensive web interface with integrated telemetry, orchestration, analytics, and performance monitoring
• Tabbed navigation providing Overview, Telemetry, Orchestration, Analytics, and Performance views in one place
• Real-time dynamic data from live telemetry systems with comprehensive legends explaining all metrics
• ML-powered insights with optimization recommendations and workflow performance analysis
• Single entry point - all features accessible through one dashboard interface

• Local-only processing - all data stays on your machine
• PII sanitization - automatic removal of emails, SSNs, credentials, and sensitive data
• Secure file storage with atomic operations and file locking
• Complete data ownership with easy export and deletion
• Transparent operation with open-source codebase

• Comprehensive command set with 20+ commands for all productivity needs
• Multiple output formats (JSON, text) for integration and automation
• Session management with start/end tracking and detailed analytics
• System health monitoring with diagnostics and issue resolution
• Flexible configuration via files, environment variables, or CLI flags

# Install from PyPI
pip install context-cleaner

# Or install from source
git clone https://github.com/context-cleaner/context-cleaner.git
cd context-cleaner
pip install -e .

# Provision local ClickHouse + OpenTelemetry stack
context-cleaner telemetry init

# Load telemetry environment variables (bash/zsh)
source ~/.context_cleaner/telemetry/telemetry-env.sh

Docker Required: Telemetry features rely on Docker and Docker Compose. Install Docker Desktop (macOS/Windows) or Docker Engine (Linux) and ensure it is running before initialising telemetry.

Windows PowerShell: Import the environment variables after telemetry init:

Get-Content "$env:USERPROFILE\.context_cleaner\telemetry\telemetry-env.sh" |
  ForEach-Object {
    if ($_ -match '^export\s+(\w+)=(.+)$') {
      Set-Item -Path Env:$($matches[1]) -Value $matches[2].Trim('"')
    }
  }

Then restart Claude Code or your terminal so the variables take effect.

# Launch the comprehensive dashboard with full orchestration (recommended)
context-cleaner run

# Example: override the dashboard port
context-cleaner run --dashboard-port 8110

The unified dashboard provides everything in one place:

• 📊 Overview: Key metrics and system summary
• 📈 Telemetry: Real-time monitoring with Phase 1-3 widgets
• 🤖 Orchestration: ML-powered workflow coordination and agent utilization
• 🔍 Analytics: Context health and performance trends with detailed legends
• ⚡ Performance: Real-time system resources, database, and cache metrics

Dashboard URL: http://localhost:8110 (default port)

# Frequently used CLI commands
context-cleaner run --status-only --json   # Snapshot orchestrator health
context-cleaner health-check               # System diagnostics
context-cleaner effectiveness --days 7     # Optimization stats
context-cleaner stop                       # Graceful shutdown

# View optimization effectiveness stats
context-cleaner effectiveness --days 30

# Example output:
# 📈 OPTIMIZATION EFFECTIVENESS REPORT
# ====================================
# 📅 Analysis Period: Last 30 days
# 🎯 Total Optimization Sessions: 45
# ⚡ Success Rate: 89.3%
# 💰 Estimated Time Saved: 12.5 hours
# 📊 Average Productivity Improvement: +23.4%
# 🌟 User Satisfaction: 4.2/5.0
# 
# 💡 TOP STRATEGIES:
#    1. Balanced Mode: 67% of sessions, 4.3/5 satisfaction
#    2. Focus Mode: 22% of sessions, 4.5/5 satisfaction  
#    3. Aggressive Mode: 11% of sessions, 3.8/5 satisfaction

# Export all analytics data
context-cleaner export-analytics --days 90 --output analytics-backup.json

# Export with session details
context-cleaner export-analytics --include-sessions --output detailed-report.json

# Basic health check
context-cleaner health-check

# Detailed diagnostics
context-cleaner health-check --detailed

# Auto-fix common issues
context-cleaner health-check --fix-issues

# JSON output for automation
context-cleaner health-check --format json

context-cleaner [OPTIONS] COMMAND [ARGS]...

# Orchestration & Telemetry:
  run                      Orchestrate services and launch the dashboard
  stop                     Gracefully shut down orchestrated services
  telemetry init           Provision ClickHouse/OTEL stack from packaged assets

# Analytics & Health:
  health-check             Perform system health diagnostics
  effectiveness            Display optimization effectiveness statistics
  export-analytics         Export analytics data for archival/analysis

# Session Management:
  session start            Begin tracking a development session
  session end              End the current session
  session stats            Show session statistics for a time window
  session list             List recent sessions

# File/Directory Monitoring:
  monitor start            Begin real-time context monitoring
  monitor status           Show monitoring status
  monitor live             Stream live metrics in the terminal

# Data & Configuration:
  analyze                  Analyze productivity trends
  export                   Export all recorded data
  privacy                  Manage privacy and data retention
  config-show              Show current configuration values

# Start named session for specific project
context-cleaner session start --session-id "api-refactor" --project-path ./my-project

# View session statistics
context-cleaner session stats --days 7

# List recent sessions
context-cleaner session list --limit 10

# End current session
context-cleaner session end

# Start real-time monitoring
context-cleaner monitor start --watch-dirs ./src --watch-dirs ./tests

# Check monitoring status
context-cleaner monitor status

# Launch live console dashboard with 10-second refresh
context-cleaner monitor live --refresh 10

• Effectiveness Overview - Success rates, time saved, and ROI metrics
• Strategy Performance - Comparative analysis of optimization approaches
• User Satisfaction Trends - Rating patterns and feedback analysis
• Before/After Comparisons - Quantifiable productivity improvements
• Interactive Controls - Operation triggers and real-time adjustments

• Current productivity score with 7-day trend analysis
• Session statistics including count, duration, and effectiveness
• Optimization events with detailed success/failure tracking
• Health trend indicators showing improvement/decline patterns
• Time-series charts with productivity correlation analysis

• Personalized recommendations based on effectiveness data
• Optimal strategy suggestions for different context types
• Performance alerts when productivity patterns change
• ROI calculations demonstrating Context Cleaner's value

# Analysis Configuration
analysis:
  health_thresholds:
    excellent: 90
    good: 70
    fair: 50
  max_context_size: 100000
  token_estimation_factor: 0.25
  circuit_breaker_threshold: 5

# Dashboard Configuration  
dashboard:
  port: 8110
  host: localhost
  auto_refresh: true
  cache_duration: 300
  max_concurrent_users: 10

# Effectiveness Tracking (NEW)
tracking:
  enabled: true
  sampling_rate: 1.0
  session_timeout_minutes: 30
  data_retention_days: 90
  anonymize_data: true

# Privacy & Security (ENHANCED)
privacy:
  local_only: true
  encrypt_storage: true
  auto_cleanup_days: 90
  require_consent: true

# Data Directory
data_directory: "~/.context_cleaner/data"
log_level: "INFO"

export CONTEXT_CLEANER_PORT=8080
export CONTEXT_CLEANER_HOST=localhost
export CONTEXT_CLEANER_DATA_DIR=~/my-context-data
export CONTEXT_CLEANER_LOG_LEVEL=DEBUG
export CONTEXT_CLEANER_LOCAL_ONLY=true

• PII Sanitization: Automatic removal of emails, SSNs, credit cards, and credentials
• Content Hashing: Secure data integrity without storing raw content
• Atomic File Operations: Race-condition protection with file locking
• Secure Permissions: All data files use 0o600 permissions (owner-only access)
• Input Validation: Comprehensive sanitization and size limits

• Local Storage: All data in ~/.context_cleaner/data/ with secure permissions
• No Telemetry: Zero external network requests or data transmission
• At-Rest Encryption: Optional AES-256 encryption for sensitive data
• Data Retention: Configurable automatic cleanup after specified period
• Resource Limits: Built-in protection against resource exhaustion

# View privacy information
context-cleaner privacy show-info

# Export all your data
context-cleaner export --format json --output my-data.json

# Permanently delete all data
context-cleaner privacy delete-all

Context Cleaner v0.2.0 Architecture
├── 📊 Analytics Engine (ENHANCED)
│   ├── ProductivityAnalyzer - Core analysis algorithms  
│   ├── EffectivenessTracker - Before/after metrics & ROI
│   ├── TrendCalculator - Time-series analysis
│   └── CrossSessionAnalytics - Multi-session insights
├── 📈 Dashboard System (ENHANCED)
│   ├── Web Server - FastAPI-based interface
│   ├── Data Visualization - Interactive charts & effectiveness
│   ├── Real-time Updates - Live metric streaming
│   └── Enhanced Controls - Operation triggers & analytics
├── 🗃️ Data Management (SECURED)
│   ├── Session Tracking - Development session boundaries
│   ├── Secure Storage - Atomic operations & file locking
│   ├── PII Sanitization - Automated sensitive data removal
│   └── Privacy Controls - Data export/deletion with encryption
└── 🔧 CLI Interface (EXPANDED)
    ├── Command Processing - 15+ commands with validation
    ├── Output Formatting - JSON/text formats for automation
    ├── Session Management - Start/end/stats tracking
    └── Health Monitoring - System diagnostics & auto-repair

# Clone repository
git clone https://github.com/context-cleaner/context-cleaner.git
cd context-cleaner

# Install development dependencies
pip install -e .[dev]

# Run full test suite (146 tests)
pytest

# Run specific test categories
pytest -m unit           # Unit tests only
pytest -m integration    # Integration tests only  
pytest -m security       # Security tests (NEW)

# Code quality
black src/ tests/
flake8 src/ tests/
mypy src/

# Full test suite with coverage
pytest --cov=context_cleaner --cov-report=html

# Test new analytics features
pytest tests/cli/test_pr20_analytics_integration.py -v

# Security and performance tests
pytest tests/cli/test_pr20_analytics_integration.py::TestSecurityAndPerformanceFixes -v

• Single-entry orchestration: context-cleaner run command as unified entry point
• Supervisor architecture: Long-running IPC supervisor with process registry
• Enhanced shutdown: Streaming progress updates and targeted service control
• Watchdog monitoring: Automatic service health checks and restart capabilities
• Process registry: Comprehensive service tracking and state management

• analytics - Advanced analytics and predictive intelligence
• bridge - Token analysis bridge service management
• debug - Process registry and service health debugging
• jsonl - JSONL content processing and analysis
• migration - Enhanced token analysis migration tools
• token-analysis - Anthropic token analysis integration
• update-data - Widget data staleness diagnostics

• Telemetry resources packaged with ClickHouse schema
• Gunicorn included in runtime dependencies
• Windows PowerShell environment variable support
• Improved dashboard asset packaging and verification

• ClickHouse schema fixes with optional-table handling
• Stale PID file cleanup for stable dashboard startup
• Developer utilities sanitized for path derivation
• Enhanced integration verification for distributions

• Effectiveness Tracking System: Quantifiable before/after productivity metrics
• User Satisfaction Monitoring: Rating system with feedback collection
• Strategy Analysis: Performance comparison across optimization modes
• ROI Demonstration: Time-saved calculations and productivity improvements
• Enhanced CLI: 3 new commands (health-check, export-analytics, effectiveness)

• PII Sanitization: Automatic sensitive data removal before storage
• Atomic File Operations: Race-condition prevention with exclusive locking
• Secure Storage: Enhanced file permissions and data integrity protection
• Content Hashing: Secure data handling without raw content storage

• Session Indexing: O(1) lookups instead of O(n) file scans
• LRU Caching: Optimized frequent data access patterns
• Optimized I/O: Index-based filtering and reduced file operations
• Memory Management: Efficient resource usage and cleanup

• Installation Guide
• CLI Reference
• Analytics Guide
• Configuration Reference

• GitHub Issues - Bug reports and feature requests
• GitHub Discussions - Questions and support
• Documentation - Comprehensive guides

• Machine Learning Analytics: AI-powered productivity insights and forecasting
• Team Collaboration: Aggregated (anonymized) team productivity metrics
• IDE Integration: Direct integration with popular development environments
• Advanced Visualizations: Enhanced charts and productivity correlation analysis

• Cross-Project Analytics: Multi-repository productivity tracking
• Custom Metrics: User-defined productivity indicators and thresholds
• API Integration: Webhooks and external service connectivity
• Performance Benchmarking: Industry-wide anonymous productivity comparisons

Context Cleaner v0.3.0 - Transforming AI-assisted development through intelligent productivity tracking, effectiveness measurement, and optimization.

Built with ❤️ for developers who want to understand and improve their coding productivity.