GPU-accelerated video synthesis SDK for Rust

scheng is a Rust engine and SDK for building programmable video instruments. Rather than a fixed VJ application, it gives you the building blocks: a graph-based execution model, explicit shader contracts, and a modular I/O surface. You wire them into your own executable.

The engine is deliberately minimal — it evaluates frames deterministically. It does not own time, schedule execution, or manage devices. Those responsibilities belong to your instrument.

Build real-time shader instruments — live mixers, processors, and generators — with professional video I/O built in.

cargo run --release -- --width 1920 --height 1080 --msaa 4

• GPU-native — Rgba16Float render pipeline on Metal, DX12, and Vulkan via wgpu
• Hot-reload shaders — edit GLSL, save, see — zero restart
• MIDI & OSC — CC messages wire directly to shader uniforms with configurable smoothing
• Professional I/O — Syphon, NDI, Spout, RTMP, RTSP, webcam, video file
• bt.709 colorspace — correct color tagging on all FFmpeg output
• 4K + MSAA — runtime resolution and anti-aliasing control
• Graph-based — composable node topology, deterministic execution
• Spout output — Windows DX texture sharing (coming soon)

Four ready-to-run reference instruments. Clone one and you're rendering on the GPU in minutes.

# Clone a template
git clone https://github.com/yourorg/scheng-gradient
cd scheng-gradient

# Build and run
cargo run --release

Requirements: Rust 1.75+, ffmpeg in PATH. macOS: vendor/Syphon.framework for Syphon I/O.

crates/
  scheng-graph               # Graph topology and compilation
  scheng-runtime-wgpu        # wgpu render pipeline and executor
  scheng-param-store         # ParamStore, MIDI/OSC routing, smoothing
  scheng-hotreload           # File watcher, shader hot-reload
  scheng-input-{midi,osc,webcam,video,ndi,syphon,rtmp}
  scheng-output-{syphon,ndi,spout,ffmpeg}
examples/
  scheng-instrument          # Full-featured reference instrument

MIT — see LICENSE.