Persist and reuse KV Cache to speedup your LLM.

Shuhai is a benchmarking-memory tool that allows FPGA programmers to demystify all the underlying details of memories, e.g., HBM and DDR4, on a Xilinx FPGA [FCCM 20]

HBM is an application to authorize and manage authorized docker commands using Docker AuthZ plugin

NATSA is the first near-data-processing accelerator for time series analysis based on the Matrix Profile (SCRIMP) algorithm. NATSA exploits modern 3D-stacked High Bandwidth Memory (HBM) to enable efficient and fast matrix profile computation near memory. Described in ICCD 2020 by Fernandez et al. https://people.inf.ethz.ch/omutlu/pub/NATSA_time-…

A Scalable BFS Accelerator on FPGA-HBM Platform

A Scalable BFS Accelerator on FPGA-HBM Platform

GTCEu 1.12.2 Pack, Large.

GateSeeder is the first near-memory CPU-FPGA co-design for alleviating both the compute-bound and memory-bound bottlenecks in short and long-read mapping. GateSeeder outperforms Minimap2 by up to 40.3×, 4.8×, and 2.3× when mapping real ONT, HiFi, and Illumina reads, respectively.

DreamRAM: A Fine-Grained Configurable Design Space Modeling Tool for Custom 3D Die-Stacked DRAM

Repo of high bandwidth memory papers, codes, ...

Convert NHibernate XML mapping to Code mapping

Simulates data communication between host memory and HBM on an AMD Alveo U55C FPGA board. Uses PCIe with QDMA to transfer data efficiently between the host and HBM.

Repo for my master thesis

high bandwidth memory study

Thermal-aware batch controller for vLLM/TensorRT-LLM. Prevents HBM thermal throttling from killing p99 latency on H100/H200. Monitors nvidia-smi, auto-cuts batch size at 85°C, migrates cold KV to DRAM. Prometheus + Grafana included. 4.2s -> 2.1s p99 at 128K context.

A small Arduino sketch for reading the RPM of some Chinese lathes and mills.

只是我给自己的MC存档转移OPENCOMPUTER模组里自己写的（并非）小代码的仓库

Analytical simulator for SRMIC — a residency-first LLM inference accelerator architecture using distributed on-package SRAM (HRM) to reduce HBM pressure on the decode critical path.