Skip to content

MemoryBench

Open-source framework for standardized, reproducible benchmarks of memory layer providers

Our goal is to make evaluation more rigorous, accessible, and in line with industry standards. Design and run evaluations tailored to your specific needs, and run industry-standard benchmarks easily on any memory provider. With MemoryBench, you can trust in provider through transparent, reproducible, and domain-relevant evaluations.

Web Interface

`bun run src/index.ts serve`

Installation

Get MemoryBench up and running in your environment

CLI Reference

Command-line interface for running evaluations

Architecture

Understanding MemoryBench's design and implementation

MemScore

Composite metric for comparing quality, latency, and token efficiency

Works with any memory provider

Supermemory

Mem0

Zep

INFO

We're actively adding support for more providers. Contribute your own or create a feature request.

Contribute

Built as an internal reference companion.