Benchmarks

Benchmarked on LoCoMo (ACL 2024)

1,986 questions · 10 conversations · Peer-reviewed dataset

System F1 Score Hardware
NEXO Brain v0.5.0   This project 0.588 CPU only
GPT-4 (128K) 0.379 GPU cloud
Gemini Pro 1.0 0.313 GPU cloud
LLaMA-3 70B 0.295 A100 GPU
GPT-3.5 + Contriever 0.283 GPU
93.3%
Adversarial rejection
25s
Ingestion time
768
CPU embeddings (dims)
#1
First MCP server benchmarked

Give your agent a mind

Open source, AGPL-3.0 licensed, and built for builders who want their AI to actually remember.

Star on GitHub Back to Features