Skip to main content

Common Configuration Parameters

All rerankers share these common configuration parameters:
ParameterDescriptionTypeDefault
providerReranker provider namestrRequired
top_kMaximum number of results to return after rerankingintNone
api_keyAPI key for the reranker servicestrNone

Provider-Specific Configuration

Zero Entropy

ParameterDescriptionTypeDefault
modelModel to use: zerank-1 or zerank-1-smallstr"zerank-1"
api_keyZero Entropy API keystrNone

Cohere

ParameterDescriptionTypeDefault
modelCohere rerank modelstr"rerank-v3.5"
api_keyCohere API keystrNone
return_documentsWhether to return document texts in responseboolFalse
max_chunks_per_docMaximum chunks per documentintNone

Sentence Transformer

ParameterDescriptionTypeDefault
modelHuggingFace cross-encoder model namestr"cross-encoder/ms-marco-MiniLM-L-6-v2"
deviceDevice to run model on (cpu, cuda, etc.)strNone
batch_sizeBatch size for processingint32
show_progress_barShow progress during processingboolFalse

Hugging Face

ParameterDescriptionTypeDefault
modelHuggingFace reranker model namestr"BAAI/bge-reranker-large"
api_keyHuggingFace API tokenstrNone
deviceDevice to run model on (cpu, cuda, etc.)strNone

LLM-based

ParameterDescriptionTypeDefault
modelLLM model to use for scoringstr"gpt-4o-mini"
providerLLM provider (openai, anthropic, etc.)str"openai"
api_keyAPI key for LLM providerstrNone
temperatureTemperature for LLM generationfloat0.0
max_tokensMaximum tokens for LLM responseint100
scoring_promptCustom prompt template for scoringstrDefault scoring prompt

LLM Reranker

ParameterDescriptionTypeDefault
llm.providerLLM provider for rerankingstrRequired
llm.configLLM configuration objectdictRequired
top_nNumber of results to returnintNone

Environment Variables

You can set API keys using environment variables:
  • ZERO_ENTROPY_API_KEY - Zero Entropy API key
  • COHERE_API_KEY - Cohere API key
  • HUGGINGFACE_API_KEY - HuggingFace API token
  • OPENAI_API_KEY - OpenAI API key (for LLM-based reranker)
  • ANTHROPIC_API_KEY - Anthropic API key (for LLM-based reranker)

Basic Configuration Example

Python
config = {
    "vector_store": {
        "provider": "chroma",
        "config": {
            "collection_name": "my_memories",
            "path": "./chroma_db"
        }
    },
    "llm": {
        "provider": "openai",
        "config": {
            "model": "gpt-5-mini"
        }
    },
    "reranker": {
        "provider": "zero_entropy",
        "config": {
            "model": "zerank-1",
            "top_k": 5
        }
    }
}

TypeScript SDK

The self-hosted TypeScript SDK (mem0ai/oss) supports the same five providers. Config keys are camelCase (apiKey, topK, maxLength) and each provider’s SDK is a peer dependency you install per reranker.
ProviderInstallDefault modelKey config fields
coherepnpm add cohere-airerank-v3.5apiKey, model, topK
zero_entropypnpm add zeroentropyzerank-1apiKey, model, topK
sentence_transformerpnpm add @huggingface/transformersXenova/ms-marco-MiniLM-L-6-v2model, device, maxLength, normalize, topK
huggingfacepnpm add @huggingface/transformersXenova/bge-reranker-basemodel, device, maxLength, normalize, topK
llm_rerankerNone (uses your LLM provider’s own SDK)openai / gpt-4o-miniprovider, model, apiKey, llm (nested override), topK
import { Memory } from "mem0ai/oss";

const memory = new Memory({
  reranker: {
    provider: "zero_entropy",
    config: { apiKey: process.env.ZERO_ENTROPY_API_KEY, topK: 5 },
  },
});
The local cross-encoder providers (sentence_transformer, huggingface) run on Transformers.js and default to ONNX (Xenova/*) model mirrors, so Python default model strings must be swapped for their ONNX equivalents. batchSize and showProgressBar are accepted for parity with Python but are no-ops in the TypeScript runtime. See the reranker feature guide for full examples.