Skip to main content

Documentation Index

Fetch the complete documentation index at: https://narev.ai/docs/llms.txt

Use this file to discover all available pages before exploring further.

You need a Narev account to create a benchmark. You can create one by registering here. With an account, you can create a benchmark in four steps.
1

Create the benchmark

Benchmarks and all of their management options are in Narev Cloud -> Benchmarks. After you create a benchmark, the to-do list appears.
Narev Cloud benchmark setup checklist view
2

Define the data source

There are multiple ways to add a data source to a benchmark, from one-off manual entry to programmatic ingestion through an API endpoint.Each data source has a separate page:
Narev Cloud benchmark data source selection
3

Configure variants

To run a benchmark, you need to configure at least one variant. You can select variants with the checkbox marked as 1.2 allows you to create a variant from scratch and 3 gives you recommendation based on the currently selected variants.
Narev Cloud benchmark variant selection view
4

Configure quality evaluation

Each benchmark requires a way to evaluate quality.There are multiple ways to evaluate quality. For concepts, see Quality evaluations.
Narev Cloud quality metrics setup view
With this setup, you are ready to run your first benchmark.