Configuration

You can configure Tally using a tally.config.ts (or .js) file in your project root.

defineConfig

Use the defineConfig helper to get full type completion for your configuration.

// tally.config.ts
import { defineConfig } from '@tally-evals/core';

export default defineConfig({
  storage: {
    backend: 'local', // 'local' | 's3' | 'redis'
    path: '.tally',
  },
  evaluators: {
    // default thresholds or settings
  },
});

Loading Configuration

The core package includes a configuration loader that automatically finds and parses your config file.

import { loadConfig } from '@tally-evals/core';

const config = await loadConfig();

Environment Variables

Some storage adapters can be configured via environment variables if not explicitly provided in the config file:

• TALLY_STORAGE_BACKEND: Sets the storage backend.
• TALLY_S3_BUCKET: Sets the S3 bucket name.
• AWS_ACCESS_KEY_ID: Used by the S3 adapter.
• AWS_SECRET_ACCESS_KEY: Used by the S3 adapter.