Skip to main content

​
Overview

The Bitfab web portal at bitfab.ai is where you view your traced AI workflows, inspect individual traces, label results, and manage automated graders.

​
Trace Functions

When you instrument your code with the SDK, each getFunction() or get_function() call registers a trace function - a named group of related spans. The main navigation lists all your trace functions with summary stats:
  • Total traces captured
  • Evaluation status - how traces are performing against your graders
  • Recent activity - latest traces and their outcomes
Click a trace function to see all of its traces, graders, and evaluation results.

​
Traces

Each execution of an instrumented function produces a trace - a tree of spans capturing the full call stack with inputs, outputs, timing, and errors.

​
Trace List

The trace list for a function shows:

​
Trace Detail

Click a trace to see the full span tree:
Each span shows its input, output, errors, context, timing, and prompt (if set). Click individual spans to drill into nested calls.

​
Searching and Filtering

Filter traces by:
  • Status: Success or error
  • Date range: Filter by time period
  • Grader results: Pass or fail on specific graders
  • Full-text search: Search across inputs, outputs, and error messages
  • Tags: Filter by assigned tags

​
Labeling

Label traces to build evaluation datasets and track quality. See the Labeling guide for details.

​
Datasets, Graders, and Experiments

Beyond browsing and labeling traces, the portal is where you manage Bitfab’s other primitives: datasets of curated traces, graders that score them automatically, and experiments that replay a dataset against your changed code. See the Primitives overview for how they fit together. These are created from your coding agent rather than from a form in the portal. The New buttons on each list show the prompt to use.

​
Settings

Additional configuration is available in the user menu:

API Keys

Manage API keys for SDK authentication

Integrations

Configure external service connections

Tags

Organize traces with tags

​
Organizations

Bitfab uses organizations to group resources:
  • Each user belongs to one or more organizations
  • Trace functions, traces, and API keys are scoped to an organization
  • Team members can be invited to collaborate

​
Switching Organizations

If you belong to multiple organizations, use the organization switcher in the header to change between them.