For the complete documentation index, see llms.txt. This page is also available as Markdown.

Time Series

Intelligems provides time series for most metrics, allowing you to view how your experiment has performed on these metrics over time. There are two time series modes, cumulative and discrete. Cumulative is enabled by default, to activate discrete, you can uncheck the “Cumulative” checkbox:

Cumulative

With this mode active, the metrics shown in the time series are up to and including the time on the x-axis. For example, in cumulative mode, at X = Jan 1, 2025, the data on the y-axis would be up to and including activity through Jan 1, 2025. Another way of thinking about this is that it’s a snapshot of how the data would have looked at the end of the day on Jan 1, 2025. This can be useful to see how the value of the metric evolved over the course of the experiment

Confidence Intervals

In cumulative mode, you can enable confidence intervals by checking off the “Confidence Intervals” checkbox. This will overlay 95% interval bands around each test group’s lines, allowing you to visualize how certainty of the metric evolved over the course of the experiment. If no confidence interval appears for a timeframe, there may not be enough data available to calculate confidence intervals.

Discrete

With this mode active (i.e., with the “Cumulative” checkbox unchecked) the metrics shown are for only the time period on the X-axis. For example, with daily intervals, at X = Jan 1, 2025, the data on the y-axis would be for the day of Jan 1, 2025 only. This can be useful to see if experiment performance differed significantly during a specific period, for example during a sale.

Custom Probability Visualizations via MCP

The built-in time series charts display underlying metric values (RPV, CVR, AOV, etc.) over the test window. Probability statistics — such as probability to beat control and probability to be best — are shown as current snapshot values on the results dashboard, not as plotted time series.

To visualize how probability statistics change over time for a specific experiment, you can use the Intelligems MCP Server's generate_custom_graph tool. This tool generates a branded Intelligems chart image from raw data, allowing you to plot any custom dataset or metric — including probability to beat control per variation — across the test duration.

For more details, see Available Tools.

Last updated

Was this helpful?