Metrics Reference
quantammsim provides ~30 financial metrics for training objectives and
evaluation. All metrics are computed by
_calculate_return_value(),
which accepts the return_val string from the run fingerprint.
Note
The default training metric is daily_log_sharpe, not sharpe.
This uses log returns and daily periodicity, which is more numerically
stable for gradient-based optimisation.
Return Metrics
|
Description |
Differentiable |
|---|---|---|
|
Total cumulative return: |
Yes |
|
Returns annualised by simulation length: |
Yes |
|
Return relative to holding the initial reserves |
Yes |
|
Annualised return relative to holding the initial reserves |
Yes |
|
Return relative to a uniform (equal-value) hold of all assets |
Yes |
|
Annualised return relative to uniform hold |
Yes |
Risk-Adjusted Metrics
|
Description |
Differentiable |
|---|---|---|
|
Daily log-return Sharpe ratio, annualised via sqrt(365) (default) |
Yes |
|
Annualised Sharpe ratio from minute-resolution arithmetic returns |
Yes |
|
Daily arithmetic-return Sharpe ratio, annualised via sqrt(365) |
Yes |
Drawdown Metrics
|
Description |
Differentiable |
|---|---|---|
|
Maximum peak-to-trough drawdown from initial value (negative) |
Approx |
|
Worst maximum drawdown across non-overlapping weekly chunks |
No (argmax) |
|
Calmar ratio: annualised return / max drawdown |
No |
|
Sterling ratio: annualised return / average of chunk drawdowns (monthly chunks) |
No |
|
Negated Ulcer Index: RMS of percentage drawdowns from running peak (monthly chunks) |
Approx |
Value at Risk Metrics
VaR metrics are available at daily (daily_) and weekly (weekly_)
frequencies, at 95% and 99% confidence levels. The _trad suffix uses
end-of-period (close-to-close) returns; the non-_trad variant uses all
intraday returns within each chunk.
|
Description |
Differentiable |
|---|---|---|
|
5th percentile of intraday returns (daily chunks) |
No (sort) |
|
5th percentile of daily close-to-close returns |
No (sort) |
|
1st percentile of intraday returns (daily chunks) |
No (sort) |
|
1st percentile of daily close-to-close returns |
No (sort) |
|
5th percentile of intraday returns (weekly chunks) |
No (sort) |
|
5th percentile of weekly close-to-close returns |
No (sort) |
|
1st percentile of intraday returns (weekly chunks) |
No (sort) |
|
1st percentile of weekly close-to-close returns |
No (sort) |
RAROC and ROVAR Metrics
RAROC (Risk-Adjusted Return on Capital) divides annualised total return by annualised VaR. ROVAR (Return Over VaR) annualises per-chunk returns independently, averages, then divides by annualised VaR.
|
Description |
Differentiable |
|---|---|---|
|
RAROC using daily intraday VaR (95%) |
No |
|
RAROC using weekly intraday VaR (95%) |
No |
|
ROVAR using daily intraday VaR (95%) |
No |
|
ROVAR using weekly intraday VaR (95%) |
No |
|
ROVAR using monthly intraday VaR (95%) |
No |
|
ROVAR using daily close-to-close VaR (95%) |
Approx |
|
ROVAR using weekly close-to-close VaR (95%) |
Approx |
|
ROVAR using monthly close-to-close VaR (95%) |
Approx |
Special / Diagnostic Metrics
|
Description |
Differentiable |
|---|---|---|
|
Full value-over-time array (not a scalar objective) |
N/A |
|
Dict with |
N/A |
Choosing a Training Metric
For gradient-based training:
``daily_log_sharpe`` (default) – Recommended. Log returns are more numerically stable, and daily periodicity avoids annualisation artifacts.
``sharpe`` – Classic choice. Works well but can have gradient issues with very short or very long simulation windows.
``calmar`` and ``sterling`` – Drawdown-aware, but contain non-differentiable operations (argmax). Gradients are approximate.
For Optuna-based optimisation (gradient-free):
Any metric works, since Optuna doesn’t need gradients.
``calmar`` and ``weekly_max_drawdown`` are popular for robust strategy selection.