Skip to main content

System Intelligence Dashboard

Operational metrics showing how Logicon's knowledge base grows and forecasting calibration improves over time

Last updated: 17 May 2026, 07:21

At a Glance

Key performance indicators from production systems

Live
Live
1,374
Predictions Generated
480 backfill resolved
Computed
187
Brain Documents
11 domain branches
Computed
12
Active Agents
Specialized domain experts
Live
0.106
Brier Score
n=480 (lower = better)
Live
0.95
AUC-ROC
Discrimination ability
Live
6 active
OSINT Connectors
9 monitored · 724 sweeps

Knowledge Base Growth

Documents added per week, by domain branch

Computed

Top Branches

06 forecasting ml
29
08 geopolitical context
22
01 diana
21
02 nato doctrine
20
07 osint sources
18
04 warfighter operations
15

Forecasting Calibration

Continuous improvement through walk-forward validation and isotonic calibration

Live

Brier Score Trajectory

Lower is better. Target: 0.10

AUC-ROC Trajectory

Higher is better. Ascending = improvement

Cumulative Predictions

Total structural predictions generated over time

Domain Calibration Scores

Brier score by conflict theatre (lower = better calibrated)

Live

Prediction Methods

Structural prediction generation by method

Live

Active Parameters

Structural baseline modelPITF aligned baseline
Defence-domain ensembleProduction ML ensemble
Confidence estimatorProbability calibrator
Calibration layerIsotonic regression on validation set
35 total versions · 0 drift alerts

Knowledge Domain Coverage

Structured knowledge base branches accessed by domain expert agents

Computed
01
forecasting ml
29 docs
02
geopolitical context
22 docs
03
diana
21 docs
04
nato doctrine
20 docs
05
osint sources
18 docs
06
warfighter operations
15 docs
07
defence tech industry
14 docs
08
compliance legal
14 docs
09
mss nato
13 docs
10
logicon internal
11 docs
11
aco sop
8 docs

Specialized Agent Network

11 domain expert agents with dedicated roles and knowledge access

Illustrative
Design View — Agent telemetry instrumentation planned for Phase 1. Agent definitions and knowledge bases are operational.
01
DIANA Compliance Expert
Ensures alignment with DIANA Challenge requirements and evaluation criteria
02
NATO Operational Doctrine Expert
Validates terminology and claims against Allied Joint Publications and NATO doctrine
03
Forecasting & ML Methodology Expert
Validates statistical accuracy, ML terminology, and calibration claims
04
OSINT & Geopolitical Analysis Expert
Validates analytical relevance and OSINT source attribution accuracy
05
Technical Writing Expert
Maintains professional communication standards across all materials
06
NATO Warfighter Operations Expert
Validates operational utility claims from a warfighter perspective
07
Allied Command Operations Expert
Validates integration narratives from ACO/SHAPE perspective
08
MSS NATO Expert
Validates MSS NATO integration patterns and technical credibility
09
Defence Industry & Competitive Intel Expert
Tracks competitors and validates positioning against existing solutions
10
Compliance & Legal Expert
Ensures GDPR, export control, and NATO information assurance alignment
11
Multi-LLM Orchestrator
Orchestrates queries across multiple LLM providers for synthesis and validation

OSINT Source Operational Status

Independent sources with redundancy and quality monitoring

Live

Last sweep: 24 Apr 2026, 10:18 (82.0s)

alphavantage
Operational
alternative_me
Operational
binance_announcements
Operational
coinmarketcal
Operational
fred
Operational
gdelt
Failed
Connectivity issue — investigation in progress
halvings
Operational
openexchange
Operational
opensanctions
Failed
throttled: ran within last 120min

Calibration Diagnostics

Standard ML reliability assessment

Live

Reliability Diagram

Perfect calibration = diagonal line. n=480

Insufficient data for reliability diagram

Prediction Confidence Distribution

Histogram of all backfill prediction probabilities

Learning Pipeline Activity

Autonomous retraining cycles and model activations

Live
gate3 first trainingactivated24/04/2026, 15:28
gate3 first trainingactivated24/04/2026, 15:23
gate3 first trainingactivated24/04/2026, 15:22
gate3 first trainingactivated24/04/2026, 15:17
gate3 first trainingactivated23/04/2026, 01:58
gate3 first trainingrejected23/04/2026, 01:58
gate3 first trainingrejected23/04/2026, 01:56
manualerror21/04/2026, 17:22

System Intelligence Index

Composite metric of operational maturity

Computed
78
/ 100
Calibration
58 (35%)
Discrimination
95 (25%)
Knowledge
94 (20%)
Sources
78 (20%)

Computed daily. Formula: Calibration (35%) + Discrimination (25%) + Knowledge (20%) + Sources (20%). Methodology at /methodology.