Benchmark / XRD phase identification

Trust should be measured, not claimed.

SciPhys runs a public XRD benchmark across clean powders, textured thin films, multiphase mixtures and substrate-containing scans. Each case exposes the expected phases, recovered phases and failure reasons.

8/8

Cases passed

100.0%

Top-1 accuracy

100.0%

Mean phase recall

100.0%

Strong peak coverage

0.0%

False-positive rate

PASS

Suite status

Evidence-first

A match must explain peaks. The benchmark checks recovered phases and how much of the strong observed signal is covered.

Multiphase-aware

Cases include anatase/rutile, iron oxide mixtures and ZnO on Si so the engine is tested beyond single-phase examples.

Regression-ready

The same suite runs from the CLI, so XRD algorithm changes can be checked before shipping.

CaseExpectedFoundStatus

ZnO wurtzite clean powder

pass

Canonical ZnO peaks with small zero-shift and intensity jitter.

8 observed peaks·100.0% strong coverage·100.0% recall
zno-wurtzite
zno-wurtzite

Top phase hit

Required phases recovered with sufficient strong-peak coverage.

Textured ZnO thin film

pass

A c-axis textured ZnO pattern dominated by (002), similar to lab thin-film scans.

6 observed peaks·100.0% strong coverage·100.0% recall
zno-wurtzite
zno-wurtzite

Top phase hit

Required phases recovered with sufficient strong-peak coverage.

TiO2 anatase clean powder

pass

Anatase polymorph should not be mislabeled as rutile.

8 observed peaks·100.0% strong coverage·100.0% recall
tio2-anatase
tio2-anatase

Top phase hit

Required phases recovered with sufficient strong-peak coverage.

TiO2 rutile clean powder

pass

Rutile polymorph should not collapse into anatase when the main 27.45 degree peak is present.

8 observed peaks·100.0% strong coverage·100.0% recall
tio2-rutile
tio2-rutile

Top phase hit

Required phases recovered with sufficient strong-peak coverage.

Mixed anatase / rutile TiO2

pass

Two TiO2 polymorphs must both survive the multiphase ranking.

12 observed peaks·100.0% strong coverage·100.0% recall
tio2-anatasetio2-rutile
tio2-anatasetio2-rutile

Top phase hit

Required phases recovered with sufficient strong-peak coverage.

ZnO film on Si substrate

pass

Primary ZnO with a strong substrate contribution should keep Si as a secondary phase.

10 observed peaks·100.0% strong coverage·100.0% recall
zno-wurtzitesi-diamond
zno-wurtzitesi-diamond

Top phase hit

Required phases recovered with sufficient strong-peak coverage.

Mixed Fe2O3 / Fe3O4

pass

Common iron-oxide ambiguity case with overlapping peaks.

14 observed peaks·100.0% strong coverage·100.0% recall
fe2o3-hematitefe3o4-magnetite
fe2o3-hematitefe3o4-magnetite

Top phase hit

Required phases recovered with sufficient strong-peak coverage.

CeO2 fluorite clean powder

pass

Fluorite oxide control case with well-separated principal peaks.

7 observed peaks·100.0% strong coverage·100.0% recall
ceo2-fluorite
ceo2-fluorite

Top phase hit

Required phases recovered with sufficient strong-peak coverage.

What comes next

Benchmark results become product evidence.

The public suite is intentionally small and readable. Internally, SciPhys can extend it with real lab cases, expert-reviewed corrections, low-signal scans and instrument-specific edge cases.

The goal is not to hide uncertainty. The goal is to show which claims are backed by measured peaks, which require expert review and which should be rejected before they enter lab memory.