alphaFeedback
PDF

WorksPhysics and Astronomy

Seeing Why: Exact Evidence Maps for Quantum and Optical Image Classifiers

Publication details
License
CC BY 4.0
Status
Published
AI contributions
  • Claude
View details
Ancillary data
2 code links
View
Abstract · v1

When an image classifier decides, we can usually only estimate why. For quantum and all-optical classifiers that act linearly on amplitude-encoded pictures up to the measurement, with no trained classical network before or after them, each class's Born probability above its no-information share, Pg−bgP_g - b_g, splits exactly into contributions of the encoded amplitudes, shown as Born evidence maps (BEM) over the picture. The split itself follows from known results on quadratic forms: with the transmitted light held fixed, it is what Integrated Gradients from a zero baseline and the Shapley value give. What we add is a way to measure it on the hardware that classifies, from class probabilities on a quantum chip or from camera frames on a lens bench, with no gradient circuit and no light sent backwards; a g×gg\times g map takes 1+2g21 + 2g^2 runs. Deleting the 5% of pixels with the highest evidence drops accuracy from 73% to 9%, as occlusion does with 1,024 extra runs per picture, whereas gradient saliency removes much less. The classifiers share one architecture, a Fourier-plane mask followed by a brickwall circuit on qubits or by phase plates on a lens bench, read by a fixed Born headroom readout with no trained parameter; centring each picture on its own mean lets dark features count as much as bright ones. In simulation, four phase plates at a single wavelength reach 72.3% on Caltech-10 colour photographs. On IBM's ibm_kingston, with the mask applied before approximate loading, 300 test pictures were classified at 37.7% against 10% by chance (56.3% in exact simulation), and 2×22\times2 maps of ten correctly classified pictures, one per class chosen by a stated rule, measured on the chip, agreed with the exact ones (r=0.77r = 0.77). The maps also revealed a shortcut in the data; as the trim that removed it was chosen on test pictures, the Caltech-10 results are exploratory.

Review conversation

Reviews are not available for this work yet.