betaFeedback

WorksComputer Science

Goal-Driven Autonomous Optical Experimentation via a Self-Recursive Hardware-Software Harness

Abstract

We propose goal-driven self-recursive optical research in which agents use physical evidence to revise the hardware, software, models, and protocols used to pursue a scientific goal. The framework can be instantiated with different stimulus systems and measurement devices. We formalize its updates and derive a relation between physical attainability, command access, and model approximation error. We demonstrate the concept in an optical see-through color-matching case study using an iPad, RayNeo X3 glasses, and a TOP 300 probe coupled to a CAS140D spectroradiometer, both from Instrument Systems. A revised glasses application adds USB-controlled RGB holds and frame acknowledgements, keeping model-generated colors displayed during spectral acquisition. The interface passes 12 live control checks. Spectral feedback reduces one target color difference from 19.756 to 1.211 ΔE_76^*; all five targets improve in a separate comparison. These measurements demonstrate the concept in one configuration. The resulting software and protocols remain available for subsequent investigations.

Introduction

An optical investigation often requires a new stimulus application, coordinated interfaces for measurement devices, or a calibration method suited to the phenomenon being measured. Developing these capabilities is part of the research. An autonomous system must be able to implement scientific decisions on physical equipment and use the resulting evidence to revise both the experiment and its supporting applications.

Self-driving laboratories combine experimental design, physical execution, and inference in closed loops [1]. A mobile robotic chemist demonstrated autonomous exploration of photocatalytic formulations [2], while scientific agents use language-based reasoning to operate computational and laboratory tools [3, 4]. We consider how such a system can establish and develop the hardware and software environment needed for a scientific goal.

We introduce goal-driven self-recursive optical research through an integrated hardware and software harness comprising the apparatus, device applications, measurement interfaces, and analysis tools available to agents. The concept can be instantiated in different experimental configurations. To demonstrate it, we develop a case study in which agents create applications for iPad background generation, RayNeo AR glasses rendering, and optical measurement. Scientific planning determines the experiments, and progress monitoring evaluates the evidence against the goal.

Once the harness is established, a result can prompt a different test or a revision to the software, measurement protocol, or analytical method. Agents implement the revision and resume physical testing.

We call this process self-recursive because evidence changes the means used to obtain further evidence. The scientific goal persists across these changes, including the joint adaptation of experiments and methods.

As a study and demonstration of the concept, we use optical see-through color compensation, in which display emission combines with transmitted background light at the viewing pupil [5, 6]. A question about temporal response or spatial variation may require new capabilities in the stimulus and measurement applications. A prediction discrepancy may require a different response model. This case study examines these revisions within one research environment and illustrates how physical attainability, available commands, and model accuracy affect the optical outcome.

Related Work

Autonomous laboratories and scientific agents:

Self-driving laboratories combine learning algorithms with automation and instruments in chemistry and materials science [1]. ChemOS 2.0 orchestrates heterogeneous experimental and computational components [7], and distributed knowledge graphs represent laboratory resources and experimental knowledge [8].

Scientific agents extend the reasoning and development work performed in these environments. Coscientist combines language models with search, computation, and laboratory capabilities [3]. Chem-Crow gives language models access to specialized chemistry tools [4]. Work on scientific facilities examines retrieval and tool augmentation [9], while agents that learn instrument operation retain procedural knowledge from experience [10]. These capabilities support the development of applications and protocols through which agents operate equipment.

A stimulus application determines which commands the system can execute. An acquisition interface determines which physical distinctions it can measure, and a protocol defines the experimental comparison. We treat these as revisable components of the harness, with development directed by the scientific goal and the evidence already acquired.

Optical discovery and programmable experimental environments:

AutoSciLab combines autonomous experimentation with interpretable scientific modeling in nanophotonics [11]. Optical see-through displays offer another setting for optical autonomy: programmable display emission combines with background light in a defined geometry [5, 6]. The response depends on the stimulus, background, and viewing position, so the investigation requires coordinated control and observation.

The required capabilities depend on the question. Spectral measurements require radiometric observation; spatial measurements require image formation and registration. Settling studies require stimulus sequences and observations that resolve the changing response. Goal-driven self-recursion includes developing the applications, measurement strategies, and models needed as these questions arise.

Goal-driven self-recursion diagram

Figure 1. Goal-driven self-recursion with the notation of Eqs. (1) and (2). The goal G directs establishment of H0H_0, experimental planning, and execution. Optical observations and execution evidence inform the recursive update of the harness, plan, and method. The revised environment enables subsequent tests, while accumulated evidence is evaluated against the same scientific goal.

Goal-driven self-recursion

A persistent goal and an evolving research environment:

The scientific goal specifies the intended outcome, its application domain, and the evidence used to assess progress. In color compensation, it may be to reproduce a family of target appearances across specified backgrounds and viewing conditions. Individual target matches test parts of that objective. The goal determines which measurements and capability revisions are useful and when the evidence supports the intended outcome.

At research stage kk, the harness includes the physical apparatus, device and observation applications, and their connection to scientific computation. The plan organizes the questions to be tested. The method specifies the response models and inferential procedures. Together with the goal and accumulated evidence, they determine a physical action:

at=π(G,Dt;Hk,Πk,mk),at∈A(Hk),yt=OHk[Fphys(at)]+εt.(1)\begin{aligned} a_t &= \pi(G,D_t;H_k,\Pi_k,m_k), \qquad a_t \in A(H_k),\\ y_t &= \mathcal{O}_{H_k}[F_{\mathrm{phys}}(a_t)] + \varepsilon_t. \tag*{(1)} \end{aligned}

Here GG is the scientific goal, DtD_t is the accumulated evidence, and HkH_k is the integrated harness. The plan is Πk\Pi_k and the method is mkm_k. The action set A(Hk)A(H_k) contains the tests that the harness can execute. An action can specify a display command, a background condition, and an acquisition configuration. The observation operator describes how the instruments and acquisition applications convert the physical response into evidence.

The apparatus supplies the physical interaction, and the software gives the agents access to it. Adding an application feature or acquisition strategy therefore changes which experiments the system can perform.

Evidence-driven revision of the means of investigation:

Experimental evidence updates the research environment and scientific method:

(Hk+1,Πk+1,mk+1)=R(G,Dt,Et;Hk,Πk,mk).(2)(H_{k+1},\Pi_{k+1},m_{k+1}) = \mathcal{R}(G,D_t,E_t;H_k,\Pi_k,m_k). \tag*{(2)}

The evidence EtE_t includes execution feedback and discrepancies that help explain the observation. The revision operator can change the test plan, extend stimulus-control applications, refine acquisition through the available measurement devices, replace a model, or revise the measurement protocol. The updated harness and plan implement the change, and subsequent tests measure its consequences.

The goal determines which revisions to pursue. A new capability may enable an informative test, a model revision may improve the measured optical response, and a plan revision may resolve a remaining scientific question.

Goal-relative progress across experimental contexts:

Improving a display setting and revising the method that selects settings are different research actions. For an optical context defined by a target, background, and geometry, the method selects a command available through the harness:

uH,m(c)=arg min⁡u∈U(H) F^m(u,b,g),q),K(H,m;c)=d(Fphys(uH,m(c),b,g),q),c=(q,b,g).(3)\begin{aligned} u_{H,m}(c) &= \underset{u \in\mathcal{U}(H)}{\operatorname{arg\,min}}\ \widehat{F}_m(u,b,g),q),\\ K(H,m;c) &= d(F_{\mathrm{phys}}(u_{H,m}(c),b,g),q),\\ c &= (q,b,g). \tag*{(3)} \end{aligned}

The physical outcome K(H,m;c)K(H,m;c) measures performance in that context. Outcomes across contexts describe how model and capability revisions affect the goal. A distribution μG\mu_G specifies the target and context domain:

RG(H,m)=Ec∼μG[K(H,m;c)],R_G(H,m) = \mathbb{E}_{c \sim\mu_G}[K(H,m;c)],
ΓG=RG(H,m)−RG(H′,m′).(4)\Gamma_G = R_G(H,m) - R_G(H',m'). \tag*{(4)}

Positive gain means that the revised harness and method reduce expected mismatch over the goal domain. This measure covers changes to the response method and to available commands. New observation capabilities can also advance the investigation by resolving a scientific question. Progress is assessed using the outcome specified by the goal [12].

Demonstration platform and harness development

Hardware and software integration:

In the developed case study, the harness combines the apparatus and optical geometry with device applications, measurement interfaces, analysis tools, and the agents that develop and use them. It carries a research question through physical execution to a measured response. The stimulus, background, viewing condition, and acquisition settings give that response its experimental context.

In this demonstration platform, the iPad generates the background and the RayNeo X3 supplies display emission. A TOP 300 optical probe and a CAS140D spectroradiometer, both from Instrument Systems, provide optical measurement [13]. The probe includes an alignment viewfinder and couples the collected light to the spectroradiometer. Device applications generate stimuli, acquisition software records spectral and spatial observations, and analysis tools fit response models and select further tests.

Establishing the harness starts with the stimuli and observations required by the goal. Development agents create or extend the applica tions, while optical characterization relates the controllable device states to measured responses.

Agent roleHarness contributionGoal-directed development
Scientific planningExperimental questions, models, and test plansSelect informative tests and revise the investigation using new evidence
iPad application developmentBackground generation and stimulus-state observationAdd background patterns, sequences, or control features required by new questions
RayNeo application developmentGlasses rendering and display controlExtend stimulus representation and rendering behavior for subsequent tests
Observation application developmentCamera-spectrometer acquisition and analysis interfacesRelate spatial and spectral observations and develop new acquisition protocols
Progress monitoringInterpretation of progress against the persistent goalIdentify unresolved objectives and direct testing, analysis, or capability development

Table 1. Agent responsibilities in the demonstration platform and the capabilities they establish and revise.

Agent responsibilities:

In this case study, scientific planning, application development, and progress monitoring share a goal and the physical evidence from the investigation (Figure 2). Table 1 assigns their responsibilities across the device and instrument applications.

Agent responsibilities and implemented interfaces in the case study

Figure 2. Agent responsibilities and implemented interfaces in the case study. The iPad viewer uses HTTP over a USB SSH connection; the glasses application receives USB/ADB commands; spectral acquisition uses the CAS4x64 SDK over USB. The TOP 300 integrates a viewfinder with the fiber-coupled optical probe [13]. Development examples identify source-level changes such as adding a HOLD command entry point, extending a viewer endpoint, or revising the SDK worker.

The iPad development agent builds background-generation features, and the RayNeo development agent builds rendering and stimulus control. The observation development agent builds the camera-spectrometer application and its acquisition interfaces.

The progress-monitoring agent evaluates results against the goal and test plan. It identifies unresolved objectives and directs the next measurement, analysis, or application revision. This role includes deciding when another measurement is useful and when the investigation first needs a new capability.

Illustration of recursive development:

As a possible extension of the case study, consider an investigation of target appearance across changing backgrounds. An initial harness generates static backgrounds, renders virtual colors, and acquires spectra for a response model. Suppose new observations depend on the preceding stimulus. The next comparison must distinguish optical memory from a static response discrepancy and may require new background and rendering sequences with time-resolved acquisition.

The planning agent specifies that comparison. Device development agents extend the iPad and glasses applications to generate the sequences, and the observation development agent extends acquisition to resolve the response. These tests inform the response model and measurement protocol. Progress monitoring evaluates the result against the original appearance objective and selects the next investigation.

The progress-monitoring agent checks revisions against the measurement relationships they must preserve. A measurement transaction records the requested stimulus, device acknowledgement, acquisition settings, and spectrum. Invariant checks cover stimulus identity, calibration and units, display stability, and command-observation correspondence. A revision capsule records the scientific motivation, source or build fingerprint, and reference checks. Known stimuli and retained reference observations allow comparisons across application versions. In § 6, command validation and framebuffer checks precede spectral acquisition with the revised interface.

Physical optical arrangement:

The iPad background and RayNeo X3 emission enter a common viewing pupil (Figure 3). The TOP 300 probe collects the light and guides it through a fiber to the CAS140D spectroradiometer. Its integrated viewfinder camera supports alignment [13]. Device applications control the stimuli, and acquisition software records the spectral response used for the colorimetric tests in Section 6.

Photograph of the demonstration platform showing the TOP 300 optical probe, mounted RayNeo X3 glasses, and an iPad displaying an alignment pattern

Figure 3. Photograph of the demonstration platform. (1) TOP 300 optical probe, (2) mounted RayNeo X3 glasses, and (3) iPad displaying an alignment pattern. Adjustable translation stages position the glasses between the background display and the probe viewing pupil. The probe is fiber-coupled to the CAS140D spectroradiometer.

Optical formulation

Additive light formation and the attainable set:

For an optical see-through display, a first-order spectral description at a fixed viewing geometry is

Sobs(λ;u,b,g)=SAR(λ;u,g)+τ(λ,g)Sbg(λ;b,g)+ϵ(λ).(5)S_{\mathrm{obs}}(\lambda; u,b,g) = S_{\mathrm{AR}}(\lambda;u,g) + \tau(\lambda,g)S_{\mathrm{bg}}(\lambda; b,g) + \epsilon(\lambda). \tag*{(5)}

Display emission and transmitted background light combine at the observation plane, with spectral transmittance weighting the background contribution. Integration against the CIE color-matching functions gives tristimulus values, which are transformed to CIELAB using a specified reference white [14]. We denote the physical color response by Fphys(u,b,g)F_{\mathrm{phys}}(u,b,g).

The physical command domain defines the attainable color set for a background and geometry. The harness exposes a subset of those commands, giving two target floors:

Gb,g={Fphys(u,b,g):u∈Uphys},\mathcal{G}_{b,g} = \{F_{\mathrm{phys}}(u,b,g) : u \in\mathcal{U}_{\mathrm{phys}}\},
U(H)⊆Uphys,\mathcal{U}(H) \subseteq\mathcal{U}_{\mathrm{phys}},
Lphys∗(c)=min⁡u∈Uphysd(Fphys(u,b,g),q),(6)L^{*}_{\mathrm{phys}}(c) = \min_{u \in\mathcal{U}_{\mathrm{phys}}} d(F_{\mathrm{phys}}(u,b,g),q), \tag*{(6)}
LH∗(c)=min⁡u∈U(H)d(Fphys(u,b,g),q).L^{*}_{H}(c) = \min_{u \in\mathcal{U}(H)} d(F_{\mathrm{phys}}(u,b,g),q).

Display commands add light to a background contribution set by optical transmission. The attainable set therefore depends on the background and geometry. An idealized linear additive system translates the response set in XYZ. Nonlinear device response, wavelength-dependent transmission, and conversion to CIELAB produce a more general geometry.

Extending a stimulus application can expose additional physically supported commands and lower the executable target floor. Extending acquisition can make a response observable. The apparatus defines the physical interactions; the harness determines which of them agents can use and measure.

Error bound for command access and model approximation:

Consider a method that globally minimizes predicted target distance over the command domain exposed by the harness. At a fixed context, suppose its uniform approximation error satisfies

sup⁡u∈U(H)d(F^m(u,b,g),Fphys(u,b,g))≤ϵH,m(c).(7)\sup_{u \in\mathcal{U}(H)} d(\widehat{F}_{m}(u,b,g),F_{\mathrm{phys}}(u,b,g)) \le\epsilon_{H,m}(c). \tag*{(7)}

The harness access gap is the difference between the executable and physical target floors. The selected command then satisfies

δH(c)=LH∗(c)−Lphys∗(c)≥0,\delta_{H}(c) = L^{*}_{H}(c) - L^{*}_{\mathrm{phys}}(c) \ge0,
Lphys∗(c)≤K(H,m;c)≤Lphys∗(c)+δH(c)+2ϵH,m(c).(8)\begin{aligned} L^{*}_{\mathrm{phys}}(c) \le K(H,m;c) \\ &\le L^{*}_{\mathrm{phys}}(c) + \delta_{H}(c) + 2\epsilon_{H,m}(c). \tag*{(8)} \end{aligned}

Apply the triangle inequality to the selected physical response, its prediction, and the target. Optimality in the predicted problem bounds the predicted distance by that of an optimal executable command. A second application of the triangle inequality gives the executable target floor plus twice the model approximation error. Substitution of the access-gap definition gives the upper bound in Eq. (8). Physical optimality over the full command domain gives the lower bound.

Equation (8) separates the effects of the physical configuration, command access, and response model. Changing the apparatus or geometry can change the attainable set. Extending command access can reduce the harness gap, and improving the model can reduce approximation error. The gap is zero when the application exposes the full physical command set. Observation capabilities affect the evidence used to learn and apply the response model.

CIELAB Euclidean distance supplies the metric structure for this derivation. Equation (7) defines a uniform error over the executable command domain; empirical prediction scores describe sampled responses.

Residuals and experimental design:

For an observed optical response, the target error admits the vector decomposition

rtarget=F^m(u,b,g)−q,r_{\mathit{target}} = \widehat{F}_{m}(u,b,g) - q,
rmodel=y−F^m(u,b,g),r_{\mathit{model}} = y - \widehat{F}_{m}(u,b,g),
y−q=rtarget+rmodel.(9)y - q = r_{\mathit{target}} + r_{\mathit{model}}. \tag*{(9)}

The first residual is the predicted displacement from the target. The second is the difference between the measured and predicted response. A small predicted target residual with a large measured mismatch directs attention to the response model. Dependence on command, background, or target region suggests variables and representations to test.

Repeated references under fixed geometry characterize variation around a stimulus. Changing the background while holding the target probes background dependence; neighboring commands near a boundary probe local response and control authority. Comparisons across model families test which representation predicts the relevant optical behavior. When a comparison requires an unavailable stimulus or observation, the agents must revise the application or acquisition protocol before performing it.

Geometric interpretation of physical attainability, harness capabilities, and model residuals in schematic CIELAB slices

Figure 4. Geometric interpretation of Eqs. (6)–(9) in schematic CIELAB slices, with a∗a^* and b∗b^* axes at fixed L∗L^*. (a) The minimum target distance is the physical target floor, Lphys(c)L_{\mathrm{phys}}(c). (b) The restricted command set introduces the harness access gap, δH(c)\delta_H(c). (c) The two residual vectors are rtargetr_{\mathrm{target}} from target to prediction and rmodelr_{\mathrm{model}} from prediction to measurement. Equation (7) defines the uniform model approximation quantity, ϵH,m(c)\epsilon_{H,m}(c), over the executable domain.

Optical color-matching case study

Color matching and characterization:

The case study seeks to match a desired color through the glasses while background light enters the viewing path. It uses measured spectra to update the display setting and to revise the response model that selects settings for later tests.

We calculate color from the measured spectrum and report Euclidean distance in CIELAB as ΔE76∗\Delta E^*_{76}, using reference white XYZ = (95.047, 100, 108.883) [14]. Smaller values indicate closer colorimetric matches. Presentation and viewing conditions determine the visual interpretation of these differences [15]. The characterization data contain 2,170 stimulus conditions and 356 additional control measurements for learning the response to display settings and backgrounds.

The corpus combines 320 direct iPad calibrations (64 patterns at five brightness settings) with 1,850 combined-platform conditions: 320 transmission, 960 white-background/display, 378 colored-background/display, and 192 background-occluded display-only measurements. The host acquired the combined conditions and all 356 controls through H1H_1’s acknowledged HOLD/BLACK interface; the 960-condition block, for example, crosses five iPad brightness settings, three glasses brightness settings, and 64 patterns.

Harness establishment and a revised stimulus protocol:

The color-matching loop requires model-generated RGB settings to remain displayed throughout an exposure-dependent spectrometer acquisition. The glasses application accepts arbitrary RGB HOLD commands through a USB/ADB entry point. It retains the requested color and reports the command token, session, eye selection, and draw acknowledgements. The host coordinates acquisition with this held state and stores its readback with the spectrum.

The transition from H0H_0 to H1H_1 adds a command receiver that is absent from the baseline binary and present in the updated application. Validation covers all 64 named stimulus commands and passes 12 live device-control tests. Three framebuffer checks each sample 384 pixels and find zero RGB mismatches. Each spectrum in the feedback example retains a custom RGB HOLD state with both software views acknowledged.

An acknowledged hold lets a fitted model request a color and measure its physical response over the acquisition interval. The retained revision record includes the added receiver, source fingerprints, device-check results, and command states stored with the measurements (Figure 5c).

Physical measurements and a documented harness revision

Figure 5. Physical measurements and a documented harness revision. (a) Four calibrated combined-light spectra: the target reference under the neutral background and the initial, first-updated, and second-updated settings under the changed background. The original W/(cm² sr nm) calibration is converted to mW/(m² sr nm). (b) Left: the measured three-setting trajectory for one target; right: independent before-and-after measurements for five desired colors. Smaller ΔE76∗\Delta E_{76}^{*} indicates a closer color match. (c) The command-interface revision, its device checks, and its subsequent use for spectral acquisition.

At fixed eye, patch geometry, and brightness, the revised interface expands catalog-based playback to the full digital RGB domain, U(H0)⊂U(H1)={0,…,255}3⊇Uphys\mathcal{U}(H_0) \subset\mathcal{U}(H_1) = \{0,\ldots,255\}^3 \supseteq\mathcal{U}_{\mathrm{phys}}. (8) then gives δH1(c)=0\delta_{H_1}(c) = 0 for RGB command access. Inverse-model outputs are rounded to the device grid and held for measurement.

Feedback-guided color matching:

For one fixed target, the initial display setting gives a color difference of 19.756 ΔE76∗\Delta E^*_{76}. Two feedback-guided updates reduce it to 5.315 and 1.211 ΔE76∗\Delta E^*_{76}, a reduction of 93.9% (Figure 5a,Figure 5b).

The reference and updated spectra have blue peaks near 449 and 460–461 nm, consistent with different background and virtual-display primaries. Their combination gives a near-colorimetric match of 1.211 ΔE76∗\Delta E^*_{76} through metameric compensation in the specified colorimetric system [16].

In a separate five-target comparison, the median color difference falls from 9.377 to 1.882 ΔE76∗\Delta E^*_{76}. All five targets improve.

Response-model revision:

The response model predicts color from the display setting and background, then supports inverse selection of a setting for a desired color. Revising this model changes the rule used to select settings in subsequent tests.

We compare three response families on the expanded calibration set: a diagonal XYZ affine model fitted in XYZ, the same parameterization fitted by minimizing fixed-reference CIELAB residuals, and an extension with bounded channel-wise quadratic terms fitted with the CIELAB objective. Each family produces 68 predictions with whole target-color groups excluded from its fit. Prediction RMSE values are 1.842, 1.363, and 1.444 ΔE76∗\Delta E_{76}^{*}, respectively. We select the CIELAB-objective affine model, refit it on the expanded evidence, and acquire new spectra for the settings it generates.

The previous and updated models each select settings for three target colors under three backgrounds, giving nine matched tests and 18 spectra. The updated model gives closer matches in seven tests and larger differences in two. The previous model has a median physical difference of 1.342 ΔE76∗\Delta E_{76}^{*}. The median decrease across paired tests is 0.197 ΔE76∗\Delta E_{76}^{*}. This comparison measures calibration refinement across the matched contexts; Section 6.3 measures feedback adjustment of the display command.

Discussion

Stimulus and acquisition applications are research outputs that determine which comparisons agents can execute and which responses they can observe. Equation (8) separates their optical effects: apparatus changes affect physical attainability, application changes affect command access, and model revisions affect prediction error. A measured discrepancy can therefore direct attention to a specific part of the research environment.

A persistent goal allows the investigation to revise its plan, applications, and response models without changing its intended outcome. Progress monitoring evaluates those revisions against unresolved parts of the objective and the evidence needed to resolve them.

Discrepancies can expose assumptions in the optical model or the harness. A structured residual may reveal background dependence. A mismatch between requested and observed stimuli can identify a device state that needs readback. Dependence on acquisition conditions can require a different measurement or analysis protocol. Agents turn these observations into hypotheses and revisions, then acquire the physical comparisons needed to assess them.

Further work can examine transfer between goals, coordination among development agents, and the choice between acquiring another measurement and developing a new capability.

Conclusion

Goal-driven self-recursive optical research uses physical evidence to revise a goal-specific hardware and software harness. The reported optical see-through color-matching case study demonstrates expanded command access, spectral feedback, and response-model refinement. The optical formulation distinguishes physical attainability, command access, and model approximation error. This configuration illustrates a research structure that can be instantiated with other stimulus systems and measurement devices. The resulting applications and protocols remain available for subsequent investigations.

Scientific questionMeasured outcomeRole in the research process
Can a new command interface enable the optical test?Arbitrary RGB holds, 64 checked commands, and 12 passed live control testsSoftware and protocol development make model-generated settings executable and observable.
Can feedback improve one displayed color?Color difference 19.756→1.21119.756 \to1.211 after two updates; 93.9% reductionAn observation changes the next physical action while the target remains fixed.
Can the approach support several desired colors?For five colors, median difference 9.377→1.8829.377 \to1.882; all five improveA shared control and measurement environment supports a family of optical targets.
Can a revised model improve later tests?The updated model gives closer matches in seven of nine new physical tests.Evidence changes the reusable relationship that generates subsequent display settings.

Table 2. Optical evidence and its role in goal-driven recursion. Color difference is measured in ΔE76∗\Delta E^{*}_{76}; smaller values indicate a closer match to the desired color.

Code availability

The case-study software is available in the SpectralColorLab repository: https://github.com/TZHU64/SpectralColorLab.

References

References

  1. [1]Tom G, Schmid SP, Baird SG, Cao Y, Darvish K, Hao H, et al. Self-driving laboratories for chemistry and materials science. Chem Rev. 2024;124(16):9633-732. doi:10.1021/acs.chemrev.4c00055.DOI
  2. [2]Burger B, Maffettone PM, Gusev VV, Aitchison CM, Bai Y, Wang X, et al. A mobile robotic chemist. Nature. 2020;583(7815):237-41. doi:10.1038/s41586-020-2442-2.DOI
  3. [3]Boiko DA, MacKnight R, Kline B, Gomes G. Autonomous chemical research with large language models. Nature. 2023;624(7992):570-78. doi:10.1038/s41586-023-06792-0.DOI
  4. [4]Bran AM, Cox S, Schilter O, Baldassari C, White AD, Schwaller P. Augmenting large language models with chemistry tools. Nat Mach Intell. 2024;6(5):525-35. doi:10.1038/s42256-024-00832-8.
  5. [5]Xiong J, Hsiang EL, He Z, Zhan T, Wu ST. Augmented reality and virtual reality displays: emerging technologies and future perspectives. Light Sci Appl. 2021;10(1):216. doi:10.1038/s41377-021-00658-8.DOI
  6. [6]Gabbard JL, Swan JE II, Zedlitz J, Winchester WW III. More than meets the eye: an engineering study to empirically examine the blending of real and virtual color spaces. In: 2010 IEEE Virtual Reality Conference; 2010 Mar 20-24; Waltham, MA, USA. Piscataway (NJ): IEEE; 2010. p. 79-86. doi:10.1109/VR.2010.5444808.DOI
  7. [7]Sim M, Vakili MG, Strieth-Kalthoff F, Hao H, Hickman RJ, Miret S, et al. ChemOS 2.0: an orchestration architecture for chemical self-driving laboratories. Matter. 2024;7(9):2959-77. doi:10.1016/j.matt.2024.04.022.DOI
  8. [8]Bai J, Mosbach S, Taylor CJ, Karan D, Lee KF, Rihm SD, et al. A dynamic knowledge graph approach to distributed self-driving laboratories. Nat Commun. 2024;15(1):462. doi:10.1038/s41467-023-44599-9.DOI
  9. [9]Prince MH, Chan H, Vriza A, Zhou T, Sastry VK, Luo Y, et al. Opportunities for retrieval and tool augmented large language models in scientific facilities. NPJ Comput Mater. 2024;10(1):251. doi:10.1038/s41524-024-01423-2.DOI
  10. [10]Vriza A, Prince MH, Zhou T, Chan H, Cherukara MJ. Operating advanced scientific instruments with AI agents that learn on the job. NPJ Comput Mater. 2026;12(1):160. doi:10.1038/s41524-026-02005-0.DOI
  11. [11]Desai S, Addamane S, Tsao JY, Brener I, Swiler LP, Dingreville R, et al. AutoSciLab: a self-driving laboratory for interpretable scientific discovery. Proc AAAI Conf Artif Intell. 2025;39(1):146-54. doi:10.1609/aaai.v39i1.3990.arxiv.org/abs/2412.12347
  12. [12]Volk AA, Abolhasani M. Performance metrics to unleash the power of self-driving labs in chemistry and materials science. Nat Commun. 2024;15(1):1378. doi:10.1038/s41467-024-45569-5.DOI
  13. [13]Instrument Systems. TOP 300 AR/VR optical probe [Internet]. Version 1.2. Munich: Instrument Systems; [date unknown] [cited 2026 Oct 23]. Available from: https://www.instrumentsystems.com/fileadmin/Downloads/Brochures_Datasheets/TOP300_EN.pdf.
  14. [14]International Commission on Illumination. Colorimetry. 4th ed. Vienna: CIE; 2018. Report No.: CIE 015:2018. doi:10.25039/TR.015.2018.
  15. [15]International Commission on Illumination. Methods for evaluating colour differences in images. Vienna: CIE; 2011. Report No.: CIE 199:2011.
  16. [16]International Commission on Illumination. International lighting vocabulary. 2nd ed. Vienna: CIE; 2020. Standard No.: CIE S 017:2020. Entry 17-23-006, Metamerism.

Paper details

vlnc:W_k79ft6t8
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 12

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents