WorksComputer Science
Confidence-Based Materials Data Quality Assessment via Domain Knowledge and Graph-Structured Learning
Abstract
The rapid development of materials machine learning relies on large-scale, heterogeneous datasets, yet model reliability is often compromised by imperfect data from diverse experiments, simulations, and database integration. Real-world materials databases may contain measurement errors, failed calculations, missing or duplicate records, and hidden violations of physicochemical constraints. Such problems are difficult to identify because corrupted samples may remain statistically plausible rather than appearing as explicit outliers. In this paper, we propose a confidence-based materials data quality assessment framework that integrates domain knowledge with graph-structured learning. Data quality is formulated as a continuous confidence estimation problem rather than a binary anomaly identification task, enabling sample-level assessment and historical-reference-based batch comparison. A nine-dimensional feature-quality prior and duplicate-aware sample initialization are calibrated using materials domain rules and statistical evidence. Confidence is further refined through sample-feature bipartite graph propagation and weakly supervised graph attention, while a Memory-GAT module provides historical reference scoring. Experiments on 23 ODDS benchmark datasets show that the generic module achieves an average AUC-ROC of 0.866. In five repeated mixed-contamination experiments on mp_20, rule calibration improves HistGradientBoostingRegressor test from to . Graph refinement increases average precision from to 0.953\pm0.004R^2R^20.590\pm0.0530.880\pm0.027$ after rule-based screening.
Introduction
Data-driven machine learning has emerged as a fundamental paradigm in materials science, enabling large-scale exploration of composition-structure-property relationships and accelerating the transition from empirical trial-and-error toward data-driven materials design [1]. However, model performance is determined not only by algorithmic architectures but also by the reliability, representativeness, and scientific consistency of the training data. Low-quality data can distort learned structure-property relationships, reduce model generalization, and introduce unreliable predictions into subsequent materials screening and design workflows. Therefore, systematic data quality assessment and continuous quality control are essential for developing reliable and trustworthy artificial intelligence (AI) systems in materials science.
Despite the success of several world-class materials databases, including Materials Project [2], OQMD [3], AFLOWlib [4], NOMAD [5], and the Materials Data Facility [6], maintaining consistent and reliable data quality remains challenging due to the diversity of computational workflows, experimental measurements, and curation procedures involved. Nevertheless, records in these databases may contain unconverged density-functional theory calculations [7], failed structural relaxations, unreasonable crystal structures, inconsistent units or field semantics, missing key properties, duplicate entries, and violations of chemical or physical constraints. Importantly, many of these issues cannot be detected by conventional statistical criteria because corrupted samples may remain within physically plausible distributions while violating underlying scientific constraints.
Existing data quality assessment and anomaly detection methods [8], including multidimensional data quality frameworks [9], distance- and density-based detectors, ensemble outlier methods [10], reconstruction-error models, and deep representation-learning approaches for tabular anomaly detection [11], have provided valuable tools for identifying corrupted records in generic datasets. However, their direct application to materials science data remains challenging due to three fundamental limitations. First, many approaches focus on a single quality dimension or binary anomaly labels, rather than constructing a unified and interpretable quality representation across samples, features, and datasets [12]. Second, purely statistical methods are sensitive to distribution shapes and feature scales, and their performance can be degraded in sparse and high-dimensional materials descriptor spaces [13]. Third, many low-quality materials records arise from violations of physical constraints, chemical relationships, structural consistency, or experimental conditions rather than simple numerical deviations.
To incorporate scientific knowledge into data quality evaluation, recent studies have explored knowledge-assisted approaches that combine domain rules with statistical analysis [14]. Knowledge-assisted methods demonstrate that expert rules can improve scientific consistency evaluation and provide inspectable explanations for low-confidence records [15]. However, these approaches still lack a unified framework that integrates domain knowledge, statistical evidence, and relational structures among data records for continuous, interpretable, and comparable quality assessment. In addition, materials science data are often submitted in batches, sources, or projects, making relative confidence scores within a single dataset insufficient for cross-batch quality comparison and acceptance [16].
This paper proposes a confidence-based materials data quality assessment framework via domain knowledge and graph-structured learning, where data quality is formulated as a continuous confidence estimation problem rather than a binary anomaly detection task. The framework first constructs a domain-informed quality prior and then refines confidence through heterogeneous graph learning, including global sample-feature consistency propagation, local neighborhood refinement, and historical reference-based quality assessment. An overview of the proposed framework is presented in Figure 1. The quality concepts summarize the assessment goals; the numerical indicators and calibration rules are specified in § 3.1–§ 3.2.

Figure 1. Overview of the proposed confidence-based materials data quality assessment framework. The five stages connect materials data, quality priors, domain evidence, graph refinement and assessment outputs.
The main contributions of this work are summarized as follows:
We formulate materials data quality assessment as a continuous confidence estimation problem, enabling interpretable sample and feature assessment beyond binary anomaly identification;
We develop a domain-informed quality prior and hierarchical calibration strategy that integrates physicochemical constraints with statistical evidence;
We introduce graph-based confidence refinement at the sample–feature and sample-neighborhood levels, together with historical reference scoring, and evaluate their contributions separately from rule calibration;
We evaluate the framework through generic anomaly benchmarks, repeated controlled-contamination and downstream prediction experiments, coefficient sensitivity analysis, and an interpretable materials-data case study.
Related work
Materials data quality assessment
Data quality assessment has evolved from single-dimensional statistical checks to multidimensional reliability evaluation frameworks. The “fitness for use” perspective emphasizes that data quality should be evaluated according to accuracy, completeness, consistency, accessibility, and task relevance [17]. With the increasing adoption of machine learning in scientific discovery, data quality has become closely associated with model reliability, uncertainty, and downstream generalization capability [18]. However, most existing data quality frameworks were originally developed for information systems or industrial data governance, where quality dimensions mainly focus on structural integrity, operational consistency, and data management requirements rather than scientific validity [19].
In materials science, large-scale data infrastructures have greatly reduced the cost of accessing crystal structures, calculated properties, and experimental records. However, their primary roles are storage, sharing, retrieval, and high-throughput data aggregation [20]. Automated quality assessment for scientific reliability remains comparatively limited. Data governance for materials machine learning must simultaneously handle statistical outliers, semantic mismatches, unreasonable structures, failed calculations, and violations of domain rules. Therefore, materials data quality assessment should evaluate not only statistical abnormality, but also scientific plausibility and suitability for downstream learning tasks [21].
Scientific data quality assessment and anomaly identification
Although anomaly detection provides an effective mechanism for identifying suspicious records, conventional approaches usually define anomalies according to statistical rarity rather than scientific reliability. Classical anomaly detection approaches include distance-based, density-based [22], statistical, clustering-based [23], and one-class classification methods. In materials data, anomaly detection methods generally target three aspects. The first concerns crystal-structure plausibility, including interatomic distances, lattice parameters, space groups, and coordination environments. The second focuses on property reliability, including formation energy, band gap, energy above hull, and calculation convergence. The third addresses multi-source data consistency, including missing values, duplicate entries, field mismatches, unit inconsistency, and abnormal property relationships.
The main limitation of purely data-driven anomaly detection is that it measures deviation from the current data distribution, but cannot directly determine whether a sample obeys materials-science rules [15]. For example, negative band gaps, out-of-range space-group identifiers, and inconsistencies between lattice matrices and lattice constants should be treated as low-quality evidence even when they are not extreme in a low-dimensional statistical projection. These limitations indicate that reliable materials data assessment requires a unified framework that integrates statistical evidence, domain constraints, and relational information among data entities [24].
Domain knowledge integration
Domain knowledge integration aims to convert expert rules, physical constraints, and empirical relationships into explicit quality indicators. Knowledge-assisted approaches have shown that materials rules can improve quality evaluation and provide explanations that domain experts can audit. Representative methods, such as DKA-DAD [15] and DADMmdk [25], introduce materials rules into anomaly detection and demonstrate the value of expert knowledge in identifying scientifically inconsistent records.
However, two limitations remain. First, rules are often triggered in isolation, rather than fused with statistical evidence in a unified scoring mechanism. Second, rule evidence is difficult to propagate between samples and features, so local defects may be handled as isolated events instead of being incorporated into a globally consistent quality judgment. These limitations motivate the development of methods that can integrate rule-based evidence, statistical signals, and relational structures into a unified quality representation.
Graph learning and confidence quantification
Graph-based methods provide a natural way to capture dependencies among samples, features, and reference data [26] in structured datasets. Graph propagation approaches enable confidence information to spread through relational structures, while graph attention mechanisms learn adaptive importance among neighboring entities. Personalized PageRank introduces restart-based propagation and is suitable for spreading confidence over a sample–feature bipartite graph [27]. Graph attention networks [28] allow each node to assign adaptive weights to its neighbors and can suppress the influence of abnormal neighbors during representation learning. In a data-quality setting, graph propagation provides global consistency, while graph attention provides local anomaly isolation [29].
Because data quality is influenced by interactions among samples, features, and historical references, graph-based methods provide a promising representation for modeling quality propagation. Confidence-based learning extends discrete error identification to probabilistic quality estimation [30]. This idea provides useful inspiration for modeling data quality as continuous confidence rather than binary normal/anomalous labels. This perspective motivates extending confidence modeling from individual prediction reliability to structured scientific data quality assessment. Moreover, historical quality anchors provide a reference for batch-level comparison. The Memory-GAT module uses these anchors to relate current batch scores to a common historical reference.
Overall, existing studies have advanced materials data quality control from statistical screening toward knowledge-assisted evaluation. However, a unified framework that simultaneously considers domain constraints, statistical evidence, relational structures, and historical-reference batch comparison remains insufficiently explored. Addressing this gap requires a continuous and interpretable quality representation capable of integrating heterogeneous quality signals across materials datasets.
Method
The framework assigns confidence scores to samples and features, then updates them using statistical checks, materials knowledge and graph relationships. These scores express data reliability on a scale from zero to one. They are used to rank records and identify fields that need inspection; they are not estimates of prediction uncertainty. The workflow consists of prior construction, evidence calibration, sample–feature propagation, local attention refinement and historical-reference scoring (Figure 2).

Figure 2. Workflow of the proposed materials data quality assessment framework. The diagram summarizes prior construction, evidence calibration, graph refinement and quality outputs. The feature indicators are defined in § 3.1. The schematic calibration factors are implemented using the minimum cell penalty for each sample and the mean cell penalty for each feature, as specified in Eq. (2).
Let the dataset be , where denotes the -th sample, and and denote the numbers of samples and features, respectively. Sample–feature confidence scores at successive stages are denoted by subscripts: for initial confidence, for calibrated confidence, for graph-propagated confidence, and for final confidence. Feature confidence is denoted analogously by , , and . A lower confidence score indicates a higher likelihood of quality defects.
Nine-dimensional quality prior
The initial feature confidence combines nine indicators derived from metadata and numerical data. The indicators translate broad data-quality concepts [31] into quantities that can be calculated for each field. Let be the score of feature on indicator , with weight . The initial feature and sample scores are
The feature weights sum to one and are fixed at (0.05, 0.15, 0.15, 0.08, 0.20, 0.05, 0.10, 0.10, 0.12) for documentation availability, statistical-property matching, numeric compatibility, metadata coupling, non-missing rate, uniqueness, distributional skewness, numerical regularity and descriptor-variation relevance, respectively. Every record in an exact duplicate group receives the lower initial sample score. The weighted feature indicators and the sample scores are then updated by the evidence checks.
The weights are fixed throughout the main experiments. Appendix § 10.§ 3 defines each indicator and explains which become constant after preprocessing. The last indicator measures the correlation between a feature and the first principal component of the input descriptors. § 5.3 examines sensitivity to the weights and penalty coefficients.
| Symbol | Meaning |
| Feature indicator and its normalized weight | |
| Initial sample confidence accounting for duplicates, and weighted feature prior | |
| Sample and feature confidence after evidence calibration | |
| Cell penalty and sample–feature edge reliability | |
| Row-stochastic transition and restart coefficient | |
| Scores after bipartite propagation | |
| Rule-trained GAT risk and final sample confidence | |
| Historical-reference sample score and batch mean |
Table 1. Main notation used in the confidence-assessment workflow.
Hierarchical materials-knowledge calibration
A record can fall within a common numerical range while violating a materials constraint. Calibration therefore uses three types of evidence: individual field ranges, relationships between fields and deviations from the batch distribution [32]. In the controlled benchmark, these checks cover configured value ranges, agreement between lattice representations, and standardized-score/IQR checks. Property targets, identifiers and injected anomaly labels are excluded from scoring.
Evidence is mapped to a cell penalty : severe evidence gives 0.3, mild evidence gives 0.7, and unaffected cells give 1.0. Severe evidence takes precedence, so overlapping checks do not multiply the same cell repeatedly. The calibrated confidence scores are
Here and are the sample and feature factors used in the workflow. The evidence-channel factors shown schematically in Figure 2 are implemented by these aggregate penalties: the minimum cell penalty for a sample and the mean cell penalty for a feature. The severe and mild coefficients remain fixed in the main experiments and are varied in the sensitivity analysis.
The sample-feature reliability matrix uses , 0.5 and 0.1 for unaffected, mildly flagged and severely flagged cells. Table 2 specifies the implemented checks and their screening ranges.
| Evidence | Evidence content | Interpretation |
| Univariate boundary | Band gap [0,10] eV; energy above hull [0,0.5] eV/atom; space group [1,230]; lattice lengths [2, 30] Å; angles [30,150] degrees; fractional coordinates [0,1]. Outside a range is severe. | Configured plausibility checks; coordinate wrapping must be declared. |
| Multivariate relationship | Relative mismatch between a lattice length and its lattice-matrix row norm exceeds 0.05; all four involved cells receive severe evidence. | Inconsistency between stored representations. |
| Global distribution | Population-standardized : severe; or outside the Tukey 1.5 IQR interval: mild unless severe. Zero standard deviation or IQR is replaced by one. | Batch-level deviation evidence. |
Table 2. Representative quality-evidence types and their effects on confidence.
Sample-feature bipartite graph propagation
Calibration first scores each record and field from the checks they trigger. A bipartite graph then links sample nodes to feature nodes [33], using as the weight between sample and feature . Each sample receives information from its associated features, and each feature receives information from the samples containing it.
This exchange allows the confidence of a record to reflect both its own checks and the reliability of its fields. In turn, feature confidence reflects the records in which that feature appears [34]. Let
collect the calibrated sample and feature scores. The propagation matrix is
where and are the separate sample and feature degree matrices. Thus each outgoing block is row-normalized. The confidence propagation process is then written as
Here, controls how much calibrated confidence is retained at each iteration [35]. The first term preserves the original evidence, and the second averages the scores of neighboring nodes using the weights in . Starting from , iteration stops when the largest score change is below , or after 400 iterations. The resulting sample and feature scores are and . Appendix § 10.§ 4 establishes convergence and checks the implementation against independent calculations.
Graph attention local refinement
Bipartite propagation combines information across the sample–feature graph. Local refinement then uses a sample KNN graph to compare records with similar descriptors. Attention learns how strongly each neighboring record contributes to the risk score.
For each sample, the normalized raw feature vector is first weighted by graph-propagated feature confidence and then concatenated with the sample’s own graph-propagated confidence:
where denotes the normalized feature vector, denotes elementwise multiplication, and denotes vector concatenation. This operation reduces the influence of low-confidence features and preserves more information from high-confidence features. A sample KNN graph is then constructed from , and graph attention learns adaptive neighbor weights [36]. The KNN graph has eight incoming neighbors and a self-loop per sample. The two-layer GAT uses four first-layer heads with 16 outputs each, ELU and dropout 0.05, followed by a sigmoid risk output. It is trained for 50 full-batch epochs with Adam (learning rate , weight decay , gradient clipping one). The training target is the rule-derived risk :
Neither injected anomaly labels nor downstream property targets enter this loss. The model learns to reproduce this rule-derived risk using the sample and its neighbors. Let be the risk score output by the GAT, where a larger value indicates a more suspicious sample. The final sample confidence is updated as
where controls the impact of GAT refinement. If the GAT estimates high risk, the confidence is further decreased from the graph-propagated value. If the risk is low, the original confidence is largely retained. A matched GAT configuration uses , in place of the propagated scores, with the same objective and training budget. These comparisons distinguish the contributions of local attention and bipartite propagation.
Historical-reference Memory-GAT
Traditional anomaly scores are dataset-dependent. Historical quality memory provides a reference for comparing newly arrived batches with previously assessed samples. The memory stores descriptors, confidence, rule evidence and sample fingerprints. Historical samples covering a range of confidence scores are selected as frozen anchors [37]. Their reference scores are obtained through rule calibration and graph propagation. The anchor descriptors and scores remain fixed while the attention model is fitted for the current batch.
The memory graph uses standardized descriptors and transformed reference confidence scores. Each current node receives messages from eight historical neighbors, six current neighbors and itself. Historical nodes receive only their own self-loop messages. A two-layer attention encoder with a sigmoid output is trained to reproduce the historical reference scores and the current rule/propagation scores. A smoothness term encourages connected nodes to have similar outputs. Appendix § 10.§ 5 gives the inputs, loss and training settings. Injected anomaly labels are excluded from training.
For current-sample scores , the batch score is
The mean summarizes the quality of the current batch relative to the historical anchors. § 5.5 compares its ordering of controlled batches with batch-only scores and a distance-weighted historical KNN reference.
Quality representation and applications
The framework outputs sample confidence , feature confidence , and the corresponding rule-trigger evidence. Sample confidence supports quality ranking and helps users prioritize low-confidence records for inspection. Feature confidence summarizes the quality of individual fields and helps identify columns requiring further checks. Rule-trigger evidence specifies the affected fields and the checks triggered by each record, providing a basis for verification against the original data source.
When historical quality memory is available, the framework uses historical anchors to calculate a reference-based score for each current sample. The dataset-level quality score is the mean of these scores over the current batch, supporting comparison of overall quality across batches. Appendix § 10.§ 1 presents the complete assessment workflow.
Experimental setup
The experiments assess anomaly identification, materials data screening, the contribution of each module, interpretation of flagged records and comparison of batches. They include 23 ODDS datasets [38], controlled contamination of mp_20 with downstream prediction, ablation and sensitivity tests, an alloy-data case study and historical-reference batch scoring.
Generic anomaly identification benchmark
The ODDS experiment tests anomaly identification without materials-specific rules. It retains the feature prior, statistical checks and graph refinement.
The method is evaluated on 23 ODDS datasets using AUC-ROC. The suite includes datasets that could be retrieved and processed consistently. Datasets with unavailable download links and exceptionally large datasets with very few features were excluded.
The baselines cover statistical methods, neighborhood-based detectors, representation-learning approaches, and large-language-model-based anomaly detection [38].
Materials data cleaning and downstream validation
The mp_20 dataset contains 45,229 records. Five independently sampled 16,000-record subsets (seeds 0–4) are deduplicated by material identifier and grouped by exact composition label and nine unrounded lattice-matrix entries. Grouped splits yield approximately 12,000 outer-training and 4,000 clean test records; the outer-training partition is further divided into 10,000 fitting and 2,000 calibration records. Feature eligibility and median imputation are determined from outer training, excluding identifiers, property targets and auxiliary property fields. The main runs retain 43 numerical descriptors.
Corruption is applied only after splitting. Half of each fitting or calibration batch is contaminated, evenly across statistical outliers, configured boundary violations, lattice-representation inconsistency and mixed perturbations. The same records receive zero-mean target noise with standard deviation 2.8 times the clean batch target standard deviation. The mixed-input perturbation scale is . This setup tests screening when both descriptors and target values contain errors. Appendix § 10.§ 6 gives the corruption procedure.
Scoring uses input descriptors and the evidence derived from them. The formation-energy target is excluded from prior construction, scoring, graph construction and GAT training. For local GAT refinement, fitting and calibration batches are each standardized using their own column means and standard deviations; a local GAT is trained separately on each batch using its rule-derived risk targets. For each method, the threshold that maximizes F1 on the synthetically labeled calibration batch is then applied to the independently scored fitting batch. The clean test data are used only for downstream evaluation.
HistGradientBoostingRegressor [39] uses 220 iterations, learning rate 0.055 and L2 regularization 0.02. All methods share the same clean test records within each seed. Isolation Forest (50 estimators, contamination 0.1), PCA (95% variance) and random retention provide comparisons. For each seed, the random control retains the same number of fitting records as the corresponding screening method. In the tables, the label rules and full identify the method whose retained count is matched; random selection itself uses no confidence scores.
MACE [40] is evaluated on five grouped 4,000-record subsets with approximately 2,500 fitting, 500 clean validation and 1,000 clean test crystals before shared structural eligibility filtering. Thresholds use separately corrupted copies of the calibration partition. Every method shares the eligible clean test set; the clean validation loss selects the model, and test predictions are computed once after training. The repeated subset study comprises five splits and seven conditions, totaling 35 MACE training runs. MACE uses random initialization, two interactions, hidden irreps 128x0e+128x1o, radius 4 Å, float32, batch size 32, learning rate 0.005 and a common ten-epoch budget. Only energy is trained; forces have zero loss weight and stage two is disabled. Appendix § 10.§ 6 specifies structural filtering, remaining settings and evaluation procedure.
Ablation and robustness analysis
The ablation compares six configurations: statistical checks, boundary checks, complete rules, rules with propagation, rules with GAT, and rules with both graph stages. This separates the effects of relationship checks, sample–feature propagation and local attention. Historical memory is tested in the batch-comparison experiment.
Robustness crosses contamination fractions 10%, 30% and 50% with mixed-descriptor scales , and , while holding other corruption mechanisms and target-noise multipliers fixed. Parameter sensitivity includes nine severe/mild penalty combinations, equal feature weights, and individual weight perturbation or omission. All configurations are repeated over seeds 0–4; the full weight results are in Appendix § 10.7. Additional diagnostics use a fixed threshold or a prespecified 50% deletion budget; these are distinguished from the main results, which use thresholds selected on the calibration partition.
Materials data governance case study
To demonstrate interpretability in a realistic materials data governance scenario, this study uses an alloy mechanical-property dataset collected from public literature [41, 42, 43]. The primary case-study table contains 185 records and 50 fields, comprising one alloy identifier, 14 elemental-composition variables, one testing-temperature variable, two mechanical-property variables—ultimate tensile strength (UTS) and fracture elongation (FE)—and 32 composition-derived physicochemical, thermodynamic, and elastic descriptors. A larger source-literature reference table containing 315 records and 61 fields is used as an auxiliary source for statistical comparison and fitting-based verification. It comprises one sample identifier, the same 14 elemental-composition variables, 12 processing-history variables describing homogenization, deformation, rolling, annealing, and aging, the two mechanical-property variables, and the same 32 material descriptors. Detailed definitions and categories of these fields are provided in Appendix § 10.10.
The case study examines whether each flagged record can be linked to a specific quality concern. It combines range checks, relationships between fields, distribution checks, missingness and differences between reported and model-predicted properties. The audit also records whether processing-history information is available.
Samples outside configured screening ranges or with property differences at matched recorded composition and temperature are treated as review candidates. Processing-history availability is included in the review evidence. Samples identified primarily through statistical or global distribution evidence are further examined using KNN and Random Forest regressors trained under five-fold cross-validation [44]. The regressors predict ultimate tensile strength (UTS) and fracture elongation (FE), and large fitting residuals are used as additional evidence of potential inconsistency [45]. The goal is to evaluate whether the proposed method can generate auditable and interpretable quality assessments for public materials datasets.
Historical-reference batch comparison
Mutually disjoint mp_20 samples form three historical batches of 800 records at 0%, 10% and 30% contamination. Historical samples are sorted by their rule/propagation confidence scores, and 800 anchors are selected at evenly spaced positions in this ordering. Four current batches contain 900 records each at 0%, 10%, 30% and 50% contamination. All preprocessing for the 18 shared descriptors is fitted on history only.
The experiment is repeated over five seeds and compares batch-only scores, distance-weighted historical KNN and Memory-GAT. Mean scores and Spearman correlation with decreasing contamination assess controlled batch ordering. The experiment evaluates historical reference scoring across disjoint batches from a common materials source. Current contamination labels are used for evaluation.
Evaluation metrics and parameter settings
Anomaly ranking is evaluated by AUC-ROC and average precision (AP). Screening is evaluated by F1 at the calibration-selected threshold, with recall also reported for each corruption mechanism. Downstream prediction is evaluated by the coefficient of determination () and mean absolute error (MAE). Higher AUC-ROC, AP, F1, recall and , and lower MAE, indicate better performance. For batch comparison, Spearman correlation measures agreement between batch confidence and decreasing contamination, so a positive correlation indicates higher scores for cleaner batches.
The ODDS benchmark retains its original seed-42 results. The materials experiments are repeated with seeds 0–4 and report mean ± sample standard deviation. Within each seed, methods share the data split and corruption realization. Differences in are calculated within each seed and summarized with 95% Student- intervals over the five runs.
Default severe/mild penalties are 0.3/0.7, edge weights are 0.1/0.5/1.0, restart is 0.35, and the GAT gate is 0.5. These manual settings remain fixed except in declared sensitivity experiments. KNN size is eight, the local GAT has two layers and hidden width 64, and historical memory retains 800 anchors. Full training and runtime settings are reported in the method and appendix.
Results and discussion
Generalization evaluation on ODDS benchmarks
Table 3 summarizes the average AUC-ROC and overall ranking on the ODDS benchmarks. Detailed per-dataset results are provided in Appendix § 10.11. With all materials-domain rules disabled, the proposed method achieves an average AUC-ROC of 0.866 on 23 ODDS datasets, showing that the generic configuration can rank anomalies without materials-specific rules.
| Method | Average AUC-ROC | Rank |
| AnoLLM-135M | 0.892 | 1 |
| ICL | 0.884 | 2 |
| DTE | 0.882 | 3 |
| KNN | 0.878 | 4 |
| AnoLLM-360M | 0.867 | 5 |
| Our method | 0.866 | 6 |
| NeuTraL | 0.863 | 7 |
| SLAD | 0.848 | 8 |
| RCA | 0.843 | 9 |
| IForest | 0.839 | 10 |
| PCA | 0.814 | 11 |
| DeepSVDD | 0.812 | 12 |
| ECOD | 0.781 | 13 |
| REPEN | 0.756 | 14 |
| GOAD | 0.729 | 15 |
Table 3. Average AUC-ROC and ranking on ODDS benchmarks.
Note. AUC-ROC is the area under the receiver operating characteristic curve; the average is over 23 datasets. Rank orders methods by decreasing average AUC-ROC (1 is highest).
The ODDS results establish the anomaly-ranking performance of the generic configuration. The following materials experiments examine the contributions of rule calibration and graph refinement.
Materials data quality assessment and downstream model validation
The downstream experiments test whether screening improves models trained on contaminated materials data. Table 4 reports MACE results, and Table 5 compares screening methods and graph modules using HGBR. All methods are evaluated on the same clean test records within each seed.
Table 4: MACE downstream validation on five repeated grouped subsets (mean ± SD). F1 and retained counts follow the common structural eligibility check. MAE is in eV/atom. Matched random retains the same number of structures as complete rules.
| Condition | F1 | MAE | Retained | |
| Clean reference | – | |||
| No cleaning | ||||
| Complete rules | ||||
| Rules + propagation + GAT | ||||
| Isolation Forest | ||||
| PCA | ||||
| Matched random |
Table 4.
Table 5: Independent module ablation under 50% mixed contamination (five-seed mean ± SD). Retention is out of approximately 10,000 fitting records; MAE is in eV/atom. Random controls match the retained counts of complete rules (rules) or the configuration with both graph stages (full).
| Configuration | AP | F1 | MAE | Retained | |
| Clean reference | – | – | |||
| No cleaning | – | – | |||
| Statistical | |||||
| Boundary | |||||
| Complete rules | |||||
| Rules + propagation | |||||
| Rules + GAT | |||||
| Rules + propagation + GAT | |||||
| Isolation Forest | |||||
| PCA | |||||
| Matched random (rules) | – | – | |||
| Matched random (full) | – | – |
Table 5.
Note. F1 is the harmonic mean of anomaly-detection precision and recall. is the coefficient of determination on clean test structures; MAE is the mean absolute prediction error in eV/atom. Retained is the number of fitting structures kept after screening and the shared structural check. Values are mean ± sample standard deviation over five seeds; – indicates a metric not reported for that condition.
On the shared eligible fitting set of 2256 ± 22 structures, clean-reference MACE achieves , compared with 0.5896 ± 0.0527 without cleaning. Rule calibration retains 1158 ± 8 structures and recovers to 0.8801 ± 0.0268. Isolation Forest and PCA obtain 0.6589 ± 0.0602 and 0.5740 ± 0.0576, respectively. The rule-versus-no-cleaning paired gain is 0.2906, with a descriptive 95% interval [0.2098, 0.3714]. The full graph configuration yields 0.8150 ± 0.0413; its difference from rules is −0.0652 [−0.1321, 0.0018]. Rule-based screening therefore recovers a substantial part of the prediction performance lost to corruption under the shared ten-epoch budget. Test sets contain 990–994 eligible clean crystals per seed.
Note. AP is average precision for anomaly ranking; F1 measures screening at the calibration-selected threshold. and MAE describe HGBR predictions on the clean test set. Retained counts fitting records kept for training. Values are mean ± sample standard deviation over five seeds; – indicates a metric not reported for that condition.
The HGBR results show that contamination reduces clean-reference from 0.6566 ± 0.0088 to 0.5379 ± 0.0077. Statistical and boundary calibration recover part of the loss, while complete rules achieve 0.6160 ± 0.0140. The paired gain over no cleaning is 0.0781 [0.0683, 0.0880]. Matched-count random retention yields markedly lower , showing that evidence-based sample selection drives the recovery.
The full graph configuration achieves the highest AP, increasing it from 0.9427 ± 0.0037 for complete rules to 0.9530 ± 0.0041. Among the screening configurations, complete rules achieve the highest F1 (0.9705 ± 0.0019) and downstream (0.6160 ± 0.0140), compared with 0.9634 ± 0.0017 and 0.6107 ± 0.0143 for the full graph configuration. The paired difference is −0.0053 [−0.0121, 0.0016]. Propagation alone gives AP 0.9024 ± 0.0054 and more variable retained counts. Local attention therefore improves anomaly ranking in this benchmark, while rule calibration gives the highest mean F1 and test among the screening configurations.
Figure 3. Repeated ablation under mixed contamination. Rules, bipartite propagation and local GAT are evaluated separately for anomaly ranking and downstream prediction.
Contamination robustness and parameter sensitivity
Table 6 compares screening F1 at three contamination fractions and three mixed-input perturbation scales. Only the mixed-descriptor perturbation changes; the other corruption mechanisms and target noise remain fixed. F1 is higher at larger contamination fractions for both configurations and changes little across the tested perturbation scales.
| Configuration | Contamination | |||
| Rules | 10% | 0.782 ± 0.010 | 0.782 ± 0.010 | 0.782 ± 0.010 |
| Rules | 30% | 0.931 ± 0.002 | 0.931 ± 0.002 | 0.931 ± 0.002 |
| Rules | 50% | 0.970 ± 0.002 | 0.971 ± 0.002 | 0.970 ± 0.002 |
| Full graph | 10% | 0.733 ± 0.016 | 0.728 ± 0.021 | 0.728 ± 0.021 |
| Full graph | 30% | 0.905 ± 0.030 | 0.911 ± 0.018 | 0.910 ± 0.019 |
| Full graph | 50% | 0.962 ± 0.001 | 0.963 ± 0.002 | 0.963 ± 0.002 |
Table 6. Screening F1 across contamination fractions and mixed-descriptor scales (five-seed mean ± SD).
Note. Contamination is the fraction of records with injected errors. Column headings give the mixed-descriptor perturbation scale relative to the descriptor standard deviation . Entries are F1 scores (higher is better), reported as mean ± sample standard deviation over five seeds. Full graph uses both propagation and GAT.
Table 7 reports recall separately for the four corruption mechanisms. Complete rules detect almost all injected records at the calibration-selected thresholds. The F1 results in Table 5 also account for clean records incorrectly removed during screening.
| Mechanism | Statistical | Rules | Rules + propagation | Full graph |
| Statistical outlier | 0.9992 ± 0.0006 | 1.0000 ± 0.0000 | 0.6373 ± 0.5006 | 0.9685 ± 0.0268 |
| Boundary violation | 0.9979 ± 0.0018 | 1.0000 ± 0.0000 | 0.9832 ± 0.0371 | 0.9990 ± 0.0010 |
| Representation mismatch | 0.9803 ± 0.0032 | 1.0000 ± 0.0000 | 0.6000 ± 0.5477 | 0.9995 ± 0.0007 |
| Mixed perturbation | 0.9706 ± 0.0068 | 0.9998 ± 0.0004 | 0.7053 ± 0.4073 | 0.9997 ± 0.0004 |
Table 7. Recall by injected mechanism under internal calibration (mean ± SD; approximately 1,250 contaminated fitting records per mechanism per seed).
Note. Entries are recall: the fraction of injected records of each mechanism identified as anomalous. Statistical uses distribution checks only; Rules uses the complete rule set; Full graph adds propagation and GAT. Values are mean ± sample standard deviation over five seeds.
Appendix § 10.§ 2 reports the score distributions at each stage. The main comparison uses AP, calibration-selected F1 and downstream prediction to assess ranking and screening performance.
Table 8 varies the severe and mild penalties for the propagation configuration. AP ranges from 0.8991 to 0.9052. F1 and downstream vary more because they also depend on applying the calibration threshold to a separately scored fitting batch. Appendix § 10.7 reports the corresponding tests with equal feature weights and changes to individual weights.
| Severe/mild | AP | F1 | |
| s0.2/m0.6 | |||
| s0.2/m0.7 | |||
| s0.2/m0.8 | |||
| s0.3/m0.6 | |||
| s0.3/m0.7 | |||
| s0.3/m0.8 | |||
| s0.4/m0.6 | |||
| s0.4/m0.7 | |||
| s0.4/m0.8 |
Table 8. Penalty sensitivity of the static-propagation configuration with independent threshold calibration (five-seed mean SD).
Note. Severe/mild gives the cell penalty coefficients: for example, s0.2/m0.6 means 0.2 for severe evidence and 0.6 for mild evidence. AP is average precision; F1 measures threshold-based screening; evaluates HGBR prediction on clean test data. Values are mean sample standard deviation over five seeds.
Interpretable materials data governance case study
To enhance interpretability in a realistic materials data governance scenario, this study conducts a case analysis on alloy data collected from public literature [41]. A curated structured analysis table supports rule aggregation and consistency checking [42] [43]. Record-level auditing identifies missing FE in 68 records and missing UTS in 12 records of the 185-record table. These are field-specific counts and can overlap within the same record. The processing-history fields are absent from this table. Two FE values exceed the configured screening threshold. Separately, 15 composition/temperature group–target combinations meet the property-spread criteria (Appendix § 10.9); these group-level events are distinct from the record-level missingness counts. Table 9 retains representative evidence patterns and distinguishes their interpretation.
| Evidence type | Representative sample | Main evidence | Interpretation |
| Unusual recorded value | TiAlVCrNb (750 °C, FE = 130%) | Recorded FE = 130% triggers the configured value-range check. | Source/context check required |
| Property spread with missing context | CoCrFeNiMnTi (25 °C) | For the same recorded composition and temperature, UTS ranges from 630 to 2220 MPa and FE from 3% to 85%. Processing and testing details are needed to interpret this spread. | Source/context check required |
| Missing field with property spread | AlCoCrFeNi (25 °C) | At matched recorded composition and testing temperature, UTS ranges from 766 to 1013 MPa, while some corresponding FE values are missing, providing directly observable missingness and a property difference requiring additional context. | Missingness observed; context check required |
| Statistical discrepancy with fitting evidence | Original literature No. 1 (UTS = 1072 MPa, FE = 55%) | The reported FE differs from its neighborhood prediction. KNN predicts FE 11.85%, while Random Forest also suggests a clear deviation. | Model-discrepancy candidate |
Table 9. Representative review candidates and evidence in the public-literature alloy dataset.
Note. UTS is ultimate tensile strength (MPa); FE is fracture elongation (%). Evidence identifies the observed value, missing field or prediction discrepancy; Interpretation states the follow-up review suggested by that evidence.
Engineering elongation has no universal upper bound of 100%, and its interpretation depends on measurement definition and gauge length. Likewise, processing can alter properties at the same nominal composition and testing temperature. These two candidate types therefore require source and experimental-context checks; fitting residuals help prioritize that review.
For example, in the original literature reference table, sample No.1 reports FE = 55, whereas the KNN-predicted FE is approximately 11.85. Sample No.108 reports UTS = 710 MPa, whereas the KNN-predicted UTS is approximately 1088.69 MPa. These differences direct attention to records whose source values or processing conditions warrant inspection.
Historical-reference batch comparison
The historical experiment tests whether batch scores follow the known contamination order. Table 10 compares within-batch anchors, historical KNN and trained Memory-GAT over five seeds. All three mean scores decrease with contamination, expressing a consistent average quality trend on their respective score scales.
| Contamination | Within-batch anchor | Historical KNN | Memory-GAT |
| 0% | 0.8637 ± 0.0054 | 0.8410 ± 0.0030 | 0.5912 ± 0.0663 |
| 10% | 0.8079 ± 0.0040 | 0.8266 ± 0.0034 | 0.5872 ± 0.0635 |
| 30% | 0.7294 ± 0.0022 | 0.7912 ± 0.0026 | 0.5776 ± 0.0583 |
| 50% | 0.6515 ± 0.0024 | 0.7581 ± 0.0020 | 0.5657 ± 0.0520 |
Table 10. Controlled cross-batch historical comparison (five-seed mean ± SD).
Note. Contamination is the injected-error fraction in the current batch. Within-batch anchor is the mean rule/propagation score; Historical KNN averages historical reference scores by inverse-distance weights; Memory-GAT reports . Larger values indicate higher assessed quality within each scoring method. Values are mean ± sample standard deviation over five seeds.
The within-batch and historical KNN scores preserve the four-batch ordering in all five runs, with mean Spearman correlation 1.00. Memory-GAT preserves the order in four runs and obtains mean correlation 0.96. Historical KNN averages reference scores using descriptor distances, while Memory-GAT learns scores from the reference nodes and their graph connections. The mean scores of both historical methods track the increasing contamination levels.
Computational cost
Dense reliability storage and each bipartite propagation iteration cost ; exact KNN construction has distance cost. A GAT layer requires operations for input/hidden widths , and edges. Measured with four CPU threads, the 15,999-record workflow takes 7.480±0.176 s and peaks at 699.1±0.2 MiB process RSS; this includes both local GAT comparisons. The 800-anchor Memory-GAT call for 900 current samples takes 0.216±0.002 s with peak process RSS 390.1±0.3 MiB, excluding upstream scoring and anchor selection. Appendix § 10.8 reports scaling and environment details.
Scope of the evaluation. The materials benchmark uses controlled input and target errors, with synthetic calibration labels for threshold selection. MACE results compare methods under the same ten-epoch budget, and the historical experiment compares disjoint batches from the same materials source. These settings define the conditions represented by the reported results.
Conclusion
This work presents a confidence-based framework for materials data quality assessment that integrates domain knowledge, statistical evidence, and graph-structured optimization. Rather than treating data quality as a binary anomaly identification problem, the proposed framework formulates quality evaluation as a continuous confidence-modeling problem and establishes an interpretable workflow consisting of nine-dimensional prior construction, knowledge-guided calibration, heterogeneous graph-based confidence propagation, local refinement, and historical-reference batch comparison.
Experiments show that the framework supports both generic anomaly ranking and materials-specific quality assessment. With materials rules disabled, it achieves an average AUC-ROC of 0.866 on 23 ODDS datasets. In the materials data cleaning experiment, the identification and removal of low-quality records lead to substantial recovery of downstream model performance, as validated by both conventional machine learning prediction and MACE-based downstream modeling, with rule-based screening increasing mean MACE from 0.590 ± 0.053 to 0.880 ± 0.027 in the repeated subset study. Graph refinement improves mean anomaly-ranking AP from 0.943 ± 0.004 to 0.953 ± 0.004, while rule calibration gives the highest mean screening F1 and test among the evaluated screening configurations. Historical reference scoring tracks batch-quality changes as contamination increases. Together, these results connect continuous confidence, inspectable evidence and task-dependent choice of scoring configuration within one assessment workflow.
Future work will extend graph construction and reference retrieval through approximate search, expand rule coverage using knowledge graphs and literature mining [46], and evaluate historical quality anchors across additional materials sources.
Code and data availability
The code and data supporting this study is available at https://github.com/materialsCnicCas/materials-data-qua
Acknowledgements
This work was supported by the National Key Research and Development Program of China (Grant No. 2025YFE0102600) and the Strategic Priority Research Program of Chinese Academy of Sciences (Grant No.XDA0410404).
Declarations
The authors declare no competing interests.
Supplementary methods and benchmark results
Complete data quality assessment workflow
Algorithm A.1: End-to-end confidence-based materials data quality assessment.
Input: dataset ; metadata ; feature-quality weights ; rule sets , , and ; coefficients and ; historical quality memory .
Output: sample confidence ; feature confidence ; rule-trigger evidence ; memory scores ; dataset-level score .
Compute feature indicators and initialize ; set for exact duplicate-group members and otherwise.
Generate univariate boundary, multivariate relationship, and global distribution evidence: , , and .
Combine the evidence as , and derive the penalty coefficients , , and edge-reliability matrix .
Calibrate confidence using and .
Compute and and construct ; set .
Iterate until convergence.
Split the converged state into and .
Construct , build the sample KNN graph, and train GAT against to obtain .
Refine sample confidence as .
Select frozen anchors covering the confidence-score range from and combine them with the current samples to construct the memory graph.
Apply Memory-GAT to obtain and compute .
return , , , , and .
Confidence distributions across stages
Table A.1 reports the mean confidence of clean and injected records, together with their difference. These statistics describe how the score distributions change during calibration and graph processing. A mean difference depends on score scale: multiplying all scores by a positive constant changes the difference without changing their ranking. It is therefore considered alongside AP, F1 and downstream prediction, rather than used alone to compare stages. In a separate 12,000-record diagnostic, a fixed cutoff of 0.4 retains all records after propagation. The main screening experiment instead selects a threshold for each scoring configuration on the calibration partition.
| Configuration | Clean | Injected | Gap |
| Complete rules | 0.8878 ± 0.0064 | 0.3000 ± 0.0000 | 0.5878 ± 0.0064 |
| Rules + propagation | 0.7709 ± 0.0035 | 0.5686 ± 0.0013 | 0.2023 ± 0.0023 |
| Rules + GAT | 0.7477 ± 0.0101 | 0.2238 ± 0.0029 | 0.5239 ± 0.0121 |
| Full graph | 0.6483 ± 0.0074 | 0.4215 ± 0.0053 | 0.2268 ± 0.0116 |
Table A.1. Confidence for clean and injected groups under the controlled benchmark (five-seed mean ± SD).
Note. Clean and Injected are the mean confidence scores of clean and contaminated records, respectively. Gap is Clean minus Injected on the corresponding score scale. Values are mean ± sample standard deviation over five seeds. Full graph includes both propagation and GAT.
Operational definitions of the feature prior
The nine indicators are calculated for each scoring batch using the weights in § 3.1. In the repeated benchmark, each field name also serves as its metadata description; the declared type is float, and the range is either configured or taken from the batch minimum and maximum. Several indicators are consequently constant: median imputation makes the non-missing fraction one, all retained fields are numerical, and the supplied metadata yield the same documentation scores. The feature uniqueness indicator is set to one because duplicate records are handled separately by the sample prior. The formulas below specify each indicator. For feature , , , , and denote the minimum, maximum, mean, pandas sample skewness and interquartile range. The configured range is , and prevents division by zero.
| Name / interpretation | Formula in this reference experiment | Operational meaning |
| provenance / documentation availability | Documentation completeness from available metadata. | |
| Name / interpretation | Formula | Operational meaning |
| dataset_characteristics / range–center agreement | If an endpoint lies outside the configured range, ; otherwise . Set and . | Measures range agreement and distance from the configured range center. |
| uniformity / numeric compatibility | Fraction of nonmissing observations convertible to a number; zero for an empty field. | Numerical conversion rate; constant for the numerical fields used here. |
| metadata_coupling / lexical match | difflib.SequenceMatcher ratio between lowercased field name and description. | Lexical agreement proxy for field documentation. |
| non_missing_cells / observed-cell fraction | Fraction nonmissing at scoring time. | Adapted completeness; equals one after imputation here. |
| non_duplicate_rows / duplicate handling | ; exact duplicate detection acts through instead. | Fixed at one; sample duplicates are handled by the sample prior. |
| un_skewness / shape regularity | With : for ; for ; for ; otherwise. | Piecewise shape score, with a discontinuity at in the implementation. |
| accuracy / numeric regularity | Start at one. Multiply by only when Tukey-outlier fraction and IQR . Multiply by 0.8 if the standard deviation of decimal digit counts exceeds three, or 0.9 if it exceeds two. | Numerical regularity proxy using precision and outlier frequency. |
| target_correlation / principal-variation relevance | using unstandardized numerical PCA; 0.5 for undefined correlation. | Descriptor-only relevance to the principal variation of the batch. |
Table A.2. Feature indicators: implementation names and operational definitions.
All nine feature scores are saved for each seed using these fixed operational formulas.
Convergence and implementation verification
All entries of the static are positive, hence the separate degree matrices have nonzero diagonals and the block transition is row-stochastic. For ,
For , the map has the unique fixed point and converges geometrically. Every update is a convex combination, preserving . An independent sparse solution of a small system agrees within ; an independently assembled 12,000-row sparse transition agrees within .
Memory-GAT inputs and training
Memory-GAT uses 18 descriptors: band gap, energy above hull, space group, three lattice lengths, three angles and nine lattice-matrix entries. Missing values and standardization are handled using medians, means and standard deviations fitted on the historical data. The historical input is , where is the stored reference confidence. The current input is , where is the current rule/propagation score. These 19-dimensional vectors are also used to retrieve Euclidean nearest neighbors. The encoder uses hidden width 24, two first-layer attention heads and a sigmoid MLP output. Each current node receives messages from eight historical neighbors, six current neighbors and itself; historical nodes receive only self-loop messages. The loss is
The first two terms fit historical and current reference scores; the third penalizes differences between connected nodes. Adam uses learning rate , weight decay , dropout 0.05 and gradient clipping at one. Training runs for at most 30 epochs and stops after eight epochs without a lower training loss; the parameters with the lowest loss are restored. Historical KNN uses eight historical neighbors with inverse-distance weights.
Controlled corruption and MACE settings
Within each corrupted batch, 50% of rows are sampled and divided into four equal groups. Statistical corruption perturbs up to eight generic descriptors by independent Gaussian offsets at ; boundary corruption sets up to five configured fields 35% of their range below or above the endpoints. Relationship corruption replaces lattice lengths with 2 or 30 Å according to their stored row norm. Mixed corruption perturbs up to 12 descriptors at the declared scale, shifts the first eight descriptors by , may set a negative band gap, and modifies one lattice length. Every selected row receives target noise at . The same recipe is applied independently to fitting and calibration batches. Corruption labels are used for metrics and calibration-threshold selection, not scorer inputs or training targets.
For MACE, corrupted numerical lattice and coordinate fields are exported as actual ASE structures, and energy per atom is multiplied by atom count. All conditions use the same structural filter, which requires finite coordinates, absolute cell determinant at least Å, condition number at most , minimum periodic pair distance at least 1 Å, and at most 120 periodic neighbors within 4 Å. A fitting record is eligible only if both its original and corrupted structures pass these checks. Validation and test records are checked using their clean structures. Random retention is matched to the screened sample count after structural filtering.
The MACE 0.3.15 environment uses Python 3.10.20, PyTorch 2.11.0 with CUDA 12.8 and NVIDIA RTX 5090 GPUs. Additional settings are max_L=1, atomic-number vocabulary 1–94, validation batch size 64, Adam with AMSGrad, gradient clipping 10 and ReduceLROnPlateau (factor 0.5, patience 10). Energy loss weight is one and force loss weight zero; stage two is disabled. Clean validation selects the exported checkpoint, with no test file passed to training. All 35 runs are evaluated on common clean test records within each seed. Every condition uses the same ten-epoch training budget.
Additional sensitivity results
Table A.3 reports the propagation configuration with thresholds selected on the calibration partition. Each indicator weight is multiplied by 0, 0.8 or 1.2, after which all weights are normalized to sum to one. Thus, x0.0 removes an indicator, and x0.8/x1.2 reduce/increase its weight by 20% before normalization. The uniform setting gives all nine indicators equal weight. All other parameters remain fixed. Changing a constant indicator can still change the overall score scale through weight normalization.
Table A.3: Complete feature-weight sensitivity results. Setting identifies the indicator and its weight multiplier (x0.0 removes it); uniform gives equal weights. AP is average precision, F1 measures screening, and evaluates HGBR prediction on clean test data. Values are mean sample standard deviation over five seeds.
| Setting | AP | F1 | |
| accuracy_x0.0 | 0.9032 ± 0.0056 | 0.7851 ± 0.2689 | 0.5857 ± 0.0425 |
| accuracy_x0.8 | 0.9025 ± 0.0054 | 0.7726 ± 0.2766 | 0.5828 ± 0.0430 |
| accuracy_x1.2 | 0.9023 ± 0.0053 | 0.7683 ± 0.2807 | 0.5858 ± 0.0371 |
| dataset_characteristics_x0.0 | 0.9067 ± 0.0049 | 0.6881 ± 0.2692 | 0.5656 ± 0.0392 |
| dataset_characteristics_x0.8 | 0.9040 ± 0.0052 | 0.7657 ± 0.2816 | 0.5828 ± 0.0414 |
| dataset_characteristics_x1.2 | 0.9009 ± 0.0055 | 0.7837 ± 0.2726 | 0.5866 ± 0.0427 |
| default | 0.9024 ± 0.0054 | 0.7715 ± 0.2776 | 0.5828 ± 0.0433 |
| metadata_coupling_x0.0 | 0.9003 ± 0.0056 | 0.7827 ± 0.2714 | 0.5849 ± 0.0402 |
| metadata_coupling_x0.8 | 0.9020 ± 0.0054 | 0.7720 ± 0.2776 | 0.5836 ± 0.0434 |
| metadata_coupling_x1.2 | 0.9028 ± 0.0053 | 0.7688 ± 0.2798 | 0.5826 ± 0.0425 |
| non_duplicate_rows_x0.0 | 0.9011 ± 0.0055 | 0.7813 ± 0.2715 | 0.5835 ± 0.0402 |
| non_duplicate_rows_x0.8 | 0.9021 ± 0.0054 | 0.7716 ± 0.2777 | 0.5851 ± 0.0413 |
| non_duplicate_rows_x1.2 | 0.9027 ± 0.0054 | 0.7713 ± 0.2777 | 0.5823 ± 0.0429 |
| non_missing_cells_x0.0 | 0.8980 ± 0.0058 | 0.8380 ± 0.2657 | 0.5976 ± 0.0357 |
| non_missing_cells_x0.8 | 0.9014 ± 0.0055 | 0.7811 ± 0.2713 | 0.5839 ± 0.0376 |
| non_missing_cells_x1.2 | 0.9034 ± 0.0053 | 0.7675 ± 0.2809 | 0.5827 ± 0.0420 |
| provenance_x0.0 | 0.9011 ± 0.0055 | 0.7813 ± 0.2715 | 0.5835 ± 0.0402 |
| provenance_x0.8 | 0.9021 ± 0.0054 | 0.7716 ± 0.2777 | 0.5851 ± 0.0413 |
| provenance_x1.2 | 0.9027 ± 0.0054 | 0.7713 ± 0.2777 | 0.5823 ± 0.0429 |
| target_correlation_x0.0 | 0.9038 ± 0.0052 | 0.8434 ± 0.2550 | 0.5977 ± 0.0330 |
| target_correlation_x0.8 | 0.9027 ± 0.0053 | 0.7797 ± 0.2703 | 0.5848 ± 0.0414 |
| target_correlation_x1.2 | 0.9021 ± 0.0055 | 0.7686 ± 0.2825 | 0.5817 ± 0.0422 |
| un_skewness_x0.0 | 0.9052 ± 0.0051 | 0.7435 ± 0.3276 | 0.5803 ± 0.0496 |
| Setting | AP | F1 | |
| un_skewness_x0.8 | 0.9031 ± 0.0054 | 0.7649 ± 0.2870 | 0.5821 ± 0.0414 |
| un_skewness_x1.2 | 0.9017 ± 0.0054 | 0.7817 ± 0.2685 | 0.5834 ± 0.0415 |
| uniform | 0.9047 ± 0.0051 | 0.7615 ± 0.2786 | 0.5807 ± 0.0396 |
| uniformity_x0.0 | 0.8988 ± 0.0056 | 0.7900 ± 0.2689 | 0.5863 ± 0.0443 |
| uniformity_x0.8 | 0.9016 ± 0.0055 | 0.7810 ± 0.2713 | 0.5835 ± 0.0394 |
| uniformity_x1.2 | 0.9032 ± 0.0053 | 0.7679 ± 0.2805 | 0.5823 ± 0.0418 |
Table A.3.
Computational scaling
Local timing uses Python 3.9.7, PyTorch 2.7.1 CPU and scikit-learn 1.6.1 on an AMD Ryzen 5 9500F, with four threads and three fresh-process runs per scale. Total scoring includes both 50-epoch local GAT comparisons and supporting steps, but not reading or corruption generation. Peak resident set size (RSS) measures the memory of the entire process, including the Python runtime and data preparation. The static iteration converges in 38–39 iterations.
| Records | Fields | Scoring (s) | Peak RSS (MiB) |
| 999 | 43–46 | 0.787 ± 0.022 | 457.9 ± 27.7 |
| 3,999 | 43 | 1.968 ± 0.004 | 468.0 ± 12.0 |
| 8,000 | 43 | 3.684 ± 0.026 | 529.5 ± 0.7 |
| 15,999 | 43 | 7.480 ± 0.176 | 699.1 ± 0.2 |
Table A.4. Local scoring cost (mean ± SD over three fresh processes).
Note. Records and Fields give the numbers of samples and numerical descriptors. Scoring is elapsed scoring time in seconds. Peak RSS is the maximum resident set size of the entire process, in mebibytes (MiB). Values are mean ± sample standard deviation over three independent process runs.
Historical scoring uses 900 current records and 200/400/800 anchors. Mean scorer-call times are 0.205/0.210/0.216 s, with process RSS 388.4/389.0/390.1 MiB. These include descriptor preparation, retrieval, attention training and inference, excluding upstream rule scoring and anchor selection. Dense propagation uses storage and per-iteration arithmetic. Exact sample KNN uses arithmetic; historical/current retrieval has worst-case distance cost even when KD-tree pruning is used. The timing measurements use exact retrieval on one machine.
Alloy audit criteria
Missingness counts are computed from the original supplied workbooks before imputation. The 185-record table lacks all 12 processing-history columns listed in Table A.5; the 315-record source table contains them. Candidate groups use the 14 element fractions rounded to four decimals and, in the 185-record table, recorded testing temperature. Missing/nonnumeric fractions are replaced by zero for group-key construction. Each property is examined separately within a group. With at least two observations, the group is flagged for that property when UTS spread is at least 100 MPa and relative spread at least 0.15, or FE spread is at least five percentage points and relative spread at least 0.20. Relative spread is the maximum minus the minimum, divided by the absolute median with a lower bound of on the denominator. These flags prioritize source review using the recorded composition, temperature and property fields.
Field definitions for the alloy case-study datasets
The two alloy tables differ primarily in their representation of experimental conditions. The 185-record case-study table retains a single testing-temperature field, whereas the 315-record source-literature table provides a more detailed processing history. Both tables contain the same elemental-composition variables, mechanical-property variables, and 32 composition-derived material descriptors.
| Availability | Category | Fields | Definition |
| Both | Sample identifier | Alloy_Name (185-record table); No. (315-record table) | Alloy-composition label or numerical record identifier used to distinguish individual observations. |
| Availability | Category | Fields | Definition |
| Both | Elemental composition | Co, Cr, Fe, Mn, Ni, Al, Ti, V, Cu, W, Mo, Zr, Nb, Ta | Contents of the 14 constituent elements. The values describe the nominal elemental fractions recorded for each alloy, typically in atomic percent. |
| 185 only | Testing condition | temperature | Temperature at which the reported UTS and FE values were measured. |
| 315 only | Homogenization | Hom-T, Hom-t | Homogenization temperature and holding time, respectively. |
| 315 only | Deformation | Def-T, Def-r | Deformation temperature and deformation or reduction ratio, respectively. |
| 315 only | First annealing stage | AnnI-T, AnnI-t | Temperature and holding time of the first annealing treatment. |
| 315 only | Rolling | Rol-T, Rol-rate | Rolling temperature and rolling-reduction rate, respectively. |
| 315 only | Second annealing stage | AnnII-T, AnnII-t | Temperature and holding time of the second annealing treatment. |
| 315 only | Aging | Age-T, Age-t | Aging temperature and aging duration, respectively. |
| Both | Mechanical properties | UTS, FE | Ultimate tensile strength and fracture elongation, which characterize alloy strength and ductility, respectively. |
| Both | Atomic and periodic descriptors | Z, Per, Gro, M, VEC | Composition-weighted atomic number, periodic-table period, group number, atomic mass, and valence-electron concentration. |
| Both | Electronic and chemical descriptors | Aff, Ion, | Composition-weighted electron affinity, first ionization energy, and electronegativity. |
| Both | Basic physical and thermal descriptors | , Tm, Tb, k/, Cm | Composition-weighted density, melting point, boiling point, thermal conductivity, and molar heat capacity. The thermal-conductivity field is named k in the 185-record table and in the 315-record table. |
| Both | Phase-change thermodynamic descriptors | , , | Composition-weighted enthalpy of vaporization, enthalpy of fusion, and entropy of fusion. |
| Both | Electronic, transport, and structural descriptors | ED, D, a, R | Electron-density descriptor, diffusion-related coefficient, lattice parameter, and atomic-radius descriptor supplied by the source dataset. |
| Both | Elastic descriptors | E, K, G, C11, C12, C44 | Composition-weighted Young’s modulus, bulk modulus, shear modulus, and the three independent elastic stiffness constants commonly used for cubic materials. |
| Both | Vibrational descriptor | Td | Composition-weighted Debye temperature, characterizing the characteristic lattice-vibration scale. |
| Both | Alloy-level mismatch and thermodynamic descriptors | , , , , | Atomic-radius mismatch, electronegativity mismatch, configurational entropy of mixing, enthalpy of mixing, and the thermodynamic parameter combining melting temperature, mixing entropy, and mixing enthalpy. |
Table A.5. Field categories and definitions for the 185-record case-study table and the 315-record source-literature reference table.
Note: The field names and grouping follow the uploaded source tables. The units and numerical conventions are retained from the corresponding literature data. The physicochemical descriptors are primarily composition-weighted elemental properties, whereas , , , , and are alloy-level quantities derived from the overall composition.
Detailed ODDS benchmark results
| Dataset | Classical methods | Deep-learning-based methods | AnoLLM | Our method | |||||||||||
| IForest | PCA | KNN | ECOD | DeepSVDD | RCA | SLAD | GOAD | NeuTraL | ICL | DTE | REPEN | 135M | 360M | ||
| Annthyroid | 0.922 | 0.839 | 0.811 | 0.790 | 0.742 | 0.718 | 0.761 | 0.572 | 0.813 | 0.842 | 0.977 | 0.736 | 0.927 | 0.931 | 0.924 |
| Arrhythmia | 0.827 | 0.796 | 0.786 | 0.811 | 0.765 | 0.786 | 0.784 | 0.681 | 0.760 | 0.785 | 0.771 | 0.684 | 0.825 | 0.822 | 0.790 |
| BreastW | 0.994 | 0.988 | 0.992 | 0.992 | 0.974 | 0.987 | 0.986 | 0.994 | 0.983 | 0.992 | 0.982 | 0.955 | 0.992 | 0.993 | 0.993 |
| Cardio | 0.948 | 0.966 | 0.921 | 0.935 | 0.842 | 0.948 | 0.840 | 0.524 | 0.859 | 0.894 | 0.920 | 0.829 | 0.940 | 0.873 | 0.926 |
| ForestCover | 0.870 | 0.945 | 0.985 | 0.921 | 0.533 | 0.944 | 0.857 | 0.278 | 0.898 | 0.977 | 0.978 | 0.902 | 0.881 | 0.835 | 0.902 |
| Glass | 0.802 | 0.713 | 0.849 | 0.693 | 0.824 | 0.719 | 0.790 | 0.574 | 0.933 | 0.887 | 0.799 | 0.755 | 0.819 | 0.797 | 0.760 |
| Ionosphere | 0.891 | 0.894 | 0.960 | 0.734 | 0.963 | 0.916 | 0.960 | 0.950 | 0.956 | 0.970 | 0.964 | 0.545 | 0.909 | 0.924 | 0.924 |
| LetterRecognition | 0.631 | 0.529 | 0.865 | 0.567 | 0.776 | 0.716 | 0.908 | 0.811 | 0.929 | 0.959 | 0.872 | 0.597 | 0.967 | 0.867 | 0.766 |
| Lymphography | 0.673 | 0.826 | 0.860 | 0.830 | 0.899 | 0.919 | 0.964 | 0.817 | 0.847 | 0.827 | 0.909 | 0.808 | 0.968 | 0.993 | 0.953 |
| Mammography | 0.881 | 0.900 | 0.872 | 0.906 | 0.857 | 0.873 | 0.740 | 0.756 | 0.690 | 0.782 | 0.864 | 0.863 | 0.915 | 0.876 | 0.884 |
| Musk | 0.971 | 1.000 | 1.000 | 0.956 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 0.722 | 1.000 | 1.000 | 1.000 |
| Optdigits | 0.824 | 0.574 | 0.944 | 0.606 | 0.753 | 0.800 | 0.735 | 0.847 | 0.979 | 0.955 | 0.888 | 0.607 | 0.983 | 0.939 | 0.687 |
| Pendigits | 0.971 | 0.942 | 0.999 | 0.928 | 0.838 | 0.967 | 0.932 | 0.220 | 0.963 | 0.971 | 0.982 | 0.922 | 0.971 | 0.964 | 0.969 |
| Pima | 0.720 | 0.711 | 0.741 | 0.587 | 0.593 | 0.704 | 0.584 | 0.665 | 0.763 | 0.697 | 0.662 | 0.688 | 0.663 | 0.654 | 0.745 |
| Satellite | 0.807 | 0.662 | 0.874 | 0.582 | 0.800 | 0.734 | 0.864 | 0.795 | 0.859 | 0.854 | 0.789 | 0.740 | 0.902 | 0.877 | 0.832 |
| Satimage-2 | 0.993 | 0.979 | 0.999 | 0.965 | 0.961 | 0.998 | 0.997 | 0.994 | 0.861 | 0.997 | 0.988 | 0.998 | 1.000 | 0.999 | 0.995 |
| Shuttle | 0.996 | 0.994 | 0.999 | 0.993 | 0.997 | 0.996 | 0.998 | 0.990 | 0.997 | 0.999 | 0.998 | 0.992 | 1.000 | 1.000 | 0.993 |
| Speech | 0.478 | 0.471 | 0.486 | 0.471 | 0.563 | 0.472 | 0.511 | 0.550 | 0.609 | 0.582 | 0.511 | 0.531 | 0.470 | 0.470 | 0.615 |
| Thyroid | 0.989 | 0.984 | 0.976 | 0.978 | 0.869 | 0.969 | 0.948 | 0.689 | 0.886 | 0.987 | 0.990 | 0.904 | 0.975 | 0.983 | 0.985 |
| Vertebral | 0.446 | 0.494 | 0.406 | 0.474 | 0.478 | 0.478 | 0.483 | 0.516 | 0.545 | 0.543 | 0.570 | 0.247 | 0.565 | 0.408 | 0.403 |
| Vowels | 0.779 | 0.644 | 0.975 | 0.597 | 0.895 | 0.891 | 0.969 | 0.925 | 0.988 | 0.979 | 0.983 | 0.753 | 0.982 | 0.938 | 0.946 |
| WBC | 0.947 | 0.949 | 0.947 | 0.907 | 0.904 | 0.946 | 0.928 | 0.663 | 0.765 | 0.908 | 0.913 | 0.770 | 0.964 | 0.952 | 0.944 |
| Wine | 0.930 | 0.927 | 0.952 | 0.729 | 0.854 | 0.899 | 0.964 | 0.961 | 0.960 | 0.944 | 0.974 | 0.835 | 0.909 | 0.851 | 0.973 |
| Average | 0.839 | 0.814 | 0.878 | 0.781 | 0.812 | 0.843 | 0.848 | 0.729 | 0.863 | 0.884 | 0.882 | 0.756 | 0.892 | 0.867 | 0.866 |
| Rank | 10 | 11 | 4 | 13 | 12 | 9 | 8 | 15 | 7 | 2 | 3 | 14 | 1 | 5 | 6 |
Table A.6. Detailed ODDS benchmark comparison in terms of AUC-ROC. Note. All entries are AUC-ROC (area under the receiver operating characteristic curve); higher values indicate better anomaly ranking. IForest, PCA and KNN denote Isolation Forest, principal component analysis and nearest-neighbor detection. AnoLLM headings 135M and 360M identify model sizes in millions of parameters. Other column names identify the baseline models described in the benchmark comparison.
References
- [1]Lauri Himanen, Amber Geurts, Adam Stuart Foster, and Patrick Rinke. Data-driven materials science: status, challenges, and perspectives. Advanced Science, 6(21):1900808, 2019.DOI
- [2]Anubhav Jain, Shyue Ping Ong, Geoffroy Hautier, Wei Chen, William Davidson Richards, Stephen Dacek, Shreyas Cholia, Dan Gunter, David Skinner, Gerbrand Ceder, et al. Commentary: The materials project: A materials genome approach to accelerating materials innovation. APL materials, 1(1), 2013.DOI
- [3]Scott Kirklin, James E Saal, Bryce Meredig, Alex Thompson, Jeff W Doak, Muratahan Aykol, Stephan Rühl, and Chris Wolverton. The open quantum materials database (oqmd): assessing the accuracy of dft formation energies. npj Computational Materials, 1(1):1–15, 2015.DOI
- [4]Camilo E Calderon, Jose J Plata, Cormac Toher, Corey Osenes, Ohad Levy, Marco Fornari, Amir Natan, Michael J Mehl, Gus Hart, Marco Buongiorno Nardelli, et al. The aflow standard for high-throughput materials science calculations. Computational Materials Science, 108:233–238, 2015.arxiv.org/abs/1506.00303
- [5]Claudia Draxl and Matthias Scheffler. Nomad: The fair concept for big data-driven materials science. Mrs Bulletin, 43(9):676–682, 2018.arxiv.org/abs/1805.05039
- [6]Ben Blaizsik, Kyle Chard, Jim Pruyne, Rachana Ananthakrishnan, Steven Tuecke, and Ian Foster. The materials data facility: data services to advance materials science research. Jom, 68(8):2045–2052, 2016.DOI
- [7]Quratul Ain, Haider Tawfiq Naeem, Mubashar Ali, Junaid Munir, Zunaira Bibi, Hamid M Ghaithan, Abdullah Ahmed Ali Ahmed, and Saif MH Qaid. A precise prediction of structure stability and hydrogen storage capability of kcdh3 perovskite hydride using density functional theory calculations. Journal of Energy Storage, 100:113734, 2024.DOI
- [8]Durgesh Samariya and Amit Thakkar. A comprehensive survey of anomaly detection algorithms. Annals of Data Science, 10(3):829–850, 2023.
- [9]André M Carvalho, Sónia Soares, João Montenegro, and Lígia Conceição. Data quality: revisiting dimensions towards new framework development. Procedia Computer Science, 253:247–256, 2025.DOI
- [10]Farshad Rahmati, Reza Heydari Gharaei, and Hossein Nezamabadi-pour. Ardod: adaptive radius density-based outlier detection. Evolutionary Intelligence, 17(5):3707–3722, 2024.DOI
- [11]Anthony Yu-Tung Wang, Ryan J Murdock, Steven K Kauwe, Anton O Oliynyk, Aleksander Gurlo, Jakoah Brgoch, Kristin A Persson, and Taylor D Sparks. Machine learning for materials scientists: an introductory guide toward best practices. Chemistry of Materials, 32(12):4954–4965, 2020.DOI
- [12]Jonathan Schmidt, Mário RG Marques, Silvana Botti, and Miguel AL Marques. Recent advances and applications of machine learning in solid-state materials science. npj computational materials, 5(1):83, 2019.DOI
- [13]Aasim Ayaz Wani. Advancing material stability prediction: leveraging machine learning and high-dimensional data for improved accuracy. Materials Sciences and Applications, 16(02):79–105, 2025.
- [14]Ruoyu Li, Qing Li, Yu Zhang, Dan Zhao, Yong Jiang, and Yong Yang. Interpreting unsupervised anomaly detection in security via rule extraction. Advances in Neural Information Processing Systems, 36:62224–62243, 2023.DOI
- [15]Yue Liu, Shuchang Ma, Zhengwei Yang, Duo Wu, Xiaoming Avdeev, and Siqi Shi. Domain knowledge-assisted materials data anomaly detection towards constructing high-performance machine learning models. Journal of Materiomics, 11(6):101066, 2025.DOI
- [16]Guangbo Yu, Xiaoqiang Zhao, and Jixiang Zhao. Cognitive-cycle learning framework for small-sample industrial process quality prediction. Measurement Science and Technology, 37(10):105107, 2026.DOI
- [17]Sandeep Rangineni, Amit Bhanushali, Manoj Suryadevara, Srinivas Venkata, and Kiran Peddireddy. A review on enhancing data quality for optimal data analytics performance. International Journal of Computer Sciences and Engineering, 11(10):51–58, 2023.DOI
- [18]Maria Priestley, Fionntán O’donnell, and Elena Simperl. A survey of data quality requirements that matter in ml development pipelines. ACM Journal of Data and Information Quality, 15(2):1–39, 2023.DOI
- [19]S Kokott, A Marek, F Merz, P Karpov, C Carkovic, M Rossi, M Rampp, V Blum, and M Scheffler. Towards efficient and accurate input for data-driven materials science from large-scale all-electron density functional theory (dft) simulations. Modelling and Simulation in Materials Science and Engineering, 32(6):28–31, 2024.
- [20]Ran Wang, Cheng Xu, Runshi Dong, Zhenghui Luo, Rong Zheng, and Xiaotong Zhang. A secured big-data sharing platform for materials genome engineering: State-of-the-art, challenges and architecture. Future Generation Computer Systems, 142:59–74, 2023.DOI
- [21]Rees Chang, Yu-Xiong Wang, and Elif Ertekin. Towards overcoming data scarcity in materials science: unifying models and datasets with a mixture of experts framework. npj Computational Materials, 8(1):242, 2022.arxiv.org/abs/2207.13880
- [22]Fatih Aydın. Boundary-aware local density-based outlier detection. Information Sciences, 647:119520, 2023.DOI
- [23]Braulio V Sánchez Vinces, Erich Schubert, Arthur Zimek, and Robson LF Cordeiro. A comparative evaluation of clustering-based outlier detection. Data Mining and Knowledge Discovery, 39(2):13, 2025.DOI
- [24]Chenlong Feng, Chao Liu, and Dongxiang Jiang. Unsupervised anomaly detection using graph neural networks integrated with physical-statistical feature fusion and local-global learning. Renewable Energy, 206:309–323, 2023.DOI
- [25]SHI Siqi, SUN Shiyu, MA Shuchang, ZOU Xinxin, QIAN Quan, and LIU Yue. Detection method on data accuracy incorporating materials domain knowledge. Journal of Inorganic Materials, 37:1311–1320, 2022.DOI
- [26]Shun Zhu, Xichen Yang, Yan Zhang, Tianshu Wang, Zhongyuan Mao, Tianyin Li, Zhuoyuan Sun, and Xiaobo Shen. Graph-driven domain co-adaptation for cross-domain image quality assessment. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 40, pages 13970–13978, 2026.
- [27]Mingji Yang, Hanzhi Wang, Zhewei Wei, Sibo Wang, and Ji-Rong Wen. Efficient algorithms for personalized pagerank computation: A survey. IEEE Transactions on Knowledge and Data Engineering, 36(9):4582–4602, 2024.DOI
- [28]Aristidis G Vrahatis, Konstantinos Lazaros, and Sotiris Kotsiantis. Graph attention networks: a comprehensive review of methods and applications. Future Internet, 16(9):318, 2024.DOI
- [29]Xiaoxiao Ma, Ruikun Li, Fanzhen Liu, Kaize Ding, Jian Yang, and Jia Wu. Graph anomaly detection with few labels: A data-centric approach. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 2153–2164, 2024.DOI
- [30]Xuchen Guo. Sample-based error rate assessment through predictive confidence in biomedical applications. PhD thesis, St. Francis Xavier University, 2026.
- [31]Theodoros Alexakis, Evgenia Adamopoulou, Nikolaos Peppes, Emmanouil Daskalakis, and Georgios Ntouskas. Evaluating data quality: Comparative insights on standards, methodologies, and modern software tools. Electronics, 14(15):3038, 2025.DOI
- [32]WEI Xiao, WANG Xiaoxin, CHEN Yongqi, and ZHANG Huiran. Constructing a material-domain knowledge graph based on natural language processing. Journal of Shanghai University, 28(3):386, 2022.
- [33]Chunyu Wei, Wenji Hu, Xingjia Hao, Yunhai Wang, Yueguo Chen, Bing Bai, and Fei Wang. Graph evidential learning for anomaly detection. In Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V. 2, pages 3122–3133, 2025.DOI
- [34]Jiaxing Zhang, Xiaoou Liu, Dongsheng Luo, and Hua Wei. Is your explanation reliable: Confidence-aware explanation on graph neural networks. In Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V. 2, pages 3740–3751, 2025.DOI
- [35]Meihao Liao, Rong-Hua Li, Qiangqiang Dai, Hongyang Chen, Hongchao Qin, and Guowen Wang. Efficient personalized pagerank computation: The power of variance-reduced monte carlo approaches. Proceedings of the ACM on Management of Data, 1(2):1–26, 2023.DOI
- [36]Lin Kaibiao, Jinpo Chen, Chen Ruicong, Yang Fan, Zhang Yang, Lin Min, and Lu Ping. Adaptive neighbor graph aggregated graph attention network for heterogeneous graph embedding. ACM Transactions on Knowledge Discovery from Data, 18(1):1–21, 2023.DOI
- [37]Xuan-Thuy Vo and Kang-Hyun Jo. A review on anchor assignment and sampling heuristics in deep learning-based object detection. Neurocomputing, 506:96–116, 2022. ISSN 0925-2312.DOI
- [38]Che-Ping Tsai, Ganyu Teng, Phillip Wallis, and Wei Ding. Anollm: Large language models for tabular anomaly detection. In The Thirteenth International Conference on Learning Representations, 2025.DOI
- [39]Mohan Raparthi, Dharmesh Dhabliya, Tanu Kumari, Rajkamal Upadhyaya, and Aditi Sharma. Implementation and performance comparison of gradient boosting algorithms for tabular data. Deep Learning and Visual Artificial Intelligence: Proceedings of ICDLAI 2024, page 461, 2024.DOI
- [40]Dávid Péter Kovács, Ilyes Batatia, Eszter Sára Arany, and Gábor Csányi. Evaluation of the mace force field architecture: From medicinal chemistry to materials science. The Journal of Chemical Physics, 159(4), 2023.DOI
- [41]Kang Xu, Zhengming Sun, Jian Tu, Wenwang Wu, and Huihui Yang. Intelligent design of fe–cr–ni–al/ti multi-principal element alloys based on machine learning. Journal of Materials Research and Technology, 35:6864–6873, 2025.DOI
- [42]Bowen Wang, Bingheng Lu, Lijuan Zhang, Jianxun Zhang, Bobo Li, Qianyu Ji, Peng Luo, and Qian Liu. Rapid in situ alloying of cocrfemnni high-entropy alloy from elemental feedstock toward high-throughput synthesis via laser powder bed fusion. Frontiers of Mechanical Engineering, 18(1):11, 2023.DOI
- [43]Xinsheng Chen, Yuzheng Liang, Qipeng Wang, Kewei Dong, Yang Yang, Shuai Feng, Xueqi Zhang, Yingchao Cai, Yong Peng, Kehong Wang, et al. Introduction of nanoprecipitation into supersaturated cocrfemnin0. 5 alloy prepared by laser-powder bed fusion via microstructure tailoring to achieve excellent properties. Scripta Materialia, 235:115636, 2023.DOI
- [44]Paidipati Dinesh, AS Vickram, and P Kalyanasundaram. Medical image prediction for diagnosis of breast cancer disease comparing the machine learning algorithms: Svm, knn, logistic regression, random forest and decision tree to measure accuracy. In AIP Conference Proceedings, volume 2853, page 020140. AIP Publishing LLC, 2024.
- [45]HF Li, JL Wei, SP Yang, and YQ Liu. The relationship between fracture toughness and tensile property in high-strength steels. Engineering Failure Analysis, 131:105854, 2022.DOI
- [46]Yang Yuan, Sihan Liang, Ji Zhang, Yangang Wang, and Zongguo Wang. A deep learning framework for scientific chart data extraction and reconstruction. Communications Engineering, 5(1):147, 2026.DOI
