betaFeedback

WorksPhysics and Astronomy

Analogical discovery of disordered perovskite oxides by crystal structure information hidden in unsupervised material fingerprints

Abstract

Compositional disorder induces myriad captivating phenomena in perovskites. Target-driven discovery of perovskite solid solutions has been a great challenge due to the analytical complexity introduced by disorder. Here, we demonstrate that an unsupervised deep learning strategy can find fingerprints of disordered materials that embed perovskite formability and underlying crystal structure information by learning only from the chemical composition, manifested in (A1-xA'x)BO3 and A(B1-xB'x)O3 formulae. This phenomenon can be capitalized to predict the crystal symmetry of experimental compositions, outperforming several supervised machine learning (ML) algorithms. The educated nature of material fingerprints has led to the conception of analogical materials discovery that facilitates inverse exploration of promising perovskites based on similarity investigation with known materials. The search space of unstudied perovskites is screened from ~600,000 feasible compounds using experimental data powered ML models and automated web mining tools at a 94% success rate. This concept further provides insights on possible phase transitions and computational modelling of complex compositions. The proposed quantitative analysis of materials analogies is expected to bridge the gap between the existing materials literature and the undiscovered terrain.

Introduction

Perovskite oxides, identified in ABO3\mathrm{ABO}_{3} general form, are utilized in broad spectrum of technological applications. The crystal structure of these materials is conveniently interpreted by an array of corner sharing BO6\mathrm{BO}_{6} octahedra and A-cations sitting at interstitial cages[1] (Figure 1b). However, in real solids, the perfect periodicity of the lattice is disrupted by several factors. As opposed to the longstanding notion of ordered crystals usually perform better than their disordered counterparts, it is now understood that chemically ‘messy’ or alloyed perovskite oxides indeed perform exceptionally better in numerous applications. These include ferroelectric photovoltaics[2], electrocatalysts and photocatalysts[3], tunable microwave ferroelectrics with shiftable Curie point[4], solid oxide fuel cells[5, 6] and resistive switching memories that are promising to be tailored as memristors and neuromorphic circuit components[7, 8]. Thus, perovskite oxides emanate as an imperative class of materials in their own right and carefully engineered disorder can potentially burnish their properties beyond theoretical limits.

Workflow demonstrating the analogical discovery of perovskites

Figure 1. Workflow demonstrating the analogical discovery of perovskites. a Elements that can fully or partially occupy octahedral and interstitial sites. b Average unit cells of (A1−xAx′)BO3(\mathrm{A}_{1-x}\mathrm{A}'_{x})\mathrm{BO}_{3} and A(B1−xBx′)O3\mathrm{A}(\mathrm{B}_{1-x}\mathrm{B}'_{x})\mathrm{O}_{3} materials, usually realized by X-ray diffraction (XRD) analysis. During total possible chemical formulation, Pauling’s valency rule is imposed by restricting the mean oxidation state of the A-site (n‾A\overline{n}_{\mathrm{A}}) to be less than or equal to that of B-site (n‾B\overline{n}_{\mathrm{B}}); (n‾A≤n‾B\overline{n}_{\mathrm{A}} \le\overline{n}_{\mathrm{B}}). We further set the condition, mean ionic radius of A-site (R‾A\overline{R}_{\mathrm{A}}) should be greater than or equal to that of B-site (R‾B\overline{R}_{\mathrm{B}}); (R‾A≥R‾B\overline{R}_{\mathrm{A}} \ge\overline{R}_{\mathrm{B}}), because otherwise the composition relates to interchanged A–B cations. A gradient boosting classifier is iteratively trained on sampled experimental data (c), extracted from the ICSD. Total possible compounds pool is classified on a probability threshold (L), in order to improve precision. The originality of positively classified candidates is confirmed by high-throughput web scraping. d VAE model is trained on 2104 unlabelled experimental data samples. The euclidean distances between each experimental composition and candidate perovskites are calculated in fingerprint space. Nearest candidates are reported as analogous to the original composition. DFT structure optimization reveals that the analogous candidates preserve the native crystal structure.

Goldschmidt tolerance factor (tt) and octahedral factor (μ\mu) are simple yet powerful descriptors proposed nearly a century ago to predict the formability of perovskite structure[9]. Recent studies revisited these factors and even developed more accurate descriptors to predict promising ordered perovskites[10, 11, 12]. Computational methods of assessing the stability of perovskites include evolutionary algorithms[13], molecular dynamics[12], semi-empirical modelling[14, 15] and density functional theory (DFT) calculations of formation enthalpy and energy above convex hull[16]. Nevertheless, adopting high-throughput ab initio methods[17] to model disordered solid solutions with mixed site-occupations is limited due to extreme computational power demanded by large supercells and, several random structure generations and optimizations. Alternatively, machine learning

(ML) approaches underpinned by experimental data have been applied to rapidly predict complex functional materials, eventually synthesized to exhibit excellent properties[18, 19, 20, 21, 22, 23]. Meanwhile, the complexities brought by compositional disorder such as random atom occupancy of the disordered site, non-stoichiometry and the presence of fractional occupations in the average unit cell have hindered the exploration of the complete composition space for target-driven perovskites discovery. Current supervised ML studies are limited to a minute fraction of disordered perovskites[19, 20, 24], calling for a general strategy to inversely search the undiscovered territory. Fortunately, unsupervised learning techniques can extract hidden knowledge from raw input features and embed those information in a compressed numerical latent vector[25]. This opens up the avenue of ‘analogical materials discovery’ where unstudied materials analogous to an existing material are identified by quantitatively comparing their respective latent representations.

In this study, we focus on A-site or B-site alloyed quaternary perovskites, typically formulated as (A1−xAx′)BO3(\mathrm{A}_{1-x}\mathrm{A}^{\prime}_{x})\mathrm{BO}_{3} and A(B1−xBx′)O3\mathrm{A}(\mathrm{B}_{1-x}\mathrm{B}^{\prime}_{x})\mathrm{O}_{3}, respectively. The rules governing A (larger) and B (smaller) cationic radii are well established, yet lenient enough as we identified 49 and 62 periodic table elements that can entirely or partially occupy A-site and B-site, respectively, by incorporating both experimental and theoretical studies[11, 12] (Figure 1a). Such elemental combinations propagate into a staggering and virtually endless diversity of disordered perovskites. Efficient screening of this massive compound pool, first to discover potential perovskites and second, elect promising candidates analogous to a target material/structure (i.e., inverse design) is paramount to supplement the increasing demand for high-performing, inexpensive and eco-friendly materials. By envisaging this objective, we first compiled an all possible candidates pool by capturing the combinations of A and B cations and incrementing xx from 0.05 to 0.95 in 0.05 intervals, subject to basic chemistry rules such as charge neutrality and Pauling’s valency rule[10, 26]. This resulted in a grand total of 591,129 distinct compositions. We then collected an experimental database of (A1−xAx′)BO3(\mathrm{A}_{1-x}\mathrm{A}'_{x})\mathrm{BO}_{3} and A(B1−xBx′)O3\mathrm{A}(\mathrm{B}_{1-x}\mathrm{B}'_{x})\mathrm{O}_{3} compositions by exhaustively querying the Inorganic Crystal Structure Database (ICSD)[27]. After discarding the duplicates, we obtained 1758 distinct perovskites and 227 non-perovskites along with their crystal structure information, indicating less than only 0.4% of composition space has been experimentally synthesized before (see Figure 1c and Supplementary Note 1). This database also comprised double perovskites in the format of A2BB′O6\mathrm{A}_{2}\mathrm{BB}'\mathrm{O}_{6} and AA′B2O6\mathrm{AA}'\mathrm{B}_{2}\mathrm{O}_{6}, because the composition is the same to the disordered equivalents A(B0.5B0.5′)O3\mathrm{A}(\mathrm{B}_{0.5}\mathrm{B}'_{0.5})\mathrm{O}_{3} and (A0.5A0.5′)BO3(\mathrm{A}_{0.5}\mathrm{A}'_{0.5})\mathrm{BO}_{3}, respectively.

An appropriate feature space is developed starting from the chemical formula to represent each material in the experimental database and candidate pool. While characterization equipment such as X-ray photoemission spectroscopy is required to investigate the oxidation state of constituent elements[28], here we implement a heuristic algorithm to unroll fractional oxidation states, closely reflecting the actual cation valences. We further add ten best perovskite descriptors procured from the sure independence screening and sparsifying operator (SISSO) algorithm[11, 29] to the feature space, consolidating hand-crafted and data-driven descriptors. A sequential screening strategy that involves ML classification, chemistry informed filtering and automated web scraping is employed to downselect promising unknown perovskites with 93.9% fidelity. We construct a variational autoencoder (VAE) model[30] and train it on a sufficiently large, unlabelled experimental database, sanguinely retrieving a low-dimensional representation of compositions, designated as the material fingerprint (Figure 1d). Notably, VAEs have been purposed as molecule generative models[31] and feature extractors where the latent vector is sent through another ML model to predict element combinations that will likely form a specific topology, requiring crystallographic data as the input[32]. VAE-obtained latent vector has also been used to predict optical properties of materials[33]. Here, we demonstrate the exclusive potential of material fingerprints learned only from the chemical composition to carry crystal structure and perovskite formability information as numerical vectors, stressing their applicability in analogical materials discovery. Material attributes such as bandgap and phase transition details can be recovered by proximity analysis of fingerprint topology assembled by the VAE. Through a series of statistical testing on crystal symmetry prediction, we illustrate that structurally and physicochemically similar materials likely possess similar fingerprint representations. This phenomenon is employed to discover lead-free analogues of several lead-based ceramics. We further exemplify the versatility of material fingerprints in initializing the DFT simulation of disordered solid solutions by modelling six promising lead-free perovskites (see Figure 1).

Results

Feature engineering

The roadmap to analogical materials discovery begins by establishing a solid and adequate collection of candidate compounds for the parent experimental material or class of materials. We use pymatgen[34], an open-source python library for analyzing the materials in our database. Pymatgen is equipped to guess the most probable oxidation states of elements in a composition based on ICSD statistics. In the case of mixed valence constituent element, this may lead to a fractional oxidation state that must be unfolded to estimate the effective ionic radius of that element and the associated crystallographic site in the average unit cell. Considering the smallest possible supercell that relates to the integer formula, our algorithm first tries to solve for the valence states of individual ions by exploiting the common oxidation states of the mixed-valence element in question. If no solution is found, it looks through other less common oxidations states. Whenever the algorithm finds more than one configuration of valence states can result in the same fractional oxidation state, the one with the smallest oxidation state numbers and the lowest variation in ionic radii is selected (see Supplementary Note 2). We expect the perovskite structure is more likely to be retained under these conditions because, if there is large difference in size between the constituent cations, the octahedral units share faces, distorting the perovskite lattice more[6]. However, it should be noted that mixed valence states are highly dependent on the element, composition, vacancies etc., requiring experimental characterization for precise investigation. Our algorithm provides a systematic estimation of the mean ionic radius of such elements, permitting us to calculate tt, μ\mu and develop the feature space. Subsequently, tt and μ\mu of (A1−xAx′)BO3(\mathrm{A}_{1-x}\mathrm{A}^{\prime}_{x})\mathrm{BO}_{3} type compositions are computed as[1],

t=[(1−x)RA+xRA′+RO]2(RB+RO)(1)t = \frac{[(1-x)R_{\mathrm{A}}+xR_{\mathrm{A}^{\prime}}+R_{\mathrm{O}}]}{\sqrt{2}(R_{\mathrm{B}}+R_{\mathrm{O}})} \tag*{(1)}
μ=RB/RO(2)\mu= R_{\mathrm{B}}/R_{\mathrm{O}} \tag*{(2)}

Similarly, for A(B1−xBx′)O3\mathrm{A}(\mathrm{B}_{1-x}\mathrm{B}^{\prime}_{x})\mathrm{O}_{3} type compositions;

t=(RA+RO)2[(1−x)RB+xRB′+RO](3)t = \frac{(R_{\mathrm{A}}+R_{\mathrm{O}})}{\sqrt{2}[(1-x)R_{\mathrm{B}}+xR_{\mathrm{B}^{\prime}}+R_{\mathrm{O}}]} \tag*{(3)}
μ=[(1−x)RB+xRB′]/RO(4)\mu= [(1-x)R_{\mathrm{B}}+xR_{\mathrm{B}^{\prime}}]/R_{\mathrm{O}} \tag*{(4)}

where RAR_{\mathrm{A}}, RA′R_{\mathrm{A}^{\prime}}, RBR_{\mathrm{B}}, RB′R_{\mathrm{B}^{\prime}} and ROR_{\mathrm{O}} are Shannon’s ionic radii[35] of A, A′, B, B′ cations and oxygen anion, respectively. Mean ionic radius is used for mixed valence elements. The feature space is composed of 55 elemental and 11 compositional features, 10 SISSO descriptors and 5 feature combinations including tt and μ\mu (provided in Supplementary Table 1). SISSO is an efficient, data-driven screening approach that finds near-optimal material descriptors relating to a property of interest from a colossal number of potential descriptors obtained by applying a set of mathematical operations to one or many primary features[29]. In our specific case, we have 71 primary features, yielding a total of ∼1071\sim10^{71} SISSO descriptors. By training the SISSO algorithm on around 500 randomly sampled compositions from our database and considering a subspace size of 1000, we extracted 10 best descriptors reflecting perovskite formability (Supplementary Note 3). The features related to oxygen are common to all compositions (i.e., no relative importance) and have thus been omitted when mapping the feature space into perovskite or non-perovskite using ML.

Quaternary compositions classification

We examined the performance of four ML algorithms in the present classification task to select the best model to proceed. These include decision tree (DT), random forest (RF), support vector machine (SVM) and gradient boosting classifier (GBC). In order to assess the performance metrics, we iteratively trained and evaluated the individual models on sub-databases generated by integrating 227 non-perovskites with 250 randomly sampled perovskites from 1758 total perovskites. Such a strategy is required to maintain the class-balance of individual training sets, minimizing the potential overfitting to a particular class. It also ensures that all available perovskites are exploited without being dissipated. All four algorithms are trained and validated for 100 independent iterations by splitting each sub-database into 80% training and 20% test sets[19]. Table 1 summarizes tenfold cross validation (CV) results. GBC is selected to proceed as it provided the best performance with 93.91% (±0.96%) and 93.33% (±2.26%) tenfold CV and test mean classification accuracies, respectively. More details about these metrics including hyperparameter tuning are available in Methods, and Supplementary Fig. 1 and Supplementary Note 4. Figure 2b,c depict confusion matrix and receiver operating characteristic (ROC) curves, respectively, as obtained by tenfold CV. Moreover, five SISSO descriptors make it to the top ten features ranked by their relative importance (Fig. 2a). However, we note that the GBC model achieves 93.71% and 93.16% tenfold CV and test mean accuracies, respectively, even in the absence of SISSO descriptors in the feature space, endorsing the fact that perovskite formability is heavily dependent on geometrical features such as cationic radii.

We then classify the total possible compounds pool (0.6 Million candidates) by following the same procedure of 100 iterations, except that, this time, each GBC model is trained on the full corresponding sub-database without train/test splitting. Figure 2d highlights the geometric region that most probably results in a stable perovskite structure. Moreover, B-site doping is a prevalent technique used to enhance and tune the properties of many perovskites. Figure 3 shows the classification map of such systems for commonly observed A and B cations. Nonetheless, our objective here is to screen down a huge composition space to a sufficient collection of potential perovskites, such that the materials will have a greater chance of potentially being synthesized in single phase perovskite structure. Therefore, we extract the compositions that have over 95% mean perovskite likelihood and, that were classified 100 out of 100 times into the perovskite category, as the most promising perovskites[19]. This increases the precision (how many selected items are relevant) of the predicted set at the cost of some possible perovskites not being selected. This tactic is also expected to address the ongoing criticism that ML models tend to predict a high rate of materials to be stable, which are actually not[36]. Likewise, 46,228 highly-probable candidate perovskites are screened, narrowing the composition space by 92%. We further downselect the compositions made up of elements in their common oxidation states. This was followed by removing all the compositions whose quaternary system is available in the ICSD relating to our format as already studied materials. For example, when we find Pb(Zr0.5Ti0.5)O3(\mathrm{Zr}_{0.5}\mathrm{Ti}_{0.5})\mathrm{O}_{3} is present in the ICSD, we remove all Pb(Zr1−xTix)O3(\mathrm{Zr}_{1-x}\mathrm{Ti}_{x})\mathrm{O}_{3} compositions

GBCRFDTSVM
Accuracy0.939 (±0.009)0.907 (±0.007)0.917 (±0.013)0.924 (±0.007)
Precision0.947 (±0.019)0.902 (±0.092)0.943 (±0.003)0.917 (±0.035)
Recall0.946 (±0.021)0.881 (±0.114)0.943 (±0.003)0.914 (±0.042)
F1-score0.946 (±0.001)0.879 (±0.013)0.943 (±0.001)0.913 (±0.003)

Table 1. Performance metrics obtained by tenfold CV for perovskites classification.

that belong to the quaternary system Pb-Zr-Ti-O. Furthermore, an automated web scraping tool is implemented to search for any mentioning of the resulting materials/systems on the internet, which were removed in turn. The competency of this tool is tested by scraping 576 ABX3_3-type experimental materials reported in ref. 11. It found the existence of 562 compounds on the web indicating over 97% success rate. This multi-step, novelty-ensuring screening flow further decreased the perovskite candidate headcount to 10,790, which will serve as the search space for analogical discovery of perovskites.

Unsupervised material fingerprinting

Learning numerical vector representations of materials, that is fingerprinting them, based only on the features extracted from their chemical formulae facilitates the similarity investigation of two or more materials by geometrical distance arithmetics between those vectors. By design, the compositions that are chemically and structurally alike should fall close to each other and disparate compositions should be further apart in the fingerprint space. An autoencoder neural network, composed of an encoder that efficiently compresses discrete material features into a latent vector and a decoder that learns to reconstruct the same features starting from those encodings, is an unsupervised technique of retrieving the material fingerprint, which refers to the encoding itself. However, a fundamental problem of such a strategy is the possibility of forming blind spots in the latent space, which, when decoded, may have no relevance to a real material.

strategy is the possibility of forming blind spots in the latent space, which, when decoded, may have no relevance to a real material. Variational autoencoders (VAEs), in contrast to vanilla autoencoders, resolve this issue by enforcing the encoder to produce two vectors relating to a set of means μ\mu and standard deviations σ\sigma that closely resemble a standard Gaussian distribution (Z∼N(0,1)Z \sim N(0, 1)), which is then sampled to obtain the latent vector, causing the latent space to be continuous (Figure 4a). Intuitively, this means that the latent encoding of a material is not unique, but stochastically distributed (Z∼N(μ,σ2)Z \sim N(\mu, \sigma^{2})) around the centre determined by the mean vector, enabling the decoder to ‘see’ the whole latent space during training and driving the encoder to generate interpretable representations. While the robustness of VAEs lies in the stochastic nature of the latent embedding, this vector is not adoptable as the material fingerprint due to its non-uniqueness. Therefore, we designate the mean vector (μ\mu) produced by the encoder as the material fingerprint. In our VAE architecture, μ\mu, σ\sigma and latent vector all are two-dimensional (2D), yielding 2D numerical fingerprints (see Methods for more details on VAE implementation). We further discuss other dimensionality reduction algorithms in Supplementary Note 5, namely, vanilla autoencoder (Supplementary Fig. 3, principle component analysis (Supplementary Fig. 4) and t-SNE (Supplementary Fig. 5).

Unsupervised material fingerprinting using VAE

Figure 4. Unsupervised material fingerprinting using VAE. a VAE architecture. Encoder must find an efficient compression, discarding bulk of irrelevant information from the input to support the decoder to reconstruct the input itself from a highly compressed dimension. Because latent vector is sampled from a probability distribution, during the training process, the decoder learns not only a single point in latent space is relevant to a particular material, but also the nearby points. This removes blind spots to the decoder and enables placing unseen compositions on the fingerprint map. b Crystal system vs 2D fingerprint visualization of the experimental materials. XY plane relates to the fingerprint space. 14 non-perovskite labelled materials out of 20 landing inside the circled area were identified as ‘perovskite’ or ‘hexagonal perovskite’ in separate literature, which may not have been examined during data labelling. The crystal system of the predicted candidate is predicted to be orthorhombic based on the plurality vote of 5-NNs. c and d display the normalized confusion matrices detailing the crystal system prediction of 2104 experimental materials as obtained by proximity analysis of fingerprints and supervised gradient boosting classifier, respectively.

Owing to the fact that training VAEs is unsupervised, that is no labelling of compositions is required, we used all available (A1−x_{1-x}A′x_x)BO3_3 and A(B1−x_{1-x}B′x_x)O3_3 compositions totalling 2104 to train and validate the model. Over 90% of experimental data relate to ambient conditions, so do our predictions. The database included 119 materials that were difficult to be reliably deposited into either of perovskite or non-perovskite categories. Clearly, there is no hard boundary between these two classes, separating them perfectly. Ultimately, it comes down to which degree of distortion from the ideal cubic perovskite lattice can be tolerated to still regard the resulting structure as perovskite? We let the VAE model to place the materials in the region that they ‘deserve’. The input to the VAE contains the same features as used in the previous classification step. Despite not being explicitly trained as perovskite or non-perovskite, the material fingerprints capture this information and form separate regions in the fingerprint space as can be observed from Figure 4b. In addition, the alloyed site is clearly recognizable from the 2D fingerprint. Notably, some of the non-perovskite-labelled materials fall within the perovskite region as circled in Figure 4b. Instead of disregarding them as ambiguous, we scrutinized the root cause for this and found that at least 14 out of 20 materials falling inside the circle were described with the terms ‘perovskite’ or ‘hexagonal perovskite’ in other areas of the literature (see Supplementary Table 2). Apparently, these compounds are more ‘perovskite’ than ‘non-perovskite’. This is a prime

Figure 3. Perovskite likelihood of selected A(B₁−xB′x)O₃ systems as predicted by the GBC model. Each panel depicts the classification probability variation as the content xx of the cation B′ at cation B sites increases, for some commonly observed A and B element combinations. Empty spaces imply no charge balanced probable compositions exist. Caesium cation is too large to occupy A-site and the formation of a stable perovskite is generally improbable. ICSD reports one quaternary perovskite oxide, K(Ta₀.₇₇Nb₀.₂₃)O₃, with potassium occupying A-site, as opposed to four stable ternary perovskites, KNbO₃, KTaO₃, KЮ₃ and KIO₃. Despite having no training data with A-site K and B-site U occupied perovskites, the model predicts that U can be alloyed with Nb, Ta or even Ti and Zr to forge a perovskite. This claim is somewhat supported by above ternary oxides. Supplementary Figure 2 shows the composition map where A-site is partially occupied by K. Strontium, an ideally sized cation sitting at A-site can form plenty of stable perovskites, supporting diverse B-site substitutions for tailoring the properties of materials. Alkaline earth metals in A-site generally show high perovskite likelihood. Likewise, these elements can replace toxic lead in many useful perovskites.

GBC classification metrics and prediction results

Figure 2. GBC classification metrics and prediction results. a Relative importance of top 20 features. Notably, tolerance factor (tt) has dropped to the 10th place, which may indicate that tt alone is not sufficient to predict the perovskite formability of complex solid solutions at a good accuracy. b Normalized confusion matrix obtained by tenfold CV. c ROC curves obtained for each fold in tenfold CV and the mean ROC curve. Area under the curve (AUC) summarizes the performance of each GBC into a single measure where high AUC indicates the model has a greater capability of distinguishing between classes. This demonstrates that our model performs consistently even with different random data divisions. Shaded region shows the standard deviation of mean ROC curve. d Classification probability map for 0.6 Million compounds pool, plotted as μ\mu vs tt.

example to elucidate that the materials are fingerprinted on their own merits. It also draws the attention to what appears to be outlier data for cross checking the correctness of data labelling. Now, the cardinal question is, are these fingerprint vectors really learned such that they embed the underlying chemical and structural properties of materials? To answer this question, we investigated small local clusters in the fingerprint space. The key idea is that the unsupervised model finds similar fingerprint representations for analogous compositions, which can be corroborated with a k-nearest neighbours approach. Anticipating that similar materials should find themselves close to each other, we compared the crystal system (cubic, orthorhombic, tetragonal, etc.) of each material with that of the five nearest neighbours (NNs) in the 2D fingerprint space. This can be viewed as a leave one out cross validation (LOOCV) technique, because, despite never being trained to predict the crystal system, all the other materials except the one being tested are present on the fingerprint space. In order to quantify materials analogies in native domain, we define euclidean distance derived similarity measure (SES_E) as, SE(p,q)=1/(1+dE(p,q))S_E(p, q) = 1/(1 + d_E(p, q)) where pp and qq are two composition points and dE(p,q)d_E(p, q) is the euclidean distance between pp and qq. If majority of neighbours vote for (belong to) the same crystal system, that will be assigned as the predicted crystal system of the original composition. In the case of equal number of votes, the one relating to the lowest euclidean distance is selected. By performing this analysis for all 2104 materials, we found that the 5-NNs can determine the correct experimental crystal system of the parent composition with a success rate of 71.8%. This implies that the unsupervised material fingerprints indeed carry crystal structure information concealed in its relative locality. Note that the optimal number of neighbours is found to be 5 by heuristic tuning. Figure 4c illustrates crystal system prediction performance as a normalized confusion matrix. Moreover, this strategy is extensible to predicting the space group of compositions, which resulted in 59.9% prediction accuracy (see Supplementary Fig. 6 for confusion matrix). Given that the total number of distinct space groups present in our database is 66 and the model is not explicitly trained to predict them, nearly 60% accuracy figure reflects that even such diminutive information is inherent in the material fingerprint. Although the data circumstances are different, material fingerprint based prediction of crystal system proposed here offers around 6% accuracy improvement over existing multi-class supervised approaches that rely on multitude of magpie features obtained only from the composition[24, 37].

Furthermore, space group detection of experimental compounds, even by training a supervised convolutional neural network (CNN) on about 150,000 powder XRD patterns is proved to be challenging, with a reported accuracy of 81%[38]. With no supplemental knowledge on crystallographic or XRD data of complex solid solutions, our model performs appreciably close to the state-of-the-art CNNs on this aspect, albeit the differences between sample sizes and data contexts should be accounted.

To assess how well this fingerprint proximity oriented approach contrasts with supervised parametric models, we evaluated the crystal symmetry detection performance of GBC, DT, RF and SVM classifiers using LOOCV for unbiased comparison. The feature space is chosen to be the same as used in perovskites classification step. The performance metrics are summarized in Table 2. GBC achieves the highest crystal system classification accuracy of 78.8% (see Figure 4d) while the proposed scheme, relying only on the 2D fingerprints, outperforms supervised algorithms such as SVM and RF. The trend is similar for space group classification. Most importantly, unsupervised deep learning techniques are quite rigorous when finding their own representations, and advantageous in inversely exploring the compositional space, which is not feasible in supervised ML regime. For instance, when the database is of sufficient size and diversity, the representations learned by VAE form an information-embedded topology that can be used not only to predict the crystal structure of unknown compositions but also to discover compositions analogous to target experimental materials, a point that we come back later in this paper.

MetricCrystal systemSpace group
FAGBCRFDTSVMFAGBCRFDTSVM
Accuracy0.7180.7880.6190.7390.6880.5990.6780.420.6550.566
Precision0.7160.7850.620.7380.6850.580.6720.3440.6510.529
Recall0.7180.7880.6190.7390.6880.5990.6780.4190.6550.566
F1-score0.7160.7860.5780.7380.6710.5870.6740.3270.6520.532

Table 2. FA fingerprint analysis based on 5-NNs, GBC gradient boosting classifier, RF random forest, DT decision tree, SVM support vector machine.

Phase identification and bandgap prediction

Some perovskites such as ferroelectrics display temperature-dependent phase transitions. There can also be coexisting phases at the same temperature[39]. We emphasize that chemical composition is not duplicated in our database, leading to an elimination of additional phases, if there are any. Taking a step back, we examined whether the NNs can reflect phase information of a material that has multiple crystallization phases. We found that if the NNs imply strong relation to two or more different symmetries by means of low euclidean distance (i.e., SE>∼95%S_E > \sim95\%), it may indicate a potential phase transition in the material of interest. For example, consider ferroelectric (Sr0.6Pb0.4)TiO3(\mathrm{Sr}_{0.6}\mathrm{Pb}_{0.4})\mathrm{TiO}_3 which is not recorded in the ICSD (neither ICSD nor our database contains any record of Sr–Pb–Ti–O system). Four experimental NNs of this composition vote for the cubic system and the remaining NN shows an SES_E of 95.7% to the original ferroelectric and votes for the tetragonal system. There is indeed a cubic to tetragonal phase transition at 66 °C in this material[40]. 219 compositions in our experimental database can crystallize in multiple phases (upto 4 crystal systems). In 97 cases, all the crystal systems shown by each material are present in the set of crystal systems of corresponding 5-NNs. We stress that the same experimental fingerprints obtained above are used throughout with no further training. Notably, 33 compositions show 3 or more phases. The stated approach can predict 2 or more phases in 27 out of 33 compositions as depicted in Figure 5a.

Predicting the properties of materials via fingerprint analogies

Figure 5. Predicting the properties of materials via fingerprint analogies. a Phase prediction of experimental compositions that can crystallize in three or more phases. We focus only on the crystal system (i.e., the phase transitions occurring within a single crystal system are ignored). The phase is considered to be predicted if at least one of the 5-NNs belong to the crystal system of original composition. b Bandgap prediction results for a DFT database of quaternary perovskites[5]. It should be noted that generalized gradient approximation is used for the calculations in ref. [5] that tends to underestimate the bandgap.

We search for the compositions with no known phase transformations by probing those which are reported to have only one phase (one crystal system) for all alloying ratios within the system. We found that 1283 compositions have no potential phase transformations. Out of these, 573 were predicted to have only one phase as expected. Two phases were predicted for 475 compositions. We conjecture that a considerable number of materials have not been fully characterized and even some of the known phases are not yet recorded in the ICSD. For example, ferroelectric (Ag0.9Li0.1)NbO3(\mathrm{Ag}_{0.9}\mathrm{Li}_{0.1})\mathrm{NbO}_3 favors a trigonal phase at room temperature and displays temperature-induced sequence trigonal →\to orthorhombic →\to tetragonal →\to cubic[41]. However, the ICSD reports only the trigonal phase of this material (as of March 2021). Therefore, it was wrongly labelled to have no phase transformations. We notice that 4-NNs of (Ag0.9Li0.1)NbO3(\mathrm{Ag}_{0.9}\mathrm{Li}_{0.1})\mathrm{NbO}_3 vote for the trigonal system and one votes for the cubic system. This is sensible given the above phases of this material. While capturing the Curie point is too much to ask from this unsupervised approach, it does convey some useful insights on possible phase transitions. We further tested whether the bandgaps of the compositions located in close proximity are similar by predicting the DFT computed bandgaps of 1016 quaternary perovskites reported in ref. [5]. These compositions are fingerprinted and the bandgap is predicted by averaging this figure of 5-DFT-NNs of the considered composition (see Figure 5b). The mean absolute error of the predictions is 0.385 eV, consistent with existing ML based bandgap prediction studies[12, 42]. We further employed several supervised approaches for predicting the bandgap. Although the error rate above is very similar to LOOCV MAE of support vector regressor (0.369 eV), the lowest MAE is achieved by RF regressor (0.17 ± 0.004 eV). Based on these predictions, it is safe to assume that geographically close materials likely possess similar properties.

Analogical discovery of perovskites

The fingerprints of the 10,790 predicted perovskites were extracted at the μ\mu layer by sending the associated features through the trained VAE network. This brings the candidate compositions and the experimental observations to a common ground, that is the fingerprint space, where unexplored perovskites landing close to a target experimental material are identified as analogous compositions to that material. We first tested the effectiveness of fingerprints for a set of predicted perovskites. During the materials screening stage, our web scraping tool recovered 24 GBC-predicted perovskites from literature that were not available in the ICSD. 17 out of 24 were reported in credible experimental studies that contained crystal structure information. As predicted, all 17 compositions have been experimentally identified as perovskites. By placing them in the fingerprint space and taking the majority vote of 5-experimental-NNs into account, we correctly identified the crystal system of 13 perovskites out of 17 (Table 3). Not only does this underpin the accuracy of our ML prediction, but it also confirms the generalizability of the material fingerprints to unseen data.

CompositionExperimental symmetryPredicted symmetry (by fingerprint analogy)NvotesN_{\mathrm{votes}}SES_{\mathrm{E}} (%)
(Sr0.7Pb0.3)TiO3(\mathrm{Sr}_{0.7}\mathrm{Pb}_{0.3})\mathrm{TiO}_{3}Cubic Pm3ˉmPm\bar{3}m[40, 60]Cubic Pm3ˉmPm\bar{3}m4/595.1
Ca(Zr0.05Ti0.95)O3\mathrm{Ca}(\mathrm{Zr}_{0.05}\mathrm{Ti}_{0.95})\mathrm{O}_{3}Orthorhombic PbnmaPbnma[61]Orthorhombic PbnmPbnm5/591.5
(La0.9Pb0.1)CoO3(\mathrm{La}_{0.9}\mathrm{Pb}_{0.1})\mathrm{CoO}_{3}Trigonal R−3cR\mathord{-}3c[62]Trigonal R−3cR\mathord{-}3c4/578.5
(La0.8Pb0.2)CoO3(\mathrm{La}_{0.8}\mathrm{Pb}_{0.2})\mathrm{CoO}_{3}Trigonal R−3cR\mathord{-}3c[62]Trigonal R−3cR\mathord{-}3c4/581.5
Sr(V0.5Bi0.5)O3\mathrm{Sr}(\mathrm{V}_{0.5}\mathrm{Bi}_{0.5})\mathrm{O}_{3}Monoclinic$[63] | Monoclinic I2/mI2/m | 3/5 | 96.2
(K0.5Nd0.5)TiO3(\mathrm{K}_{0.5}\mathrm{Nd}_{0.5})\mathrm{TiO}_{3}Cubic Pm3ˉmPm\bar{3}m[64]Cubic Pm3ˉmPm\bar{3}m3/592.7
(K0.5Sm0.5)TiO3(\mathrm{K}_{0.5}\mathrm{Sm}_{0.5})\mathrm{TiO}_{3}Cubic Pm3ˉmPm\bar{3}m[64]Cubic Pm3ˉmPm\bar{3}m3/591.2
Sr(Y0.5Nb0.5)O3\mathrm{Sr}(\mathrm{Y}_{0.5}\mathrm{Nb}_{0.5})\mathrm{O}_{3}Monoclinic P21/nP2_{1}/n[65]Monoclinic P21/nP2_{1}/n4/598.1
Sr(Hf0.5Ti0.5)O3\mathrm{Sr}(\mathrm{Hf}_{0.5}\mathrm{Ti}_{0.5})\mathrm{O}_{3}Cubic Pm3ˉmPm\bar{3}m[66]Cubic Pm3ˉmPm\bar{3}m5/587.2
(Sr0.8Ca0.2)ZrO3(\mathrm{Sr}_{0.8}\mathrm{Ca}_{0.2})\mathrm{ZrO}_{3}Orthorhombic PnmaPnma[67]Orthorhombic PbcmPbcm4/594.1
(Sr0.6Ca0.4)ZrO3(\mathrm{Sr}_{0.6}\mathrm{Ca}_{0.4})\mathrm{ZrO}_{3}Orthorhombic PnmaPnma[67]Orthorhombic PbnmPbnm5/595.8
(Ba0.3Sr0.7)ZrO3(\mathrm{Ba}_{0.3}\mathrm{Sr}_{0.7})\mathrm{ZrO}_{3}Cubic$[68] | Cubic Pm3ˉmPm\bar{3}m | 5/5 | 95.5
(Ba0.9Sr0.1)ZrO3:0.025Eu(\mathrm{Ba}_{0.9}\mathrm{Sr}_{0.1})\mathrm{ZrO}_{3}\mathord{:}0.025\mathrm{Eu}Cubic$[69] | Cubic Pm3ˉmPm\bar{3}m | 3/5 | 93.3
(Sr0.6Pb0.4)TiO3(\mathrm{Sr}_{0.6}\mathrm{Pb}_{0.4})\mathrm{TiO}_{3}Tetragonal P4mmP4mm[40]Cubic Pm3ˉmPm\bar{3}m4/595.6
(Sr0.5Pb0.5)TiO3(\mathrm{Sr}_{0.5}\mathrm{Pb}_{0.5})\mathrm{TiO}_{3}Tetragonal P4mmP4mm[40]Cubic Pm3ˉmPm\bar{3}m4/595.7
(La0.95Sb0.05)FeO3(\mathrm{La}_{0.95}\mathrm{Sb}_{0.05})\mathrm{FeO}_{3}Orthorhombic PbnmPbnm[70]Trigonal R−3cR\mathord{-}3c4/591.4
bBa(Hf0.05Ti0.95)O3^{\mathrm{b}}\mathrm{Ba}(\mathrm{Hf}_{0.05}\mathrm{Ti}_{0.95})\mathrm{O}_{3}Tetragonal P4mmP4mm - orthorhombic Amm2Amm2[39]Cubic Pm3ˉmPm\bar{3}m4/588.7
\multicolumn{5}{l}{None of the quaternary systems relating to these compositions are in our database, making them completely unseen to the model. NvotesN_{\mathrm{votes}} is the vote fraction secured by the predicted crystal system. SES_{\mathrm{E}} is the similarity measure obtained based on the mean of euclidean distances to 5-NNs.}
\multicolumn{5}{l}{a^{\mathrm{a}}Prediction refers to (Ba0.9Sr0.1)ZrO3(\mathrm{Ba}_{0.9}\mathrm{Sr}_{0.1})\mathrm{ZrO}_{3} composition without a dopant.}
\multicolumn{5}{l}{b^{\mathrm{b}}Coexistence of P4mmP4mm - Amm2Amm2 phases is reported.}

Table 3. Crystal system prediction of perovskites not present in the ICSD using material fingerprints.

The inauguration of analogical materials discovery is driven by the exigent demand for alternatives to some of the existing industrial materials that may be toxic, expensive, unstable or lossy. For example, discovering lead-free ceramics and solar cell materials is a heavily invested specialism[43]. Identifying lead-free promising perovskites that potentially resemble the crystal structure and physiochemical properties of a Pb-based material is achievable by fingerprinting the Pb-composition and capturing the nearest candidates in the fingerprint space. For instance, our analysis suggests that unstudied Bi(Mg0.65V0.35)O3\mathrm{Bi}(\mathrm{Mg}_{0.65}\mathrm{V}_{0.35})\mathrm{O}_{3} could be a non-toxic substitution for room temperature multiferroic Pb(Fe0.5Nb0.5)O3\mathrm{Pb}(\mathrm{Fe}_{0.5}\mathrm{Nb}_{0.5})\mathrm{O}_{3} (PFN). PFN ceramic undergoes several phase transitions, namely, cubic →\to tetragonal →\to rhombohedral →\to monoclinic with decreasing temperature[44]. Rather unexpectedly, 5-NNs to Bi(Mg0.65V0.35)O3\mathrm{Bi}(\mathrm{Mg}_{0.65}\mathrm{V}_{0.35})\mathrm{O}_{3} evidence the relation to all these phases with tetragonal P4mmP4mm receiving two votes and the rest obtaining one vote each. Moreover, Bi(Sc0.2Co0.8)O3\mathrm{Bi}(\mathrm{Sc}_{0.2}\mathrm{Co}_{0.8})\mathrm{O}_{3} and Bi(Ti0.5Zn0.5)O3\mathrm{Bi}(\mathrm{Ti}_{0.5}\mathrm{Zn}_{0.5})\mathrm{O}_{3} locate near the relaxor ferroelectric Pb(Mg1/3Nb2/3)O3\mathrm{Pb}(\mathrm{Mg}_{1/3}\mathrm{Nb}_{2/3})\mathrm{O}_{3}. Note that double perovskite equivalent of Bi(Ti0.5Zn0.5)O3\mathrm{Bi}(\mathrm{Ti}_{0.5}\mathrm{Zn}_{0.5})\mathrm{O}_{3} has experimentally been identified as an analogue of PbTiO3\mathrm{PbTiO}_{3}. Furthermore, (K0.5Bi0.5)ZrO3(\mathrm{K}_{0.5}\mathrm{Bi}_{0.5})\mathrm{ZrO}_{3} shows similarity to the studied ceramic (Ba0.67Pb0.33)TiO3(\mathrm{Ba}_{0.67}\mathrm{Pb}_{0.33})\mathrm{TiO}_{3}. It is well regarded that bismuth-based ceramics are eco-friendly alternatives to lead-rich piezoelectrics, with the downside of usually requiring high-pressure and high-temperature synthesis conditions. Intriguingly, many compositions with bismuth occupying A-site, when fingerprinted, lie close to those containing lead. This implies that our model can rediscover known phenomena even with no domain-specific knowledge explicitly supplied. Full list of suggested alternatives to current selected perovskites is tabulated in Supplementary Table 3.

DFT validation

One of the major hindrances to modelling unstudied materials with ab initio methods such as DFT is the lack of a priori knowledge about the starting geometry. This is especially challenging for perovskites having previously unknown cation combinations. In the era of experimental records reaching big data status, chances are that structurally similar materials to an unstudied material do exist. Not only does material fingerprinting facilitate analogical materials discovery, but it also is readily applicable to find a reasonable experimental structure required to initialize DFT geometry optimization. As a demonstration, we perform DFT calculations to realize the optimized structures of six selected promising perovskites. Tractable computational methods of modelling random solid solutions in conjunction with the DFT framework include the special quasirandom structures (SQS) approach[46], the virtual crystal approximation[47] and the supercell approach that signifies disorder aspects at local level. While the SQS method has been particularly successful in predicting the properties of random solid solutions[48], we note that the supercell approach is significantly faster than SQS generation and the associated groundwork. Since property prediction is not intended here, we opt for the supercell method and use the recent supercell program especially designed to construct reflective supercells of solids having mixed/partial site occupancies[49]. It potentially includes SQS systems within its exhaustive search space and implements a combinatorial structure ranking method based on their respective electrostatic (Coulomb) energies. Owing to the importance of conformer search, here, we select the supercell configuration with the lowest Coulomb energy to start geometry optimization. Note that, supercell generation itself could be very computationally demanding depending on the number of combinatorial structures, not to mention the subsequent DFT calculation. Figure 6 elaborates the DFT structure optimization steps of the selected promising perovskite (Ce0.5Ag0.5)ZrO3(\mathrm{Ce}_{0.5}\mathrm{Ag}_{0.5})\mathrm{ZrO}_{3}. By analyzing the fingerprints, we found that (La0.8Al0.2)FeO3(\mathrm{La}_{0.8}\mathrm{Al}_{0.2})\mathrm{FeO}_{3} orthorhombic PbnmPbnm, is the most similar experimental material in our database, to the selected candidate. Hence, it is used as the starting geometry. Table 4 details the structure generation and the optimized lattice constants of the six selected promising perovskites. The structures are fully relaxed, allowing to change the ionic positions, cell volume and cell shape. All the optimized structures preserve the perovskite nature as well as the starting structural integrity with minimal change in lattice parameters, seemingly indicating that the initial geometry found by material fingerprint analogy is a plausible basis.

Figure 6. DFT modelling workflow of the composition (Ce0.5Ag0.5)ZrO3(\mathrm{Ce}_{0.5}\mathrm{Ag}_{0.5})\mathrm{ZrO}_{3}. The initial geometry cif (crystallographic information file) is borrowed from an analogous experimental material (La0.8Al0.2)FeO3(\mathrm{La}_{0.8}\mathrm{Al}_{0.2})\mathrm{FeO}_{3} having an orthorhombic PbnmPbnm structure. The atomic species, occupancies and oxidation states were replaced according to the composition. A supercell of size 2×1×12 \times1 \times1 having the lowest Coulomb energy is selected. DFT optimization of ionic positions, cell volume and cell shape results in an orthorhombic Pmn21Pmn2_{1} structure, preserving perovskite nature and staring structural attributes.

Candidate PerovskiteExperimental AnalogyExperimental SymmetrySimilarity Measure (%)Supercell SizeOptimized Symmetryaabbccα\alphaβ\betaγ\gamma
(Ce0.5Ag0.5)2ZrO3(\mathrm{Ce}_{0.5}\mathrm{Ag}_{0.5})_{2}\mathrm{ZrO}_{3}(La0.8Al0.2)2FeO3(\mathrm{La}_{0.8}\mathrm{Al}_{0.2})_{2}\mathrm{FeO}_{3}Orthorhombic PbnmPbnm90.82×1×402 \times1 \times40 atomsOrthorhombic Pmn21Pmn2_{1}11.257 (+0.232)5.901 (+0.374)8.132 (+0.33)909090
Bi2Sr2Co2O8\mathrm{Bi}_{2}\mathrm{Sr}_{2}\mathrm{Co}_{2}\mathrm{O}_{8}Pb(Mg0.3Nb0.6O3)\mathrm{Pb}(\mathrm{Mg}_{0.3}\mathrm{Nb}_{0.6}\mathrm{O}_{3})Cubic Pm3ˉmPm\bar{3}m98.31×5×251 \times5 \times25 atomsTetragonal P4/mmmP4/mmm3.926 (−0.124)3.926 (−0.124)18.825 (−1.425)909090
Bi(Mg0.65V0.35)O3\mathrm{Bi}(\mathrm{Mg}_{0.65}\mathrm{V}_{0.35})\mathrm{O}_{3}Pb(Fe0.5Nb0.5)O3\mathrm{Pb}(\mathrm{Fe}_{0.5}\mathrm{Nb}_{0.5})\mathrm{O}_{3}Tetragonal P4/mmmP4/mmm92.11×3×151 \times3 \times15 atomsTetragonal P4/mmmP4/mmm3.834 (−0.173)3.834 (−0.173)13.385 (−1.345)909090
(K0.5Bi0.5)2ZrO3(\mathrm{K}_{0.5}\mathrm{Bi}_{0.5})_{2}\mathrm{ZrO}_{3}(Ba0.95Pb0.05)TiO3(\mathrm{Ba}_{0.95}\mathrm{Pb}_{0.05})\mathrm{TiO}_{3}Tetragonal P4/mmmP4/mmm92.61×2×101 \times2 \times10 atomsTetragonal P4/mmmP4/mmm4.15 (+0.158)4.15 (+0.158)8.317 (+0.25)909090
(K0.5La0.5)2ZrO3(\mathrm{K}_{0.5}\mathrm{La}_{0.5})_{2}\mathrm{ZrO}_{3}(Sr0.6La0.4)TiO3(\mathrm{Sr}_{0.6}\mathrm{La}_{0.4})\mathrm{TiO}_{3}Cubic Pm3ˉmPm\bar{3}m87.31×2×101 \times2 \times10 atomsTetragonal P4/mmmP4/mmm4.139 (+0.005)4.139 (+0.005)8.375 (+0.01)909090
Ba(U0.5Sn0.5)O3∗\mathrm{Ba}(\mathrm{U}_{0.5}\mathrm{Sn}_{0.5})\mathrm{O}_{3}^{*}Ba2YbReO6\mathrm{Ba}_{2}\mathrm{YbReO}_{6}Cubic Fm3ˉmFm\bar{3}m90.7NA 40 atomsCubic Fm3ˉmFm\bar{3}m8.73 (+0.407)8.73 (+0.407)8.73 (+0.407)909090

Table 4. DFT geometry optimization results of 6 selected promising perovskites.

Discussion

There are several extensions to the present study worthwhile considering. Virtually all materials in our experimental database are published single phase structures. Collecting non-perovskite materials from the literature or databases essentially means that we miss failed syntheses of perovskites or those having major secondary phases, which are, strictly speaking, non-perovskites too. While this data is not usually published, the possible inclusion of such materials as non-perovskites would enhance the reliability of ML predictions. Another possibility would be to use a transfer learning technique by training a neural network classification model subsequently on a large computational database of perovskites/non-perovskites and available experimental data to mitigate data limitation problem[15, 50]. Furthermore, because over 90% of our data has been acquired near room temperature, we did not scrutinize temperature dependence for crystal structure prediction. All our predictions are based only on the composition, assuming ambient conditions. Present study can be extended to include temperature by curating a sufficient database having enough diversity in the temperature field. Due to data limitations, this method is restricted to 66 space groups available in our database. Therefore, the phases outside of these space groups cannot be predicted. This is one of the reasons why we focus on the crystal system, as the data is abundant for all the categories. Moreover, the typical black-box nature of artificial neural networks makes the material fingerprint a black-box too. Investigating the ties of the fingerprint to a physical meaning would make the materials design process more transparent. A relatively large and ideally experimental database of heterogeneous compositions is essential for the proposed framework to succeed. This may be viewed as a constraint to apply our concept in very specific domains where materials data is scarce. We believe the database used in this study is reasonably sized to follow a neural network strategy, and we recommend at least a similar sized database to apply our method in a different context.

In summary, by establishing a comprehensive experimental database of disordered quaternary compositions and involving powerful ensemble ML methods, we have rapidly screened potential perovskites from total feasible compounds. A further series of filtering steps including automated web scraping were imposed to ensure the originality and potential synthesizability of the predicted perovskites. Concurrently, we introduced an unsupervised deep learning strategy to retrieve fingerprints of materials. We elucidated the ineffectiveness and the educated essence of fingerprints by unravelling hidden salient information such as perovskite formability and underlying crystal structure, that can be used to identify the crystal symmetry of materials. The fingerprints essentially regulate all compositions into a common numerical platform where similar compositions tend to locally stick together. This phenomenon can be capitalized to predict the possible phases and the bandgap of materials. This further led to the conception of analogical materials discovery, that could accelerate the pursuit of finding inexpensive green materials as a replacement for current hazardous materials. We also emphasized the importance of fingerprints to pick up an initial experimental structure required for DFT modelling. Material fingerprint uncovered in this study is not universal, meaning that, it is mutable in a different data context. Nevertheless, due to the versatility of unsupervised techniques, the materials analogy quantification conceptualized here is expected to be valid for other material systems as well. Therefore, we believe the proposed framework has far-reaching implications for accelerated target-driven discovery of materials as well as computational modelling of complex compounds.

Methods

Machine learning

All supervised ML algorithms used in this study, including KNN and GBC are adapted from the scikit-learn package[51] in a python programming language environment. Gradient boosting algorithms create an ensemble of weak learners, typically by adding DTs over time to produce a powerful predictive model. The learning takes place by applying gradient The space group symmetry can be lowered during supercell generation because the initial “mixed” atom gets separated into two atom types. Hence, we substituted the disordered site with one atomic species to determine the optimized symmetry, aa, bb and cc are the optimized lattice parameter (in angstroms) compared to experimental values (in brackets ±\pm indicates the change in angstroms). α\alpha, β\beta and γ\gamma are the angles in degrees. In both combinations at B-site, (U6+,Sn4+)(\mathrm{U}^{6+}, \mathrm{Sn}^{4+}) and (U6+,Sn4+)(\mathrm{U}^{6+}, \mathrm{Sn}^{4+}) were considered, which converged to almost identical lattice parameters and total energy. (U4+,Sn6+)(\mathrm{U}^{4+}, \mathrm{Sn}^{6+}) is the most probable combination based on OCS statistics. NA—not applicable, experimental structure is used as it is.

descent algorithm to optimizing a differentiable cost function, usually logarithmic loss for classification tasks. The hyper-parameters are external to the ML model and should be tuned in advance to control the training process and achieve better predictive power. We tuned the hyper-parameters of the models (learning rate and No. of estimators in the case of GBC) using tenfold CV and grid search method. In k-fold CV, the database is randomly partitioned into k equal size subsets. The ML model is trained by combining k-1 of them and validated on the remaining subset. This is repeated k times such that each data-point in the original database gets to be in the test set exactly once. LOOCV is the extreme version of k-fold CV where k is equal to the number of samples in the database. Material features were acquired and analyzed using pymatgen[34] and mendeleev[52] python packages. The computer codes required to train the models and reproduce the results presented in this paper may be found online at https://github.com/ihalage/analogmat.

VAE architecture and training

The VAE model is implemented in python using Keras deep learning framework[53] with TensorFlow backend[54]. The depth of the VAE neural network and the dimension of the latent vector should be carefully controlled to obtain meaningful representations. A high depth (i.e., more parameters) means low reconstruction loss, but this often comes with the risk of data memorization rather than learning anything useful. High dimensional latent space can also give rise to this problem. We found that, using a significantly low dimension for the latent vector not only forces the encoder to find near optimal compression due to the added pressure by high reconstruction loss, but it also facilitates convenient data visualization without incorporating other dimensionality reduction algorithms. After some extensive heuristic tuning, we eventually constructed the VAE with five hidden layers with 2D μ\mu, σ\sigma and latent vectors. The remaining four hidden layers have 128, 64, 32, and 64 neurons, chronologically. The weights were initialized using Glorot uniform initializer. Rectified linear unit is used as the activation function of the hidden layers and linear activation is used for the output layer. L2L_2 regularization is applied in hidden layers to avoid the overfitting phenomenon. Kullback–Leibler divergence (KL loss)[55] and mean squared error (MSE) were used additively as the loss function, which was optimized using Adam optimizer with a learning rate of 0.001. The exponential decay parameters β1\beta_1, β2\beta_2 and the stability constant ϵ\epsilon were set to 0.9, 0.999 and 10−710^{-7}, respectively. The model is trained on an RTX 2080 Ti graphics processing unit (GPU) with a batch size of 32 and the validation data (20%) loss was monitored for an early-stopping method to prevent possible data memorization.

Density functional theory

Spin-polarized DFT calculations were performed with projector augmented wave pseudopotentials[56] using the generalized gradient approximation as implemented in the Vienna Ab initio Simulation Package (VASP)[57]. We used Perdew–Burke–Ernzerhof exchange-correlation functional for the present calculation. The Brillouin zone was sampled with a 10×10×1010 \times10 \times10 Monkhorst–Pack k-point grid. Cutoff energy for the plane wave basis set was set to 520 eV. The ionic positions, cell volume and cell shape were allowed to change during the structure relaxation until reaching an energy convergence threshold of 2×10−62 \times10^{-6} eV and net atomic force less than 0.01 eV/Å on any atom. The solid solutions were approximated with a supercell having the lowest Coulomb energy as generated by the supercell package[49]. The supercell dimensions used in this study are sufficient to demonstrate the geometry optimization process, however, larger supercells or a SQS based method is recommended if further calculation of physical properties is intended. The crystal structures were analyzed using pymatgen and visualized with VESTA[58]. We used the GPU port of VASP[59] to run the calculations on an RTX 2080 Ti GPU.

DATA AVAILABILITY

The experimental database is provided in Supplementary Data 1. Predicted compositions having over 98% perovskite likelihood are provided in Supplementary Data 2 along with their respective five most similar experimental materials. All other data needed to evaluate the findings of this study are present in the paper and/or the Supplementary Information.

CODE AVAILABILITY

The codes required to reproduce the results of this study are publicly available at https://github.com/ihalage/analogmat.

Received: 18 October 2020; Accepted: 8 April 2021; Published online: 21 May 2021

References

Acknowledgements

The authors thank Sachini Amararathna for collecting the experimental data analyzed in this study. We thank M.J. Reece for stimulating discussions on disordered materials and their attributes. The authors acknowledge funding received by The Institution of Engineering and Technology (IET) under the AF Harvey Research Prize. This work is supported in part by Engineering and Physical Sciences Research Council (EPSRC) ANIMATE grant (No. EP/R035393/1).

Author contributions

A.I. conceived the idea, performed ML and DFT analysis and wrote the paper. Y.H. directed and coordinated the research. All authors discussed the results and reviewed the paper.

Competing interests

The authors declare no competing interests.

ADDITIONAL INFORMATION

Supplementary information The online version contains supplementary material available at https://doi.org/10.1038/s41524-021-00536-2.

Correspondence and requests for materials should be addressed to Y.H.

Reprints and permission information is available at http://www.nature.com/reprints

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

© The Author(s) 2021

References

  1. [1]Tilley, R. J. The ABX3 Perovskite Structure, chap. 1, 1–41 (John Wiley & Sons, Ltd, 2016).
  2. [2]Grinberg, I. et al. Perovskite oxides for visible-light-absorbing ferroelectric and photovoltaic materials. Nature 503, 509–512 (2013).DOI
  3. [3]Yin, W.-J. et al. Oxide perovskites, double perovskites and derivatives for electrocatalysis, photocatalysis, and photovoltaics. Energy Environ. Sci. 12, 442–462 (2019).DOI
  4. [4]Ahmed, A., Goldthorpe, I. A. & Khandani, A. K. Electrically tunable materials for microwave applications. Appl. Phys. Rev. 2, 011302 (2015).DOI
  5. [5]Jacobs, R., Mayeshiba, T., Booske, J. & Morgan, D. Material discovery and design principles for stable, high activity perovskite cathodes for solid oxide fuel cells. Adv. Energy Mater. 8, 1702708 (2018).DOI
  6. [6]Fop, S. et al. High oxide ion and proton conductivity in a disordered hexagonal perovskite. Nat. Mater. 19, 752–757 (2020).DOI
  7. [7]Lähteenlahti, V., Schulman, A., Huhtinen, H. & Paturi, P. Transport properties of resistive switching in ag/pr0.6ca0.4mno3/al thin film structures. J. Alloys Compd. 786, 84–90 (2019).
  8. [8]Panda, D. & Tseng, T.-Y. Perovskite oxides as resistive switching memories: a review. Ferroelectrics 471, 23–64 (2014).DOI
  9. [9]Goldschmidt, V. M. Die gesetze der krystallochemie. Naturwissenschaften 14, 477–485 (1926).DOI
  10. [10]Filip, M. R. & Giustino, F. The geometric blueprint of perovskites. PNAS 115, 5397–5402 (2018).DOI
  11. [11]Bartel, C. J. et al. New tolerance factor to predict the stability of perovskite oxides and halides. Sci. Adv. 5, eaav0693 (2019).DOI
  12. [12]Lu, S., Zhou, Q., Ma, L., Guo, Y. & Wang, J. Rapid discovery of ferroelectric photovoltaic perovskites and material descriptors via machine learning. Small Methods 3, 1900360 (2019).DOI
  13. [13]Woodley, S. M. & Catlow, R. Crystal structure prediction from first principles. Nat. Mater. 7, 937–946 (2008).DOI
  14. [14]Marchenko, E. I. et al. Transferable approach of semi-empirical modeling of disordered mixed-halide hybrid perovskites ch3nh3pb(i1−xbrx)3: prediction of thermodynamic properties, phase stability, and deviations from vegard’s law. J. Phys. Chem. C 123, 26036–26040 (2019).DOI
  15. [15]Liu, N. et al. Interactive human-machine learning framework for modelling of ferroelectric-dielectric composites. J. Mater. Chem. C 8, 10352–10361 (2020).DOI
  16. [16]Emery, A. A. & Wolverton, C. High-throughput dft calculations of formation energy, stability and oxygen vacancy formation energy of abo3 perovskites. Sci. Data 4, 170153 (2017).DOI
  17. [17]Im, J. et al. Identifying pb-free perovskites for solar cells by machine learning. npj Comput. Mater. 5, 37 (2019).DOI
  18. [18]Schmidt, J., Marques, M. R. G., Botti, S. & Marques, M. A. L. Recent advances and applications of machine learning in solid-state materials science. npj Comput. Mater. 5, 83 (2019).DOI
  19. [19]Balachandran, P. V., Kowalski, B., Sehirlioglu, A. & Lookman, T. Experimental search for high-temperature ferroelectric perovskites guided by two-step machine learning. Nat. Commun. 9, 1668 (2018).DOI
  20. [20]Weng, B. et al. Simple descriptor derived from symbolic regression accelerating the discovery of new perovskite catalysts. Nat. Commun. 11, 3513 (2020).DOI
  21. [21]Yuan, R. et al. Accelerated discovery of large electrostrains in batio3-based piezoelectrics using active learning. Adv. Mater. 30, 1702884 (2018).DOI
  22. [22]Raccuglia, P. et al. Machine-learning-assisted materials discovery using failed experiments. Nature 533, 73–76 (2016).DOI
  23. [23]Ren, F. et al. Accelerated discovery of metallic glasses through iteration of machine learning and high-throughput experiments. Sci. Adv. 4, eaap1566 (2018).DOI
  24. [24]Zhao, Y. et al. Machine learning-based predictions of crystal systems and space groups from inorganic materials compositions. ACS Omega 5, 3596–3606 (2020).
  25. [25]Tshitoyan, V. et al. Unsupervised word embeddings capture latent knowledge from materials science literature. Nature 571, 95–98 (2019).DOI
  26. [26]Pauling, L. The nature of the chemical bond. application of results obtained from the quantum mechanics and from a theory of paramagnetic susceptibility to the structure of molecules. J. Am. Chem. Soc. 53, 1367–1400 (1931).
  27. [27]Nist inorganic crystal structure database, nist standard reference database number 3, national institute of standards and technology, gaithersburg md, 20899. https://icsd.nist.gov/.
  28. [28]Nechache, R. et al. Bandgap tuning of multiferroic oxide solar cells. Nat. Photonics 9, 61–67 (2015).DOI
  29. [29]Ouyang, R., Curtarolo, S., Ahmetcik, E., Scheffler, M. & Ghiringhelli, L. M. Sisso: A compressed-sensing method for identifying the best non-dimensional descriptor in an immensity of offered candidates. Phys. Rev. Mater. 2, 083802 (2018).
  30. [30]Kingma, D. P. & Welling, M. Auto-Encoding Variational Bayes, in 2nd International Conference on Learning Representations (ICLR), Banff, AB, Canada, April 14–16 (2014).arxiv.org/abs/1312.6114
  31. [31]Gómez-Bombarelli, R. et al. Automatic chemical design using a data-driven continuous representation of molecules. ACS Cent. Sci. 4, 268–276 (2018).
  32. [32]Ryan, K., Lengyel, J. & Shatruk, M. Crystal structure prediction via deep learning. J. Am. Chem. Soc. 140, 10158–10168 (2018).DOI
  33. [33]Stein, H. S., Guevarra, D., Newhouse, P. F., Soedarmadji, E. & Gregoire, J. M. Machine learning of optical properties of materials – predicting spectra from images and images from spectra. Chem. Sci. 10, 47–55 (2019).DOI
  34. [34]Ong, S. P. et al. Python materials genomics (pymatgen): a robust, open-source python library for materials analysis. Comput. Mater. Sci. 68, 314–319 (2013).DOI
  35. [35]Shannon, R. D. Revised effective ionic radii and systematic studies of interatomic distances in halides and chalcogenides. Acta Crystallogr. Sect. A 32, 751–767 (1976).DOI
  36. [36]Bartel, C. J. et al. A critical examination of compound stability predictions from machine-learned formation energies. npj Comput. Mater. 6, 97 (2020).DOI
  37. [37]Ward, L., Agrawal, A., Choudhary, A. & Wolverton, C. A general-purpose machine learning framework for predicting properties of inorganic materials. npj Comput. Mater. 2, 16028 (2016).DOI
  38. [38]Park, W. B. et al. Classification of crystal structure using a convolutional neural network. IUCrJ 4, 486–494 (2017).DOI
  39. [39]Li, M.-D. et al. Large electrocaloric effect in lead-free ba(hfxti1−x)o3 ferroelectric ceramics for clean energy applications. ACS Sustain. Chem. Eng. 6, 8920–8925 (2018).DOI
  40. [40]Huang, X.-X. et al. Dielectric relaxation and pinning phenomenon of (sr,pb)tio3 ceramics for dielectric tunable device applications. Sci. Rep. 6, 31960 (2016).DOI
  41. [41]Farid, U., Gibbs, A. S. & Kennedy, B. J. Impact of li doping on the structure and phase stability in agnb o3. Inorg. Chem. 59, 12595–12607 (2020).
  42. [42]Pilanía, G. et al. Machine learning bandgaps of double perovskites. Sci. Rep. 6, 19375 (2016).DOI
  43. [43]Koruza, J. et al. Requirements for the transfer of lead-free piezoceramics into application. J. Materiomics 4, 13 – 26 (2018).DOI
  44. [44]Raymond, O., Font, R., Portelles, J. & Siqueiros, J. M. Magnetoelectric coupling study in multiferroic pb(fe0.5nb0.5)o3 ceramics through small and large electric signal standard measurements. J. Appl. Phys. 109, 094106 (2011).DOI
  45. [46]Zunger, A., Wei, S.-H., Ferreira, L. G. & Bernard, J. E. Special quasirandom structures. Phys. Rev. Lett. 65, 353–356 (1990).
  46. [47]Bellaiche, L. & Vanderbilt, D. Virtual crystal field approximation revisited: application to dielectrics and piezoelectric properties of perovskites. Phys. Rev. B 61, 7877–7882 (2000).DOI
  47. [48]Von Pezold, J., Dick, A., Friák, M. & Neugebauer, J. Generation and performance of special quasirandom structures for studying the elastic properties of random alloys: application to al-ti. Phys. Rev. B 81, 094203 (2010).
  48. [49]Okhotnikov, K., Charpentier, T. & Cadars, S. Supercell program: a combinatorial structure-generation approach for the local-level modeling of atomic substitutions and partial occupancies in crystals. J. ChemInformatic 8, 17 (2016).
  49. [50]Jha, D. et al. Enhancing materials property prediction by leveraging computational and experimental data using deep transfer learning. Nat. Commun. 10, 5316 (2019).
  50. [51]Pedregosa, F. et al. Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011).arxiv.org/abs/1201.0490
  51. [52]Mentel, L. mendeleev – a python resource for properties of chemical elements, ions and isotopes, ver. 0.6.0 (2014). https://github.com/lmmentel/mendeleev.
  52. [53]Chollet, F. et al. Keras (2015). https://keras.io.
  53. [54]Abadi, M. et al. TensorFlow: large-scale machine learning on heterogeneous systems (2015). https://www.tensorflow.org/.arxiv.org/abs/1603.04467
  54. [55]Kullback, S. & Leibler, R. A. On information and sufficiency. Ann. Math. Statist. 22, 79–86 (1951).DOI
  55. [56]Blöchl, P. E. Projector augmented-wave method. Phys. Rev. B 50, 17953–17979 (1994).pubmed.ncbi.nlm.nih.gov/9976227
  56. [57]Kresse, G. & Furthmüller, J. Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set. Phys. Rev. B 54, 11169–11186 (1996).pubmed.ncbi.nlm.nih.gov/9984901
  57. [58]Momma, K. & Izumi, F. VESTA 3 for three-dimensional visualization system for electronic and structural analysis. J. Appl. Crystallogr. 41, 653–658 (2008).
  58. [59]Hacene, M. et al. Accelerating sparse electronic structure calculations using graphic processing units. J. Comput. Chem. 33, 2581–2589 (2012).DOI
  59. [60]Ge, P.-Z. et al. Composition dependence of giant electrocaloric effect in pbxsr1−xtio3 ceramics for energy-related applications. J. Materiomics 5, 118–126 (2019).DOI
  60. [61]Cavalcante, L. et al. Dielectric properties of ca(zr0.05ti0.95)o3 thin films prepared by chemical solution deposition. J. Solid State Chem. 179, 3739–3743 (2006).DOI
  61. [62]He, T., Chen, J., Calvarese, T. & Subramanian, M. Thermoelectric properties of la1-xca xco3 (a=pb, na). Solid State Sci. 8, 467–469 (2006).DOI
  62. [63]Sutar, B., Das, P. & Choudhary, R. N. Synthesis and electrical properties of sr (bio5v0.5)o3 electroceramic. Adv. Mater. Lett. 5, 131–137 (2014).DOI
  63. [64]Zhengfa, L. et al. Synthesis and structural features of k0.5nd0.5tio3 and k0.5sm0.5tio3. RARE METAL MAT. ENG. 42, 476–478 (2013).
  64. [65]Yang, J. H., Choo, W. K., Lee, J. H. & Lee, C. H. The crystal structure of the B-site ordered complex perovskite Sr(Yb0.5Nb0.5)O3. Acta Crystallogr. Section B: 55, 348–354 (1999).pubmed.ncbi.nlm.nih.gov/10927377
  65. [66]Yan, L. et al. High permittivity srf0.5tio3 films grown by pulsed laser deposition. Appl. Phys. Lett. 94, 232903 (2009).DOI
  66. [67]Tarrida, M., Larguem, H. & Madon, M. Structural investigations of (ca,sr)zro3 and (ca,sr)zro3 perovskite compounds. Phys. Chem. Miner. 36, 403–413 (2009).DOI
  67. [68]Wan ali, Wff et al. Synthesis and characterization of ba0.3sr0.7zro3 ceramic thick films prepared by sol-gel technique. Adv. Mat. Res. 620, 435–439 (2012).DOI
  68. [69]Chen, K., Zheng, J., Diao, C., Yang, C. & Chiu, Y. Photoluminescence characteristics of perovskite eu-doped (ba0.9sr0.1)zro3 ceramic. In 2016 International Conference on Advanced Materials for Science and Engineering (ICAMSE), 419–422 (2016).DOI
  69. [70]Ahmed, M., Selim, M. S. & Arman, M. Novel multiferroic la0.95sb0.05feo3 orthoferrite. Mater. Chem. Phys. 129, 705–712 (2011).DOI

Paper details

vlnc:W_33zszdnx
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

Not recorded for this paper

View statement
Looking for related papers…
Contents