FM
Fernando Martínez-Plumed
cs.AIcs.LGcs.CLcs.CYstat.MLcs.DBArtificial IntelligenceBenchmarkingNatural Language Processing
On Valency
published · living versionsW_xaqzq29k·v1 · currentpublished
Keeping Time vs. Understanding Time: Neither Alone Explains Temporal Reasoning in LLMs
with Auss Abbood, José Hernández-Orallo, Nigel Collier
1 version
Preprints & journals
21 papers in the corpus · 2013–2026Keeping Time vs. Understanding Time: Neither Alone Explains Temporal Reasoning in LLMs2610.29507v1 · Auss Abbood, Fernando Mart'inez-Plumed, Jos'e Hern'andez-Orallo et al.2026 · 0 citationsarXivon Valency
General scales unlock AI evaluation with explanatory and predictive power.41922702 · Zhou, Lexin, Pacchiardi, Lorenzo, Martínez-Plumed, Fernando et al.2026 · 7 citationsNature. 2026;652(8108):58-67
From Human-Level AI Tales to AI Leveling Human Scales2602.18911v2 · Peter Romero, Fernando Mart'inez-Plumed, Zachary R. Tidler et al.2026 · 0 citationsarXiv
Capabilities Ain't All You Need: Measuring Propensities in AI2602.18182v5 · Daniel Romero-Alvarado, Fernando Mart'inez-Plumed, Lorenzo Pacchiardi et al.2026 · 0 citationsarXiv
Comparative analysis of public and expert perceptions of electrified vehicles in the European Union.40594306 · Mourtzouchou, Andromachi, Marin, Andres L, Laveneziana, Lorenzo et al.2025 · 4 citationsScientific reports. 2025;15(1):21695
PredictaBoard: Benchmarking LLM Score Predictability2502.14445v2 · Lorenzo Pacchiardi, Konstantinos Voudouris, Ben Slater et al.2025 · 3 citationsarXiv
What should an AI assessor optimise for?2502.00365v1 · Daniel Romero-Alvarado, Fernando Mart'inez-Plumed, Jos'e Hern'andez-Orallo2025 · 0 citationsarXiv
Larger and more instructable language models become less reliable.39322679 · Zhou, Lexin, Schellaert, Wout, Martínez-Plumed, Fernando et al.2024 · 200 citationsNature. 2024;634(8032):61-68
Predictable Artificial Intelligence2310.06167v3 · Lexin Zhou, Pablo A. Moreno-Casares, Fernando Mart'inez-Plumed et al.2023 · 9 citationsarXiv
Rethink reporting of evaluation results in AI.37053341 · Burnell, Ryan, Schellaert, Wout, Burden, John et al.2023 · 103 citationsScience (New York, N.Y.). 2023;380(6641):136-138
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models2206.04615v3 · Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao et al.2022 · 569 citationsTransactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5Bvosj
General intelligence disentangled via a generality metric for natural and artificial intelligence.34819537 · Hernández-Orallo, José, Loe, Bao Sheng, Cheke, Lucy et al.2022 · 29 citationsScientific reports. 2021;11(1):22822
Compute and Energy Consumption Trends in Deep Learning Inference2109.05472v2 · Radosvet Desislavov, Fernando Mart'inez-Plumed, Jos'e Hern'andez-Orallo2021 · 275 citations"Trends in AI inference energy consumption: Beyond the performance-vs-parameter laws of deep learning" Sustainable Computing: Informatics and Systems (2023). Volume 38, April 2023, 100857
Fairness and Missing Values1905.12728v1 · Fernando Mart'inez-Plumed, Cesar Ferri, David Nieves et al.2019 · 9 citationsarXiv
Analysing Results from AI Benchmarks: Key Indicators and How to Obtain Them1811.08186v2 · Fernando Mart'inez-Plumed, Jos'e Hern'andez-Orallo2018 · 24 citationsIEEE Transactions on Games, 2018
General-purpose Declarative Inductive Programming with Domain-Specific Background Knowledge for Data Wrangling Automation1809.10054v1 · Lidia Contreras-Ochando, C'esar Ferri, Jos'e Hern'andez-Orallo et al.2018 · 3 citationsarXiv
A multidisciplinary task-based perspective for evaluating the impact of AI autonomy and generality on the future of work1807.02416v1 · Enrique Fern'andez-Mac'ias, Emilia G'omez, Jos'e Hern'andez-Orallo et al.2018 · 8 citationsarXiv
Between Progress and Potential Impact of AI: the Neglected Dimensions1806.00610v2 · Fernando Mart'inez-Plumed, Shahar Avin, Miles Brundage et al.2018 · 1 citationarXiv
CASP-DM: Context Aware Standard Process for Data Mining1709.09003v1 · Fernando Mart'inez-Plumed, Lidia Contreras-Ochando, Cesar Ferri et al.2017 · 20 citationsarXiv
Forgetting and consolidation for incremental and cumulative knowledge acquisition systems1502.05615v1 · Fernando Mart'inez-Plumed, Cesar Ferri, Jos'e Hern'andez-Orallo et al.2015 · 1 citationarXiv
On the definition of a general learning system with user-defined operators1311.4235v1 · Fernando Mart'inez-Plumed, Cesar Ferri, Jos'e Hern'andez-Orallo et al.2013 · 4 citationsarXiv
Career total: 121 works. 21 are in this corpus.
Profile built from the corpus for this byline.
Author records are still filling in while the Hub is in alpha. If this is your page, you'll be able to claim it soon. Spot a mistake? Tell us.