betaFeedback

WorksComputer Science

LifeVal: Evaluating AI Model Performance on Personalized Agentic Consumer Tasks

Abstract

We introduce LifeVal, a benchmark evaluating AI model performance on personalized agentic consumer tasks. LifeVal covers the most valuable life tasks that a personalized digital superassistant could automate, representing over 1.7 trillion US dollars in annual willingness-to-pay across 148 consumer task categories (e.g., managing finances, moving apartments, searching for a job, finding childcare). To construct our activity distribution, we conducted a new survey of willingness-to-pay for a digital superassistant across a demographically representative sample of over 3,800 consumers, cross-referencing our results against the American Time Use Survey (Bureau of Labor Statistics, 2025) and the Multinational Time Use Study (Fisher et al., 2025). For the most valuable consumer activities, we recruited task creators to create AI evaluation tasks personalized using real ChatGPT conversations and memories, reference files, and personal context. Task creators had to pass our expertise threshold (including personally completing the task multiple times and seeing the results through in their real lives for over a year) and also write a rubric, ensuring that our evaluation measured the best personalized completion for that task. All tasks had to pass at least three rounds of human quality-control before acceptance into our final evaluation sets.

Example LifeVal Tasks

Figure 1. Example LifeVal Tasks. Any personal information in the paper, including any images with personal information, has been deidentified or synthetically generated to protect our task creators’ privacy.

Introduction

AI models are increasingly acting as digital superassistants: highly capable, personalized agents with deep integration across users’ digital lives. To understand and forecast the impacts of such models, we need to measure their capabilities. One way to measure the consumer capabilities of such models is through usage metrics. However, while usage data tells us about tasks already requested by users, adoption often lags capabilities, and usage metrics don’t capture newer capabilities that take time to adopt, or tasks that users don’t think to ask [25]. To better measure the capabilities of AI models in consumer settings, we introduce LifeVal, a benchmark explicitly designed to measure AI capabilities on real-world tasks that consumers deeply value.

LifeVal tasks capture valuable, long-horizon consumer needs:

  • High Value: LifeVal tasks are pulled from the highest-value tasks from a demographically-representative survey of willingness to pay for AI superassistance, triangulated against the American Time Use Survey and Multinational Time Use Study, which compiles comparable time-use surveys from 25 countries [8, 13].1

  • High Context: LifeVal tasks require the model to reference detailed personal data, lengthy ChatGPT conversation histories, and context across different applications.

  • Personalized: LifeVal tasks are highly personalized and subjective, requiring models to adapt to individual preferences.

  • Agentic: LifeVal tasks require taking complex actions on a computer, including interacting with websites, accessing account states, filling forms, producing artifacts, and managing digital transactions.

  • Objectively gradable: Despite their subjective nature, LifeVal tasks are possible to objectively grade when conditioned on the provided context.

Related Work

LifeVal sits at the intersection of three literatures that have mostly remained separate: agentic benchmarks, personalization and memory benchmarks, and economic literature on task augmentation and automation.

AI evaluations are shifting from single-turn academic benchmarks toward interactive, agentic tasks that test whether models can reliably complete real workflows [32] (Zhou et al. 2024). Performance has risen rapidly since early baselines, including WebArena’s original 14% vs. 78% human gap, OSWorld’s original 12.24% agent performance vs. 72.36% human [32] (Zhou et al. 2024). More recent verified variants report much stronger results, including 67.3% on WebArena-Verified and 75.0% on OSWorld-Verified for GPT-5.4 [24]. This literature suggests several design lessons for LifeVal: (i) partially subjective outcomes are often evaluated with rubrics [16]; (ii) reinforcement learning environments improve reproducibility relative to the live web [Zhou et al., 2024, XLANG Lab, 2025]; (iii) evaluation harnesses must be hardened against reward hacking [31].

Related work examines how AI systems infer, retain, and apply user preferences [20]. PrefEval [Zhao et al., 2025] evaluates whether models can remember preferences over long synthetic conversations, while other benchmarks study personalized assistance in conversational and research settings [22, 21]. More closely related to LifeVal, PersonalWAB [9] combines real shopping histories with generated user profiles to evaluate personalized search and recommendation performance, and Persona2Web [19] evaluates whether agents can infer preferences from synthetic user profiles and browsing histories to tasks on the open web. Our work extends personalized agent evaluation by combining real ChatGPT conversation histories and memories with tasks requiring browser and computer use across everyday domains. The same users contribute task-specific rubrics, providing ground truth about whether the agent successfully used their personal context.

This paper is also closely related to a large literature in economics on task-automating or augmenting technologies [4, 1, 2]. When technology sharply reduces the cost of a task, households gain purchasing power, time, or both, and can reallocate those resources toward other goods and services, especially complements to the now-cheaper task [15].

More broadly, automation can create new consumer demand rather than merely substitute for labor. Agricultural mechanization and productivity growth reduced food prices, allowing households to devote less spending to food and more to manufactured goods and services [14, 18]. Similarly, electrification and labor-saving appliances reduced the time required for cooking, cleaning, and laundry, shifting time out of unpaid home production and into market work and other activities [15, 26].

When the marginal cost of completing a task falls far enough, technology can also expand access. In the U.S., digital retail increased consumer surplus by adding variety and convenience, especially for households outside dense urban markets [6, 27, 11]. Such effects may be larger when a technology lowers the cost of many consumer tasks at once.

Many LifeVal tasks — coordinating home services, managing finances, communicating with providers, and navigating taxes — are inputs into household production rather than final consumption. These activities are quantitatively important, as households devote substantial time to home production and to purchasing and coordinating goods and services [3, 26]. Tax filing is one clear example, where many low-income households pay for assistance to access tax-administered benefits, and filing frictions affect claiming behavior [5]. In most other domains, however, the relevant margin is the cost of administrative burden. Incomplete take-up of social services reflects learning costs, paperwork requirements, and other barriers that deter eligible households [10, 12, 17]. Reducing the cost of these tasks may therefore generate welfare gains through time savings, lower expenditures, and expanded access for households that would otherwise be unable to participate.

Task and Benchmark Construction

Prioritizing consumer life tasks

To construct the initial set of tasks for LifeVal, we used data from the American Time Use Survey (ATUS, 2024; n=7,700) and the Multinational Time Use Study (MTUS, 2020; n=8,782). ATUS is a detailed time-use taxonomy created by the U.S. Bureau of Labor Statistics (BLS) that documents how people allocate their time across daily activities. MTUS is a database of international timeuse diary surveys, designed to make activity categories comparable across countries. Together, these datasets provide a detailed view of how people spend their time across a full 24-hour period, including differences between weekdays and weekends and across different times of year. We cleaned the data based on the procedure outlined in A.1.

We then estimated the potential value of an AI digital superassistant for each task. We considered whether task categories could simply be weighted by the amount of time people spend on them. But for consumer life tasks, time spent is often a poor proxy for value: some tasks are relatively infrequent or short in duration, yet highly consequential when they arise, such as tax preparation, choosing health insurance, or obtaining preventive health care. Moreover, sometimes life tasks that take a lot of time (e.g., sleeping, eating) can only be moderately impacted by a personal digital superassistant; an AI model can give advice about these activities, but it cannot sleep for you or eat for you. This makes measuring AI impacts on life tasks different from work-related tasks. For work tasks, the value from an AI superassistant can often be approximated more directly using average wages multiplied by hours worked for the relevant occupation.

Because no comparable market wage exists for many personal life tasks, we supplemented the ATUS/MTUS task data with a willingness-to-pay survey (n=3,837), with recruitment targeting US Census distributions for age, gender, and ethnicity from Census Bureau population estimates (2021), and income from the Current Population Survey Annual Social and Economic Supplement (CPS-ASEC, 2025) [29, 30]. We specified a hypothetical perfect digital superassistant that could provide advice and perform digital tasks, but could not perform physical work. Respondents estimated the maximum amount they would have paid over the course of 2025 for digital assistance with each activity (respondents remained responsible for the cost of any goods or services arranged). Each respondent evaluated a randomized subset of 30 activity categories.

The resulting data informed a prioritized distribution of 148 activity categories derived from the most detailed level of the ATUS classification, used to guide further LifeVal task collection. Summing the estimated U.S. annual willingness to pay across these categories yields approximately $1.7 trillion (Table 1). We compared these valuations with external proxies for activity importance, including BLS consumer expenditure, occupational wages, and ATUS wellbeing measures. The valuation question is provided in A.2, aggregate willingness-to-pay estimates by broad activity category in B.2, and a discussion of the external comparisons in A.2.1. The resulting tasks span the most important areas that people want help with, including caregiving, health, education, household administration, personal finances, shopping, and accessing government services.

Tier 1 activity categorySample of Tier 3 activitiesAnnual WTP per respondent (US,sum)∣USannualWTP(US, sum) | US annual WTP (US billions)
Household activities and servicesFinancial management; Using home maint/repair/decor/construction svcs; Exterior repair, improvements, & decoration$1,811.7 | $505
Caring for and helping othersHome schooling of children; Looking after adult (as a primary activity); Activities related to child’s education, n.e.c.*$1,289.4 | $329
Personal careActivities rel. to purchasing/selling real estate; Using health and care services outside the home; Banking$856.3 | $239
EducationResearch/homework for class for degree, certification, or licensure; Research/homework n.e.c.*; Taking class for degree, certification, or licensure$653.7 | $190
Volunteer activitiesVolunteer - Computer use; Volunteer - Teaching, leading, counseling, mentoring; Volunteer - Telephone calls (except hotline counseling)$385.5 | $100
Consumer purchasesShopping, except groceries, food and gas; Grocery shopping; Comparison shopping$266.9 | $81
Socializing, relaxing and leisureWriting for personal interest; Hobbies, except arts & crafts and collecting; Arts and crafts as a hobby$282.3 | $77
Telephone callsTelephone calls to/from professional or personal care svcs providers; Telephone calls to/from salespeople; Telephone calls to/from household services providers$233.8 | $64
Professional and personal care servicesJob search activities; Job interviewing$159.6 | $47
Government services and civic obligationsObtaining licenses & paying fines, fees, taxes; Using social services; Civic obligations & participation$158.7 | $46
Sports, exercise and recreationWeightlifting/strength training; Working out, unspecified; Playing baseball$135.7 | $35
TravelingTraveling; Travel as a form of entertainment$104.2 | $28
Eating and drinkingEating and drinking$13.2 | $3
Religious and spiritual activitiesReligious education activities$9.3 | $2
Total across listed categories$1,746

Table 1. ATUS/MTUS Tier 1 activity categories, sample Tier 3 activities, and summed willingness-to-pay estimates. The annual WTP column sums activity-level means from our demographic survey; the U.S. annual WTP column sums national estimates.

Task writer recruitment, consent, and personalization data

Our belief is that only an “expert” in the task knows what the truly correct outcome is in the long run for them. In LifeVal, we did not want generic tasks; each task instead represents what is useful and correct for the writer. We personally reviewed every task proposed by expert task writers to confirm their experience met the expertise thresholds for the project, including back-and-forths with additional information requests, and conducted live virtual trainings and office hours. When writing tasks, expert task writers replaced personally identifiable information (PII) with synthetic data and consented to share their ChatGPT data which itself was de-identified before research use, as shown in Figure 2.

Task writer personalization data processing

Figure 2. Task writer personalization data processing

Task Creation

Each task consists of the following components:

  • Request (Prompt): Clearly specifies what the task writer wants the model to accomplish.

  • Personalized Context: Provided to enable accurate personalized task completion. While many personal queries seem highly subjective, providing detailed personal context significantly reduces ambiguity. For example, the general question “What should I have for dinner?” becomes objectively answerable if the model has access to the user’s preferences and recent dining history. Personalized context includes:

    • ChatGPT Conversations and Memories: Relevant excerpts from prior conversations and memories. At evaluation time, the model sees their entire conversation dump (minus any conversations they archived or deleted).

    • Reference Files: Any additional context provided to complete the task in file form, e.g. medical test results, last semester’s course schedule.

    • Additional Task Context: Any other essential details or resources that the model would need to successfully perform the task that are not available in ChatGPT data, reference files, or web browsing.

  • Rubric: To ensure objective grading despite the inherent subjectivity of personalized tasks, writers also create rubrics for each task.

  • Reinforcement Learning Environment (RLE): Each task has corresponding environment(s) where the model can complete the agentic actions required by the task. We also give the model a browser tool to search an offline version of the web.

  • Starting State: Initial data or information required within the environment to complete tasks (e.g., an email in the inbox containing medical results).

Figure 3. Task structure

Figure 4. Task quality control loop

Quality control for tasks, environments, and rubrics

We employ rigorous quality control (QC) procedures, involving both human and automated model review to ensure task accuracy, realism, and fairness.

Human QC

LifeVal tasks underwent at least three rounds of human review:

  1. Peer Review: Conducted by another task writer with domain expertise relevant to the task if needed. The peer reviewer assessed task accuracy, realism, and completeness from the perspective of practical domain knowledge.

  1. Lead Review: A trained reviewer evaluated the task against campaign standards, including whether the task demonstrated sufficient difficulty for the campaign and was fair i.e., possible to complete with the provided information.

  1. Final Sign Off: A third expert reviewer reviewed the completed task and signed off when it was ready for inclusion.

Model QC

In parallel with human review, model-driven QC helped ensure that the rubric criteria were fair and solvable given the provided inputs:

  • A model is given all task components, including the prompt, personal context, and environment, and attempts to complete the task.

  • Another model reviews the completion of the task and categorizes failures into rubric, prompt/context, environment, or model-related problems.

  • Based on the identified issues, the model proposes targeted corrections.

  • Human reviewers assess the model’s proposed fixes and decide whether or not to implement them.

Grading

We use two automated graders, both of which use GPT-5.6.

  • Primary Grader: The purpose of the primary grader is to assess whether the task was completed correctly. The grader receives the original task prompt, relevant conversation history and memories, task rubric items and their available points, the model’s final response, any files or artifacts the model created, and a backend state diff showing the change in the task RLE from start to finish. The grader is instructed to score each rubric item independently using only the provided evidence. It must verify that any artifacts the model claims to have created exist, consider backend state changes for tasks involving real side effects, and only give credit for actions that were actually completed.

  • Hack Grader: The goal of the hack grader is to detect successful environment hacking. We consider any instance when the model accesses internal RLE APIs to be hacking. This is discouraged because real sites are unlikely to have these types of open endpoints for a model to use. If hacking is detected, the sample receives a score of 0. For additional information about the grading setup, see A.3.

Results

We created a set of 169 tasks and evaluate GPT-5.2, 5.4, 5.5, 5.6, and GPT-6 Astra.

Four plots showing performance versus latency, tool calls, tokens, and API cost

Figure 5. Clockwise from top left: performance versus average observed rollout wall time, average tool calls per rollout, average API cost, and average tokens per rollout. Points show mean reward for each model setting, with an 8-hour timeout per rollout.

The plots show 95% confidence intervals obtained by bootstrapping (resampling with replacement the available automated grader scores for each sample, computing the mean per sample, and averaging across all samples or for the specified model).

Common Failure Modes

LifeVal failure modes on xhigh reasoning

Figure 6. Failure mode profiles by model. Each bar’s total height is the model’s overall failure rate, computed as the average value of 1−reward1 - \text{reward} across evaluated samples.

The models exhibit similar failure-mode profiles but we see trends over time. GPT-5.2 is the only model to run out of tokens trying to complete the tasks, which results in the ”no final answer” failure. Since 5.2, improved training on computer use, browser use, and connectors has resulted in higher rewards overall. GPT-6 Astra is our most aligned model yet, and we see an increase in failure modes related to decision boundaries and alignment like “Required action not completed” and “Reported inability to find or verify information.” The most stable failure mode across models is, “Incorrect information or recommendation.” Models often miss key information that is located in personal conversations.

Limitations

LifeVal has the following limitations:

First, because LifeVal draws on ATUS and MTUS, it may miss newer tasks that do not appear in historical time-use surveys. ATUS ends in 2021, and the most recent survey data from MTUS, which is a database rather than a single survey, is also from 2021. Also, our willingness-to-pay survey was US-centered and conducted in English, so it may under-represent tasks that are common outside the US or in communities that are weakly represented in demographic survey panels.

Second, willingness-to-pay estimates are only a proxy for digital superassistant value. They are likely better than raw time spent for consumer tasks, but they still depend on self-reporting, survey framing, and respondents’ imagination of what a “digital superassistant” can do. We cross-checked our weights against BLS consumer spending and other related measures, but the final benchmark is still anchored to survey answers rather than revealed long term behavior.

A final limitation is timelessness. Although we direct most web interactions through our RLEs rather than live websites, tasks that depend on time-sensitive information or browsing hit a web cache that is not frozen and can therefore change across runs. This source of variation is substantially reduced by the RLE setup, but not fully removed, and can lead to variations in model scores on tasks that rely on browsing.

Conclusion

LifeVal introduces the first benchmark we’ve built specifically to measure AI models’ capabilities on consumer-oriented tasks, leveraging personalized ChatGPT data to evaluate performance realistically and accurately. Key contributions of this work include:

  • Task Distribution: A set of tasks derived from real-world consumer activities and prioritized by consumer-reported value (using a new consumer survey), ensuring relevance and utility.

  • Dataset: A novel dataset of tasks, RLEs, rubrics, and personalized, user-specific context drawn directly from the task writers’ ChatGPT histories.

LifeVal provides a structured and gradable framework to measure AI models’ potential to act as genuinely useful personalized assistants.

Acknowledgments

We thank Alexandra Barr, Ally Bennett, Andy Applebaum, Annie Lee, April Won, Dana Palmie, Daniel Fradin, David Li, Erik Ritter, Fidji Simo, Grace Kim, Henry Baer, James Lennon, Kendra Rimbauch, Kirsty Le, Laurance Fauconnet, Leon Maksin, Mark Chen, Marwan Aljubeh, Michael Sharman, Michele Wang, Michelle Pokrass, Minnia Feng, Natalie Kim, Nick Otis, Nick Turley, Tom Stasi, Tony Song, Ugurcan Turkdogan, Vinnie Monaco, Wyatt Thompson, Xiaolei Zhu, and Yiheng Xu. We’d especially like to thank the experts who contributed their time and expertise to LifeVal, without whom this work would not have been possible.

Appendix

ATUS Data Cleaning Procedure

We performed the following data cleaning.

  • Merged related subcategories: We collapsed related subcategories like traveling to various places, watching various sports, and waiting activities into unified categories for “transportation,” “watching sports” and “waiting.”

  • Merged closely related tasks: We consolidated very similar tasks like “medical care provided to adults” and “medical care provided to children” into one category and combined financial management tasks regardless of whether assistance is provided to others or for oneself.

  • Removed long-tail categories: We excluded work-related activities (already covered in GDPval) and unspecified categories (“not elsewhere classified”) from our analysis.

Consumer willingness-to-pay survey

Recruitment targeted U.S. population distributions for age, gender, ethnicity, and income. 3,837 respondents completed the survey. Screening comprised comprehension questions assessing respondents’ understanding of the assistant’s capabilities and a simple attention check. Respondents were retained only if they answered all five checks correctly, yielding 1,826 retained respondents and 2,011 exclusions.

Each respondent provided valuations for a subset of up to 30 activities from the cleansed ATUS/MTUS task distribution. Each activity-level estimate was calculated from the retained respondents who provided a valuation for that activity. For each assigned activity, respondents were asked the following valuation question:

Imagine you have access to a perfect digital superassistant.

The digital superassistant provides perfect advice (e.g., explain how to fix your washing machine, give the world’s best personalized parenting tips, create a custom LSAT study guide), and when possible, automates digital tasks on your behalf (e.g., buying your preferred clothing online, filling out an online tax return perfectly on your behalf, knowing what takeout dinner you want and ordering it via delivery).

  • Any money that the digital superassistant spends comes from your wallet.

  • Assume the digital superassistant is perfect at performing these tasks–so for the purposes of this exercise, assume that it knows your preferences perfectly and does not make any mistakes.

Consider the entirety of last year (2025). What is the most you would have been willing to pay, as the sum total across the whole year, in $USD, for the digital superassistant to assist on this task? Put 0 if you would not pay to use the digital superassistant.

We estimated annual willingness to pay for each activity using a 95th-percentile winsorized mean. Specifically, valuations above the 95th percentile for the activity were replaced by that percentile, and the resulting values were averaged. Percentiles were calculated by linear interpolation. Zero valuations were included, while missing responses were excluded from the denominator for the activity.

We converted these estimates into task collection targets proportional to estimated willingness to pay. Each activity’s share of total estimated willingness to pay across eligible activities was multiplied by a target of 800 tasks and rounded down to the nearest integer. After rounding, 148 activity categories had positive allocations, corresponding to 702 tasks representing more than $1.7T in annual willingness to pay for US consumers.

Validating willingness-to-pay survey results

As a robustness check, we compared our willingness-to-pay rankings against several external proxies for task importance: the BLS Consumer Expenditure Survey, O*NET, and the ATUS Wellbeing Survey [23, 7] (U.S. Bureau of Labor Statistics 2025).

For each ATUS Tier 3 activity in our distribution, we mapped a corresponding spending category, occupation, and ATUS wellbeing activity where possible. For example, the activity “using legal services” was mapped to the spending category “legal fees” and the occupation “Lawyers.” We then compared our survey-reported willingness to pay against external measures of willingness to pay, including average household spending, spending participation rates, occupational wages, and reported emotions during the activity.

These external measures were only moderately correlated with our survey-based willingness-to-pay rankings (R2≈0.4R^2 \approx0.4). We view this as evidence that willingness to pay captures something related to, but distinct from, standard proxies such as spending, wages, or experienced affect. In particular, we believe the differences arise for several reasons:

  • Consumers may place high value on tasks that have important long-run consequences even when they involve relatively little direct spending (e.g., financial management).

  • Occupational wages reflect labor market conditions, not just value to consumers.

  • Consumer expenditure categories combine goods and services, whereas willingness to pay for AI assistance is primarily thought of as a service.

  • Negative or positive emotions during an activity do not consistently translate into willingness to pay for that activity.

Grading

Our main grader for the above results was GPT-5.6 Sol with xhigh reasoning. To test whether our autograder aligned with human judgments, we also asked human trainers to grade the model’s rollouts using the task rubrics. Seventeen trainers graded one GPT-5.5 rollout for each task in an n=30n=30 subset, and we found that the mean rubric grade was 83.61% for humans and 84.20% for GPT-5.6. Across the 30 rollouts, the Pearson correlation between the mean human grade and the GPT-5.6 grade was r=0.864r = 0.864.

GraderMean rubric grade
Human83.61%
GPT-5.684.20%

Table 2.

Personalization

To assess the importance of personalization in LifeVal tasks, we evaluated the tasks under four conditions: baseline; past conversations and memories removed; additional task context removed; and additional task context synthetically inserted into past conversations rather than provided directly. We used the same model and varied reasoning effort across all conditions.

Removing additional task context substantially reduced performance at every reasoning effort, while removing past conversations and memories had a much smaller effect. Inserting facts from the additional task context into past conversations reduced performance by approximately as much as removing the context entirely. These results suggest two conclusions:

  1. Additional task context contains much of the personal information needed to complete the tasks.

  2. The model has difficulty finding and using relevant information in past conversations.

To investigate these findings further, we examined performance on personalized rubric criteria: criteria requiring information from memories, past conversations, or additional task context. When creating their rubrics, trainers identified the where the information needed to satisfy each criterion was located in the task (e.g. the reference files, their past conversations, additional task context, available via browsing, etc.). We selected criteria where trainers identified exactly one of these three sources and compared their win rates.

  • Past conversations: average win rate of 33.33%.

  • Memories: average win rate of 47.8%.

  • Additional task context: average win rate of 55.8%, falling to 41.5% when the information was synthetically inserted into past conversations.

For criteria attributed exclusively to past conversations on which the model achieved a 100% win rate, we inspected the corresponding rollouts to determine:

  1. Whether the model accessed past conversations.

  2. Whether it found the relevant information.

  3. Whether it used that information correctly.

  1. Whether the information was also available elsewhere in the task or could be inferred from conversation titles alone.

For every criterion in this reviewed subset, the information needed to satisfy it was also available elsewhere in the task or could be inferred from conversation titles alone. Thus, success on these criteria did not establish that the model retrieved the relevant facts from conversation contents. We observed the model searching conversation history, including in unsuccessful attempts, but its searches often relied on keywords and topical cues. For example:

grep -Rni -E \
'GAship|graduate assistant|full.?time|student loan|LING 800|dissertation credits|qualifying paper
|registration' \
/home/reference_files /home/conversation_history \
2>/dev/null | head -300

Expert Sourcing, Instructions, and Compensation

Experts were recruited from existing pools of generalist task writers, supplemented with targeted outreach for niche categories (e.g. ADU setup, mold remediation) via blogs and social media channels.

Participation was voluntary, and contributors could withdraw at any time. Contributors were compensated as professional contractors for their time and expertise.

ATUS/MTUS Task Categories

References

  1. [1]Daron Acemoglu and David Autor. Skills, tasks and technologies: Implications for employment and earnings. In Handbook of labor economics, volume 4, pages 1043–1171. Elsevier, 2011.
  2. [2]Daron Acemoglu and Pascual Restrepo. Automation and new tasks: How technology displaces and reinstates labor. Journal of economic perspectives, 33(2):3–30, 2019.
  3. [3]Mark Aguiar and Erik Hurst. Measuring trends in leisure: the allocation of time over five decades. The quarterly journal of economics, 122(3):969–1006, 2007.
  4. [4]David H Autor, Frank Levy, and Richard J Murnane. The skill content of recent technological change: An empirical exploration. The Quarterly journal of economics, 118(4):1279–1333, 2003.
  5. [5]Saurabh Bhargava and Dayanand Manoli. Psychological frictions and the incomplete take-up of social benefits: Evidence from an IRS field experiment. American Economic Review, 105(11):3489–3529, 2015.DOI
  6. [6]Erik Brynjolfsson, Yu Hu, and Michael D Smith. Consumer surplus in the digital economy: Estimating the value of increased product variety at online booksellers. Management science, 49 (11):1580–1596, 2003.
  7. [7]Bureau of Labor Statistics. American Time Use Survey – 2021 Well-Being Module Microdata Files. Machine-readable data file, 2022. URL https://www.bls.gov/tus/data/wbdatafiles-2021.htm. Accessed: 2026-04-17.
  8. [8]Bureau of Labor Statistics. American Time Use Survey – 2024 Results. Technical report, U.S. Department of Labor, 2025. URL https://www.bls.gov/news.release/pdf/atus.pdf. Accessed: April 16, 2026.
  9. [9]Hongru Cai, Yongqi Li, Wenjie Wang, Fengbin Zhu, Xiaoyu Shen, Wenjie Li, and Tat-Seng Chua. Large language models empowered personalized web agents. In Proceedings of the ACM on Web Conference 2025, WWW ’25, pages 198–215. Association for Computing Machinery, 2025. doi: 10.1145/3696410.3714842. URL https://doi.org/10.1145/3696410.3714842.
  10. [10]Janet Currie. The take up of social benefits, 2004.DOI
  11. [11]Paul Dolfen, Liran Einav, Peter J Klenow, Benjamin Klopack, Jonathan D Levin, Larry Levin, and Wayne Best. Assessing the gains from e-commerce. American Economic Journal: Macroeconomics, 15(1):342–370, 2023.
  12. [12]Amy Finkelstein and Matthew J Notowidigdo. Take-up and targeting: Experimental evidence from SNAP. The Quarterly Journal of Economics, 134(3):1505–1556, 2019.
  13. [13]Kimberly Fisher, Jonathan Gershuny, Sarah M. Flood, Juana Lamote, Liana C. Sayer, Daniel Backman, Etienne Breton, and Stephanie Richards. Multinational Time Use Study Extract System: Version 1.5 [dataset]. Minneapolis, MN: IPUMS, 2025. URL https://doi.org/10.18128/D062.V1.5.
  14. [14]Douglas Gollin, Stephen Parente, and Richard Rogerson. The role of agriculture in development. American economic review, 92(2):160–164, 2002.DOI
  15. [15]Jeremy Greenwood, Ananth Seshadri, and Mehmet Yorukoglu. Engines of liberation. The Review of economic studies, 72(1):109–133, 2005.
  16. [16]Hongliang He, Wenlin Yao, Kaixin Ma, Wenhao Yu, Yong Dai, Hongming Zhang, Zhenzhong Lan, and Dong Yu. WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models. arXiv preprint arXiv:2401.13919, 2024.arxiv.org/abs/2401.13919
  17. [17]Pamela Herd and Donald P Moynihan. Administrative burden: Policymaking by other means. Russell Sage Foundation, 2019.
  18. [18]Berthold Herrendorf, Richard Rogerson, and Akos Valentinyi. Two perspectives on preferences and structural transformation. American Economic Review, 103(7):2752–2789, 2013.
  19. [19]Serin Kim, Sangam Lee, and Dongha Lee. Persona2Web: Benchmarking personalized web agents for contextual reasoning with user history. In Proceedings of the 43rd International Conference on Machine Learning, volume 306 of Proceedings of Machine Learning Research, pages 58276–58303. PMLR, 2026. URL https://proceedings.mlr.press/v306/kim26ap.html.arxiv.org/abs/2602.17003
  20. [20]Xiaopeng Li, Pengyue Jia, Derong Xu, Yi Wen, Yingyi Zhang, Wenlin Zhang, Wanyu Wang, Yichao Wang, Zhaocheng Du, Xiangyang Li, Yong Liu, Huifeng Guo, Ruiming Tang, and Xiangyu Zhao. A Survey of Personalization: From RAG to Agent, 2025. URL https://arxiv.org/abs/2504.10147.
  21. [21]Yuan Liang, Jiaxian Li, Yuqing Wang, Piaohong Wang, Motong Tian, Pai Liu, Shuofei Qiao, Runnan Fang, He Zhu, Ge Zhang, Minghao Liu, Yuchen Eleanor Jiang, Ningyu Zhang, and Wangchunshu Zhou. Towards Personalized Deep Research: Benchmarks and Evaluations, 2026. URL https://arxiv.org/abs/2509.25106.
  22. [22]Shuochen Liu, Junyi Zhu, Long Shu, Junda Lin, Yuhao Chen, Haotian Zhang, Chao Zhang, Derong Xu, Jia Li, Bo Tang, Zhiyu Li, Feiyu Xiong, Enhong Chen, and Tong Xu. PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environments, 2026. URL https://arxiv.org/abs/2603.23231.
  23. [23]National Center for O*NET Development. O*NET OnLine, 2026. URL https://www.onetonline.org/. Accessed: April 16, 2026.
  24. [24]OpenAI. Introducing GPT-5.4. https://openai.com/index/introducing-gpt-5-4/, 2026. Accessed 2026-04.
  25. [25]Tejal Patwardhan, Rachel Dias, Elizabeth Proehl, Jerry Tworek, et al. GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks. arXiv preprint arXiv:2510.04374, 2025. URL https://arxiv.org/abs/2510.04374.
  26. [26]Valerie A Ramey. Time spent in home production in the twentieth-century United States: New estimates from old data. The Journal of Economic History, 69(1):1–47, 2009.DOI
  27. [27]Todd Sinai and Joel Waldfogel. Geography and the Internet: Is the Internet a Substitute or a Complement for Cities? Journal of Urban Economics, 56(1):1–24, 2004.
  28. [29]U.S. Census Bureau. Annual Estimates of the Resident Population for the United States, Regions, States, the District of Columbia, and Puerto Rico: April 1, 2020 to July 1, 2021. Technical Report NST-EST2021-POP, U.S. Department of Commerce, 2021. URL https://www2.census.gov/programs-surveys/popest/tables/2020-2021/state/totals/NST-EST2021-POP.xlsx. Vintage 2021. Accessed: April 16, 2026.
  29. [30]U.S. Census Bureau. Current Population Survey: 2025 Annual Social and Economic Supplement (CPS-ASEC). Public-use microdata, U.S. Department of Commerce, 2025. URL https://www.census.gov/data/datasets/2025/demo/cps/cps-asec-2025.html. Accessed: April 16, 2026.
  30. [31]Hao Wang, Qiyuang Mang, Alvin Cheung, Koushik Sen, and Dawn Song. How We Broke Top AI Agent Benchmarks: And What Comes Next. https://rdi.berkeley.edu/blog/trustworthy-benchmarks-cont/, 2026. Accessed 2026-04.
  31. [32]Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh Jing Hua, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, Yitao Liu, Yiheng Xu, Shuyan Zhou, Silvio Savarese, Caiming Xiong, Victor Zhong, and Tao Yu. OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments, 2024. URL https://arxiv.org/abs/2404.07972.

Paper details

vlnc:W_yuw9dgur
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 10

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents