OpenAI的使命是确保人工一般智能造福全人类。 对于目前每周使用ChatGPT的十多亿人，我们希望建立AI，帮助应对日常生活中的实际挑战，比如寻找儿童保育，获得政府服务，创造预算，准备上学，修改食谱，订购杂货，设计健身计划等。
当有人寻求帮助使他们的生活更加轻松时，他们需要的不仅仅是建议或聊天回应。 要成为真正有帮助的私人助手，ChatGPT应该能够采取实际把事情办好的行动。
为了衡量日常任务的模型性能，我们对用户最需要AI和个人agents帮助的领域进行了任务评价。 我们利用这一评价来跟踪和推动过去一年日常工作模式业绩的改进。
背景情况
为了确定人们最珍视的任务，我们首先开展了两项大型研究，跟踪人们如何在美国和国际上度过时间：美国时间使用调查(在新窗口打开)和多国时间使用研究(在新窗口打开). 这些数据集共同提供了人们在不同人口、白天和季节中完成的日常生活任务的详细目录。 为了了解人们最重视AI援助的地方，我们扩大了这些现有调查，对3 995名答卷者进行了新的具有人口代表性的调查。 对于每项任务，我们提出了各种问题，以确定人们每天最需要个人助理帮助的领域。 由此产生的任务涉及人们需要帮助的最重要领域，包括护理、保健、教育、家庭管理、个人财务、购物和获得政府服务。
单个任务实例
以下是我们目前的模型在日常生活中的实际工作流程中表现的一些例子。
我们最新的模型在很多生命瓦尔任务上得分非常高。
在过去的一年里，我们训练了我们的模型，使其在浏览器使用、计算机使用和连接器任务方面更快、更有能力、更一致。 在 ChatGPT 中实现这些能力，同时也是扩展中实现该模型可以帮助的任务类型，帮助将 ChatGPT 移动到一个聊天工具之外，并成为真正的代理个人助手。
为什么这很重要
为了确保全体人类都受益，我们需要衡量和改进日常生活中重要内容的示范进展。 这意味着超越对模型知识的学术评估，实际上衡量AI模型如何帮助人们导航决策，管理日常责任，并完成有意义的事情。 我们希望LifeVal是朝着这一目标迈出的一步。
本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. For the more than one billion people who currently use ChatGPT every week, we want to build AI that can help with the practical challenges of everyday life, like finding childcare, accessing government services, creating a budget, preparing for school, modifying recipes, ordering groceries, designing workout plans, and more.
When someone is looking for help making their life easier, they need more than advice or a chat response. To be a truly helpful personal assistant, ChatGPT should be able to take actions that actually get things done.
To measure model performance over time on everyday tasks, we built an evaluation of tasks covering areas where users wanted the most help from AI and personal agents. We used this evaluation to track and drive improvement in model performance on everyday tasks over the past year.
Background
To identify the tasks people value most, we started with two large studies that track how people spend time in both the U.S. and internationally: the American Time Use Survey(opens in a new window) and the Multinational Time Use Study(opens in a new window). Together, these datasets provide a detailed catalog of everyday life tasks that people do across different demographics, times of day, and seasons. To understand where people would most value AI assistance, we expanded on these existing surveys with a new demographically representative survey of 3,995 respondents. For each task, we asked a variety of questions to identify the areas where everyday people most wanted help from a personal assistant. The resulting tasks span the most important areas that people want help with, including caregiving, health, education, household administration, personal finances, shopping, and accessing government services.
Individual task examples
Below are some examples of how our current models perform on practical workflows from everyday life.
Our latest models score very highly on many LifeVal tasks.
Over the past year, we’ve trained our models to become much faster, more capable, and more aligned on browser use, computer use, and connectors tasks. Enabling these capabilities in ChatGPT also expands the types of tasks the model can help with, helping move ChatGPT beyond a chat tool and towards a truly agentic personal assistant.
Why this matters
To ensure AGI benefits all of humanity, we need to measure and improve model progress on what matters in the lives of everyday people. That means going beyond academic assessments of model knowledge and actually measuring how well AI models can help people navigate decisions, manage everyday responsibilities, and get meaningful things done. We are hopeful that LifeVal represents a step towards that goal.
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.