Skip to content

Commit 8fc2708

Browse files
gaojie058claude
andauthored
Rework Scope, CFP, and advisory board content (#10)
- Reframe Scope around three levels (agent, human, interaction) with refreshed questions and a new color palette per topic - Restructure CFP categories into named blocks with example lists and drop the Special Track in favor of NeurIPS-review resubmission guidance - Add lead advisor Ziang Xiao to the inline advisory list and simplify the board note; link program committee members - Standardize "people" -> "humans" phrasing across About and Scope - Add .eg-list styling for CFP example bullets Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent b7dc759 commit 8fc2708

3 files changed

Lines changed: 107 additions & 74 deletions

File tree

src/App.jsx

Lines changed: 25 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,5 @@
11
import { Fragment, useEffect, useState } from 'react';
22
import heroImage from '../img/hero.png';
3-
import Avatar from './components/Avatar';
43
import Navigation from './components/Navigation';
54
import PersonCard from './components/PersonCard';
65
import TopicIcon from './components/TopicIcon';
@@ -14,7 +13,6 @@ import {
1413
openReviewUrl,
1514
programCommittee,
1615
schedule,
17-
specialTrack,
1816
speakerSection,
1917
submissionDeadline,
2018
submissionDeadlineLabel,
@@ -24,7 +22,6 @@ import {
2422

2523
const speakers = getPeopleByRole(PERSON_ROLE.SPEAKER);
2624
const organizers = getPeopleByRole(PERSON_ROLE.ORGANIZER);
27-
const [leadAdvisor] = getPeopleByRole(PERSON_ROLE.ADVISOR);
2825

2926
function Hero() {
3027
return (
@@ -60,17 +57,17 @@ function About() {
6057
<p className="line">Humans cannot read through thousands of log entries.</p>
6158
<p className="line">They need patterns, summaries, and explanations, in other words <em>interpretation</em>.</p>
6259
<p className="line">But we do not yet know how to <em>generate it at scale</em>.</p>
63-
<p className="line">Our aim with <em>IAB</em> is to turn agent runtime data into human understanding of what agents do and how people work with them.</p>
60+
<p className="line">Our aim with <em>IAB</em> is to turn agent runtime data into human understanding of what agents do and how humans work with them.</p>
6461
</div>
6562
<div className="about-content">
6663
<p>
67-
Commercial autonomous agents such as Claude and Codex now run for hours or even days to complete tasks, and along the way they show complex behavior: they plan, reason, use tools, recover from errors, coordinate with subagents, and communicate with users. We use the word <em>behavior</em>, as in the study of human behavior, for the full range of what an agent does during runtime. This behavior spans <span className="uline">three levels: what agents do and how they do it, what people do in response, and how the two work together</span> through instructions and corrections. All three generate vast behavioral data such as execution logs and interaction traces. Yet existing approaches read this data largely for outcomes: benchmarks tell us <em>whether</em> an agent succeeds or fails, <span className="uline">but not <em>what</em> it did or <em>how</em> it did it</span>.
64+
Commercial autonomous agents such as Claude and Codex now run for hours or even days to complete tasks, and along the way they show complex behavior: they plan, reason, use tools, recover from errors, coordinate with subagents, and communicate with users. We use the word <em>behavior</em>, as in the study of human behavior, for the full range of what an agent does during runtime. This behavior spans <span className="uline">three levels: what agents do and how they do it, what humans do in response, and how the two work together</span> through instructions and corrections. All three generate vast behavioral data such as execution logs and interaction traces. Yet existing approaches read this data largely for outcomes: benchmarks tell us <em>whether</em> an agent succeeds or fails, <span className="uline">but not <em>what</em> it did or <em>how</em> it did it</span>.
6865
</p>
6966
<p>
7067
Understanding <em>what</em> and <em>how</em> is what people actually need. It lets agent developers and model trainers debug failures, compare architectures, and filter training data; it lets agent users and deployment engineers watch production agents to understand safety, cost, and reliability risks. For agentic models, the trajectory is both the training data and what the reward scores. Interpreting it therefore sits inside the training loop, deciding which rollouts are safe to reinforce and flagging reward that reflects a verifier exploit rather than real skill. But the field still <span className="uline">lacks the vocabulary, methods, and tools to describe and analyze agent behavior at scale</span>. Humans cannot read through thousands of log entries; they need patterns, summaries, and explanations, in other words <span className="uline"><em>interpretation</em></span>, and we do not yet know how to scale it.
7168
</p>
7269
<p>
73-
<strong>IAB works toward an interpretive science of agent behavior.</strong> It treats behavior across these three levels as the object of study and proceeds in two steps: first gathering the community to identify the problem space and emerging challenges, then bringing the broad set of methods that social scientists have developedgrounded theory, qualitative analysis, error analysis, corpus analysis, trace analysis, and red-teaming to read meaning from this data, discover categories from it, and count them. <span className="uline">IAB bridges two communities: social science and HCI contribute the interpretation methods, while AI contributes the problem space</span> of evaluation, governance, alignment, and responsible AI.
70+
<strong>IAB works toward an interpretive science of agent behavior.</strong> It treats behavior across these three levels as the object of study and proceeds in two steps: first gathering the community to identify the problem space and emerging challenges, then bringing the broad set of methods that social scientists have developed, such as grounded theory, qualitative analysis, error analysis, corpus analysis, trace analysis, and red-teaming, to read meaning from this data, discover categories from it, and count them. <span className="uline">IAB bridges two communities: social science and HCI contribute the interpretation methods, while AI contributes the problem space</span> of evaluation, governance, alignment, and responsible AI.
7471
</p>
7572
<p className="paper-callout">
7673
Read our recent paper{' '}
@@ -110,14 +107,13 @@ function Scope() {
110107
<section id="topics" className="alt">
111108
<div className="container">
112109
<h2>Scope</h2>
113-
<p className="lead">IAB studies agent behavior across three levels, asking three questions.</p>
110+
<p className="lead">IAB studies agent behavior at three levels: the agent, the human, and their interaction. At each level we ask what happens and how.</p>
114111
<div className="topics-grid">
115112
{topics.map((topic) => (
116113
<article className="topic-card" key={topic.type}>
117114
<h3>
118115
<TopicIcon type={topic.type} color={topic.color} />
119-
<span style={{ color: topic.color }}>{topic.label}</span>
120-
<span>{topic.question}</span>
116+
<span><span style={{ color: topic.color }}>{topic.label}</span>: {topic.question}</span>
121117
</h3>
122118
<ul>{topic.items.map((item) => <li key={item}>{item}</li>)}</ul>
123119
</article>
@@ -174,24 +170,32 @@ function Schedule() {
174170
);
175171
}
176172

173+
function CfpCategoryItem({ category }) {
174+
const { name, description, examples } = category;
175+
return (
176+
<li>
177+
<strong>{name}:</strong> {description}
178+
{examples?.length ? (
179+
<ul className="eg-list">
180+
{examples.map((example) => <li key={example}>{example}</li>)}
181+
</ul>
182+
) : null}
183+
</li>
184+
);
185+
}
186+
177187
function CallForPapers() {
178188
return (
179189
<section id="cfp">
180190
<div className="container">
181191
<h2>Call for Papers</h2>
182192

183193
<h3 className="cfp-heading">Topics</h3>
184-
<p className="lead">We call for non-archival submissions on understanding agent behavior. We welcome work that helps us understand what agents do and why, including but not limited to:</p>
194+
<p className="lead">We call for non-archival submissions on understanding agent behavior. Work can address any level of our <a href="#topics">Scope</a> (what agents do, what humans do in response, or how the two interact). Specific topics include, but are not limited to:</p>
185195
<ul className="lead-list">
186-
{cfpCategories.map(([name, description, example]) => (
187-
<li key={name}><strong>{name}:</strong> {description} <span className="eg">{example}</span></li>
188-
))}
196+
{cfpCategories.map((category) => <CfpCategoryItem key={category.name} category={category} />)}
189197
</ul>
190-
<div className="special-track">
191-
<h4>This year, we have a <span className="st-hl">Special Track</span>: {specialTrack.heading}</h4>
192-
<p>{specialTrack.body}</p>
193-
</div>
194-
<p className="lead">We also encourage negative results and methodological position papers.</p>
198+
<p className="lead">We also welcome negative results and methodological position papers. NeurIPS-rejected papers may be resubmitted with their reviews, and we will decide on acceptance ourselves. NeurIPS-accepted papers that want more visibility are also welcome to resubmit with their reviews.</p>
195199

196200
<h3 className="cfp-heading">Submission Format</h3>
197201
<div className="cfp-formats">
@@ -280,15 +284,6 @@ function Countdown() {
280284
);
281285
}
282286

283-
function PersonInline({ person }) {
284-
return (
285-
<span className="person-inline">
286-
<Avatar avatar={person.avatar} name={person.name} />
287-
<a href={person.url} target="_blank" rel="noopener noreferrer">{person.name}</a>
288-
</span>
289-
);
290-
}
291-
292287
function InlinePeople({ people, linked = false }) {
293288
return people.map(([name, affiliation, url], index) => (
294289
<span key={name}>
@@ -308,16 +303,13 @@ function Organizers() {
308303
</div>
309304
<div className="adv">
310305
<h3>Advisory Board</h3>
311-
<p>
312-
We specially thank <PersonInline person={leadAdvisor} /> for the advising, and other senior
313-
collaborators and senior researchers for their insightful discussions,
314-
including <InlinePeople people={advisors} linked />.
315-
</p>
306+
<p className="adv-note">We thank the faculty and senior researchers who advise and support this workshop.</p>
307+
<p><InlinePeople people={advisors} linked /></p>
316308
</div>
317309
<div className="adv">
318310
<h3>Program Committee</h3>
319311
<p className="adv-note">We thank our program committee members from the NLP, HCI, and ML systems communities.</p>
320-
<p><InlinePeople people={programCommittee} /></p>
312+
<p><InlinePeople people={programCommittee} linked /></p>
321313
</div>
322314
</div>
323315
</section>

0 commit comments

Comments
 (0)