Continually Self-Improving Robots

Workshop at CoRL 2026 · November 12, 2026 · Austin, Texas

Room 202, JW Marriott Austin

Introduction

Developing general-purpose robots capable of autonomously performing diverse tasks in unstructured environments remains a central challenge in robotics. Recent demonstration-driven approaches, including learning from teleoperated robot demonstrations and human video demonstrations, have provided robots with strong behavioral priors and capable initial policies. However, imitation alone is unlikely to close the gap between broad initial competence and reliable performance across the long tail of real-world tasks, objects, and environments. Robots must improve beyond their demonstrated experience: autonomously collecting data, discovering failures, adapting to new situations, and refining their skills through interaction.

This workshop advocates for an era of experiences in robot learning, where robots continually expand their capabilities by interacting with the world. We aim to bring together researchers across robot learning, reinforcement learning, and continual learning to define the algorithmic and systems-level foundations for self-improving robots.

Invited Speakers

Abhishek Gupta headshot
AG

Abhishek Gupta

UW & Amazon FAR

Kay Ke headshot
KK

Kay Ke

Physical Intelligence

Jeff Clune headshot
JC

Jeff Clune

UBC & Recursive

Jason Ma headshot
JM

Jason Ma

Dyna

Pete Florence headshot
PF

Pete Florence

Generalist

Accepted Papers

Explore the accepted contributions to CSIR 2026. Papers will be presented through student spotlights and posters, with paper awards recognizing outstanding research contributions.

View Accepted Papers on OpenReview

Selected Spotlight Papers

09:05–09:30 · Five talks · 5 minutes each

  1. –

    Test-Time Gradient Guidance of Flow Policies in Reinforcement Learning

  2. –

    WEAVER, Better, Faster, Longer: An Effective World Model for Robotic Manipulation

  3. –

    Autonomous Functional Play with Correspondence-Driven Trajectory Warping

  4. –

    Language to Design (L2D): Towards Self-Evolving Robots

  5. –

    EqC: Equilibrium Energy Control for Introspective Lifelong Robot Learning

Archived Call for Papers

Submissions are closed · Archived for reference

Call for Papers

We invited contributions that introduce theoretical frameworks, experimental findings, or applications that advance autonomous robot learning and self-improvement.

Submission deadline September 28, 2026 · 11:59 PM AoE

Submission Guidelines

Template Any paper template

Authors may use any academic paper template.

Length Up to 8 pages

References and the appendix do not count toward the page limit.

Review Double-blind

Remove author names, affiliations, and other identifying information.

Publication Non-archival

Accepted papers will not appear in archival proceedings.

Topics of Interest

Robot self-improvement, continual robot learning, RL for robotics, autonomous data collection, failure discovery, safe exploration, world models, in-context robot learning, real-to-sim-to-real transfer, automatic reset systems, and reliable evaluation environments.

Presentation & Participation

Accepted papers will be presented through student spotlights and posters. Paper awards will be presented to recognize outstanding research contributions.

Schedule

Workshop location: Room 202, JW Marriott Austin

Time
Session
Details
08:30–08:40
Opening
Opening remarks by organizers
08:40–09:05
Invited Talk
Abhishek Gupta
09:05–09:30
Student Spotlight
View spotlight papers
09:30–09:55
Invited Talk
Jason Ma
09:55–10:35
Breakout Session
10:35–11:05
Break & Poster Session
Griffin (Level 2), JW2-1-1 to JW2-10-1
11:05–11:30
Invited Talk
Jeff Clune
11:30–11:55
Invited Talk
Pete Florence
11:55–12:20
Invited Talk
Kay Ke
12:20–12:30
Closing
Awards & closing summary

With support from

Our Sponsors

We gratefully acknowledge the organizations supporting CSIR 2026.

Organizers

Annie Xie headshot
AX

Annie Xie

Google DeepMind

Mengdi Xu headshot
MX

Mengdi Xu

Tsinghua University

xumd@mail.tsinghua.edu.cn

Advisory Board

Peter Stone headshot
PS

Peter Stone

UT Austin & Sony AI

Jie Tan headshot
JT

Jie Tan

Google DeepMind