PackIt: A Virtual Environment for Geometric Planning

07/21/2020
by   Ankit Goyal, et al.
12

The ability to jointly understand the geometry of objects and plan actions for manipulating them is crucial for intelligent agents. We refer to this ability as geometric planning. Recently, many interactive environments have been proposed to evaluate intelligent agents on various skills, however, none of them cater to the needs of geometric planning. We present PackIt, a virtual environment to evaluate and potentially learn the ability to do geometric planning, where an agent needs to take a sequence of actions to pack a set of objects into a box with limited space. We also construct a set of challenging packing tasks using an evolutionary algorithm. Further, we study various baselines for the task that include model-free learning-based and heuristic-based methods, as well as search-based optimization methods that assume access to the model of the environment. Code and data are available at https://github.com/princeton-vl/PackIt.

READ FULL TEXT
research
05/23/2017

Visual Semantic Planning using Deep Successor Representations

A crucial capability of real-world intelligent agents is their ability t...
research
07/27/2022

Break and Make: Interactive Structural Understanding Using LEGO Bricks

Visual understanding of geometric structures with complex spatial relati...
research
09/06/2018

Planning with Arithmetic and Geometric Attributes

A desirable property of an intelligent agent is its ability to understan...
research
06/06/2023

Agents Explore the Environment Beyond Good Actions to Improve Their Model for Better Decisions

Improving the decision-making capabilities of agents is a key challenge ...
research
11/22/2021

Hybrid Imitative Planning with Geometric and Predictive Costs in Off-road Environments

Geometric methods for solving open-world off-road navigation tasks, by l...
research
06/22/2020

SN-Engine, a Scale-free Geometric Modelling Environment

We present a new scale-free geometric modelling environment designed by ...
research
02/09/2022

Task Modifiers for HTN Planning and Acting

The ability of an agent to change its objectives in response to unexpect...

Please sign up or login with your details

Forgot password? Click here to reset