Many emerging robotics applications require the use of multiple collaborating robots to operate under human supervision. To be useful in such applications, robots will need to act as smart assistants by automatically selecting actions, efficiently learning from the observed performance, safely operating in the presence of uncertainty, and appropriately calling for help during the execution of challenging tasks. Our group is making advances in physics-aware artificial intelligence that are being used to enable robots to automatically make decisions to meet the aforementioned requirements. Our research focuses on: