Video Friday: ChatGPT for Robotics

Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrumrobotics. We also post a weekly calendar of upcoming robotics events over the next few months. Please send us your events to be included.

HRI 2023: 13–16 March 2023, STOCKHOLM
Robotics Summit & Expo: 10–11 May 2023, BOSTON
ICRA 2023: 29 May–2 June 2023, LONDON
RoboCup 2023: 4–10 July 2023, BORDEAUX, FRANCE
RSS 2023: 10–14 July 2023, DAEGU, KOREA
IEEE RO-MAN 2023: 28–31 August 2023, BUSAN, KOREA
CLAWAR 2023: 2–4 October 2023, FLORIANOPOLIS, BRAZIL

Enjoy today’s videos!

Do you want to tell a robot what to do with words? Our team at Microsoft introduces a new paradigm for language-based robotics, powered by ChatGPT. Our recent paper “ChatGPT for Robotics” describes a series of design principles that can be used to guide ChatGPT towards solving robotics tasks. In this video, we present a summary of our ideas, and experimental results from some of the many scenarios that ChatGPT can perform in the domain of robotics: such as manipulation, aerial navigation, even full perception -action loops. Our goal is to empower even non-technical users to use the full potential of robotics using ChatGPT.

[ Microsoft ]

Where we see the moderate progress made by Tesla in his humanoid robot (including a questionable cut video of some manipulation), followed by Musk saying some things.

[ Tesla ]

It is very important to know in advance the dangerous situation at the rescue site, so the emergency rescue robot was created.

[ Unitree ]

The hairy caterpillar is a bug that poses a serious threat to daily life in the Maldives, where it damages the local Indian Almond tree, a critical species at the heart of the islands’ ecosystem. DJI Agriculture’s T30 spraying drones have been deployed in a series of groundbreaking entomological projects, and have been shown to be effective in protecting against hairy caterpillars, with minimal pesticide use.

[ DJI ]

Don’t get tired of watching it.

[ JPL ]

Teleoperation creates a unique opportunity for experts to incorporate general purpose robots and offer their services on a global scale.

[ Sanctuary ]

The qualification video for the RoboCup 2023 in Bordeaux, France of the Middle Size League team, Tech United Eindhoven.

[ Tech United ]

New year, new look for our test fleet! We are launching a new design in our test cars.

[ Zoox ]

TRI uses AI technology to augment and enhance human capabilities to advance its mission of achieving carbon neutrality, driving future product innovations, and creating harmonious communities for the goal of Toyota “joy for all.”

[ TRI ]

Pranali Desai and Jamie Barnes, software engineers at Torc Robotics, talk about their experiences navigating the male-dominated workplace.

[ Torc Robotics ]

Athena 3D is a leading additive manufacturing service bureau located in Tempe, AZ, that prints parts on demand. The printers run according to programmed specifications, and as jobs are completed (many times at 3:00 a.m.), the cobot removes the print bed, places it in a storage rack, and places a clean print bed back to the printer. The Application Programming Interface (API) then communicates with the printer to start the next job.

[ Fanuc ]

Robotic leg prostheses – the future of assistive technology or a step too far? Powered leg prostheses make walking, climbing stairs and navigating obstacles easier for users. But despite their promise, robotic legs remain elusive. Do you have a winning design? Register now to take part in our CYBATHLON Challenges, which will take place in March 2023.

[ Cybathlon ]

A robotic workcell that can pack new and irregular 3D objects, and uses vision and tactile sensing to adjust for errors encountered during packing. 99/100 5-item packing test successful in these tests.

[ IML ]

Work on the ANT guidance, navigation, and control system for the future planetary exploration walking system has been completed. The final tests proved its capabilities on uneven, unstructured, and inclined terrains. Visual foothold adaptation can rely on a highly constant and unbiased pose estimate and an up-to-date map. Therefore, contact information is added to the map to include the changed surface structures. Additionally, a load bearing assessment can be performed to evaluate the stability of the next foothold before relying on it. In this way, a stable recovery from collapsed rock formations is possible, which will increase the safety of future exploration missions on foot.

[ DFKI ]

Hod Lipson is the James and Sally Scapa Professor of Innovation in the Department of Mechanical Engineering. He is a roboticist working in the areas of artificial intelligence and digital manufacturing, designing and building robots with his students that do what you wouldn’t expect robots to do: Self-replication, self-reflection, questioning, and even creation.

[ Columbia ]

Auro from Ridecell introduces the Empty Vehicle Automation feature for car sharing – where an empty vehicle (with no passengers inside) repositions itself autonomously to be in an easily accessible location location for the next ride.

[ Auro ]

Founded in 2014, Verity delivers fully autonomous indoor drone systems that are trusted in environments where failure is not an option. Based in Zurich, Switzerland, with global operations, the Verity system is used to complete thousands of fully autonomous inventory checks every day in warehouses everywhere.
We are happy to be a part of Amazon Web Services (AWS) Swiss Cloud Day! Verity’s CEO, Raffaello D’Andrea, shared the stage among other speakers.

[ Verity ]

In the ALMI project funded by the Assuring Autonomy International Programme, the University of YORK and PAL Robotics focus on the development of adaptive methods that can help care for the TIAGo robot to cope with uncertainty and disturbances that cannot be avoided in a home environment. In this solution, the TIAGo robot uses its speech interaction and object manipulation capabilities to assist a user with mild motor and cognitive disabilities in the daily activities of preparing a food, including reacting to emergency situations. To achieve this, we created a similar representation of the environment that the TIAGo robot operates in the kitchen by using the Gazebo simulator.

[ PAL Robotics ]

This Spring 2022 GRASP Industry Talk from Mujin, Inc, titled “We’re All About Robotics.”

Mujin started in 2011 in Tokyo, with founding members from the USA, Japan, and China. Since our small start from the bicycle garage (40 m2), we have grown into the largest robotics lab in Tokyo (14,000 m2) through innovation and focus on quality. Mujin helped Chinese e-commerce giant JD.com build the world’s first fully automated logistics warehouse in 2017, and is now partnering with companies such as Uniqlo, Accenture, and others to automate logistics and manufacturing worldwide.

[ Mujin ]

Leave a Comment