一本道

20 June 2024

How do you develop a product with as little human involvement as possible? LiU students built a robot using generative artificial intelligence.

Female PhD student lectures to master's students in the lab. Photographer: Thor Balkhed
male student with robot.
Master鈥檚 student Arad Jafari has worked on the programming of the robot. Photo credit: Thor Balkhed

From an initial idea with AI-generated images to the final stages of optimisation. Generative AI (GAI) supported the students throughout the design process.

鈥淚 mainly used ChatGPT to program the robot鈥檚 navigation and control,鈥 says Arad Jafari, master鈥檚 student in technical design.

Programming

The robot is similar to a radio-controlled car, with a small arm and a grapple claw in the front. With the sensors, it is able to drive along a lined path and stop in the designated place, pick up a small box and transport it further.

鈥淚鈥檝e always been interested in programming, but my knowledge has been limited. Both my interest and my skills have increased with this project. Robotics and coding were new to me. In addition to the help I have received from the AI, ChatGPT has also acted as a digital mentor,鈥 says Arad Jafari.

How did that work in practice?

鈥淔or instance, we received AI support with brainstorming and various solutions to the requirements we have on the robot. What electronic components are needed? How do the components work and how should they be connected? Here, ChatGPT has helped generate all the code for the different solutions.鈥

Robot moving ona predestined track.
The robot is programmed for following a track and stop for lifting a box. Photo credit: Thor Balkhed

The task they faced on the course 鈥楧esign and production鈥 was to develop a so-called proof of concept, i.e. to prove that something is feasible, in this case by designing, constructing and programming using generative AI 鈥 and without too much prior knowledge.

The students麓 curiosity

The students were supported by a doctoral student and an external supervisor from the forklift manufacturer Toyota Material Handling. Their supervisor Tomas Jankauskas, senior designer, explains why the industry needs to cooperate with LiU:

鈥淲e risk turning into dinosaurs if we don鈥檛 take advantage of the students鈥 curiosity. They represent the future. I鈥檝e given them a framework and provided advice, but the students have been the driving force in this project,鈥 he says.

Tre manliga studenter i labbet.

Master鈥檚 students Vivaldus Berglund, Fredrik Jarl and Ville Jonsson examining the components of the robot they built using AI. Photo credit: Thor Balkhed

By asking questions to the Open AI tools and a number of other tools (such as ChatGPT, Vizcom and others), they have designed a vehicle with an open chassis in futuristic style. With the help of AI, they have also received assembly instructions. To attach the chassis, they had to make small adjustments manually. But they have basically gone from AI-generated images and 3D models on the screen to 3D printing on the spot. It was difficult in the beginning.

Challenges

Photo credit: Thor Balkhed

鈥淭here were products that had three wheels on one side and two wheels on the other. Or an arm that didn鈥檛 reach over the hood. A lot that didn鈥檛 work. The advantage is that it鈥檚 a quick process, so you can fail several times. The difficulty lies in deciding what to move forward with,鈥 says Vivaldus Berglund.

Do you have any tips on how to write questions to an AI?

鈥淲e saw that you can ask the AI how best to type a prompt to achieve a certain result. This made the final prompt much better. Another tip is to be specific. The AI will look up shapes based on what it thinks we mean,鈥 says Ville Jonsson.

Why is it important to try to get AI to do the whole job?

鈥淒rawing and programming takes time and costs money. If a manufacturer discovers that it鈥檚 possible to automate, that鈥檚 of course interesting,鈥 says Johan Asp.

But doctoral student Elena Jim茅nez Romanillos objects:

You need to monitor the whole process very carefully and reflect.

鈥淵ou need to monitor the whole process very carefully and reflect. You have to understand what is happening all the time and spot the mistakes. Otherwise, you鈥檒l lose all the efficiency improvements that can occur with AI,鈥 she says.

At the same time, the project will be turned into research. Associate Professor Torbj枚rn Andersson and Elena Jim茅nez Romanillos study methods for learning using AI. They note that these tools are changing the way students approach different design challenges.

Female  PHD-student.
PhD-student Elena Jim茅nez Romanillos. Photo credit: Thor Balkhed

鈥淚t鈥檚 about how you take facts into account, see connections, draw your own conclusions, evaluate and finally produce and create something new" says Elena Jim茅nez Romanillos. "For example, the use of AI varies depending on the students鈥 prior knowledge,鈥

鈥淎rtificial intelligence in the learning process is still a new thing. It鈥檚 interesting to see how students search for information and discover completely new tools, almost day by day,鈥 says Torbj枚rn Andersson.

Exhibition

The students and teachers participated in Milan Design week, 15鈥21 April 2024, together with Toyota鈥檚 exhibitors. They promoted the MSc Programme in Design and Product Development, and shared their experiences of programming and designing using generative artificial intelligence.

Design process using generative artificial intelligence (GAI)

New tools are being developed all the time. Here are some that were used in this process

1. Brainstorming phase

Open AI’s GPT and various image generation tools produced a variety of concepts. The rapid results of AI facilitate repetitive tasks and expand the creative process.

2. Concept development

Vizcom, a creative design tool, was used to refine and add details to visual concepts. The result was uploaded to the CSM/Common Sense Machine tool that converts images into 3D models.

3. GAI in modelling and optimisation

Tools such as Blender and Fusion 360 were used to refine the 3D model. Fusion 360's GAI capability was used to define volumes within the robot's component placement design. This also optimised the shape to provide increased strength with reduced weight.

Eduactional program that covers the entire product development cycle

Contact

More about AI at LiU

Latest news from LiU

A woman in a yellow lab coat and blue gloves.

Dysregulated immune cells cause silent inflammation after heart attack

People with narrowing of the coronary arteries have low-grade, uncontrolled inflammation in the body, even when symptom-free. The findings suggest that some immune cells drive a silent inflammation that may increase the risk of further heart attacks.

En grupp m盲nniskor som sitter vid ett bord framf枚r en folkmassa.

Participants in UN climate meetings want greater focus on implementation

UN climate negotiations are often criticised for moving too slowly. A new study published in Nature Climate Change examines what changes government delegates and other participants at the COP29 UN climate conference would like to see.

Neil Lagali vid utrustning f枚r att unders枚ka 枚gonen.

Eye problems after COVID-19 can now be explained

Mild COVID-19 can cause severe and long-lasting eye problems, according to a study from LiU. The study also explains why it has been difficult for sufferers to get help: the abnormal eye behaviour cannot be detected by standard methods.