From an initial idea with AI-generated images to the final stages of optimisation. Generative AI (GAI) supported the students throughout the design process.
鈥淚 mainly used ChatGPT to program the robot鈥檚 navigation and control,鈥 says Arad Jafari, master鈥檚 student in technical design.
Programming
The robot is similar to a radio-controlled car, with a small arm and a grapple claw in the front. With the sensors, it is able to drive along a lined path and stop in the designated place, pick up a small box and transport it further.
鈥淚鈥檝e always been interested in programming, but my knowledge has been limited. Both my interest and my skills have increased with this project. Robotics and coding were new to me. In addition to the help I have received from the AI, ChatGPT has also acted as a digital mentor,鈥 says Arad Jafari.
How did that work in practice?
鈥淔or instance, we received AI support with brainstorming and various solutions to the requirements we have on the robot. What electronic components are needed? How do the components work and how should they be connected? Here, ChatGPT has helped generate all the code for the different solutions.鈥
The task they faced on the course 鈥楧esign and production鈥 was to develop a so-called proof of concept, i.e. to prove that something is feasible, in this case by designing, constructing and programming using generative AI 鈥 and without too much prior knowledge.
The students麓 curiosity
The students were supported by a doctoral student and an external supervisor from the forklift manufacturer Toyota Material Handling. Their supervisor Tomas Jankauskas, senior designer, explains why the industry needs to cooperate with LiU:
鈥淲e risk turning into dinosaurs if we don鈥檛 take advantage of the students鈥 curiosity. They represent the future. I鈥檝e given them a framework and provided advice, but the students have been the driving force in this project,鈥 he says.
By asking questions to the Open AI tools and a number of other tools (such as ChatGPT, Vizcom and others), they have designed a vehicle with an open chassis in futuristic style. With the help of AI, they have also received assembly instructions. To attach the chassis, they had to make small adjustments manually. But they have basically gone from AI-generated images and 3D models on the screen to 3D printing on the spot. It was difficult in the beginning.
Challenges
鈥淭here were products that had three wheels on one side and two wheels on the other. Or an arm that didn鈥檛 reach over the hood. A lot that didn鈥檛 work. The advantage is that it鈥檚 a quick process, so you can fail several times. The difficulty lies in deciding what to move forward with,鈥 says Vivaldus Berglund.
Do you have any tips on how to write questions to an AI?
鈥淲e saw that you can ask the AI how best to type a prompt to achieve a certain result. This made the final prompt much better. Another tip is to be specific. The AI will look up shapes based on what it thinks we mean,鈥 says Ville Jonsson.
Why is it important to try to get AI to do the whole job?
鈥淒rawing and programming takes time and costs money. If a manufacturer discovers that it鈥檚 possible to automate, that鈥檚 of course interesting,鈥 says Johan Asp.
But doctoral student Elena Jim茅nez Romanillos objects:
You need to monitor the whole process very carefully and reflect.
鈥淵ou need to monitor the whole process very carefully and reflect. You have to understand what is happening all the time and spot the mistakes. Otherwise, you鈥檒l lose all the efficiency improvements that can occur with AI,鈥 she says.
At the same time, the project will be turned into research. Associate Professor Torbj枚rn Andersson and Elena Jim茅nez Romanillos study methods for learning using AI. They note that these tools are changing the way students approach different design challenges.
鈥淚t鈥檚 about how you take facts into account, see connections, draw your own conclusions, evaluate and finally produce and create something new"
says Elena Jim茅nez Romanillos. "For example, the use of AI varies depending on the students鈥 prior knowledge,鈥
鈥淎rtificial intelligence in the learning process is still a new thing. It鈥檚 interesting to see how students search for information and discover completely new tools, almost day by day,鈥 says Torbj枚rn Andersson.
Exhibition
The students and teachers participated in Milan Design week, 15鈥21 April 2024, together with Toyota鈥檚 exhibitors. They promoted the MSc Programme in Design and Product Development, and shared their experiences of programming and designing using generative artificial intelligence.