一本道

28 June 2023

It is already possible to perform part of the autopsy with the assistance of mixed reality, and fully digital autopsies might be achieved in the future. In the long term, this technology could render autopsies more efficient and legally certain, and also have uses in training and collaborations.

Portait of Lonni Besan莽on. Photographer: Thor Balkhed
Lonni Besançon, assistant professor in the Division of Media and Information Technology at 一本道 University.

鈥淭here are some things you can鈥檛 do digitally, such as weighing organs. But our tool could be a complement to real autopsies and a step towards eventually not having to cut into the body at all,鈥 says Lonni Besan莽on, assistant professor in the Division of Media and Information Technology at Link枚ping University.

Autopsies are performed by a physician to determine the cause of death and consist of a medical examination of the body and its organs. In Sweden there are two types of autopsies: clinical and forensic.

Clinical autopsies are carried out to gain important knowledge about various diseases and possible treatments. Around five per cent of all deceased persons undergo a clinical autopsy. A forensic autopsy is carried out when there is suspicion of crimes such as murder or manslaughter. But also in cases of deaths caused by accidents, suicide or medical malpractice.

Immersive visualisation

Forensic autopsies are required by law. But in the case of clinical autopsies, religious convictions or a no from a next of kin may result in the non-performance of an autopsy and the risk of losing important knowledge. There are also several challenges related to the autopsy itself.Hand infront of screen with digital autopsy. The digital tool is controlled by hand movements.
Photo credit Thor Balkhed

鈥淭he pathologist often has to compare their findings with both the police reports and the blood test results while at the same time making notes and checking CT scans. This means that they need to take off their gloves and wash their hands several times, which is inefficient,鈥 says Lonni Besan莽on.

This is why he, together with researchers at Monash University and the University of Queensland in Australia, examined the possibility of using so-called immersive visualisation technology to create a mixed reality in the autopsy room. The idea is that digital technology will facilitate physicians鈥 work.

Controlled by hand movements

A major advantage is that digital autopsies can be performed several times over, which means that they can be shown in the court room as well as to colleagues online. But the researchers also see great potential in using the technology in teaching medical students.

By using information from CT scans, it is possible to build a virtual model of the deceased body. In the autopsy room, the physician has the real body in front of them, but wears a headset over their eyes making it possible to see a digital overlay, with a digital version of the body and a menu controlled by hand movements.Digital autopsy seen through hololens.By using information from CT scans, it is possible to build a virtual model of the deceased body. Photo credit Thor Balkhed The menu also contains masses of information that would not have been able to fit on a 2D screen simultaneously, such as reports and traditional CT scans. It is also possible to view different parts of the body layer by layer in 3D and perform certain tasks digitally, such as for instance measure various body parts.

Three to five years

This technology was developed in collaboration with autopsy technicians at the Victorian Institute of Forensic Medicine in Australia, who were asked to explain their needs and provide continuous feedback on the performance of the technology. But according to Lonni Besan莽on it will be a few more years before the technology becomes generally available in the field.

鈥淚 think that within three to five years, if the new headsets perform better than current ones, pathologists will be able to work with a hybrid solution,鈥 he says.

The next step of this research is to continue working on facilitating report writing and making it possible to integrate it with the autopsy. By for instance taking a screen shot from the headset and then delivering a verbal report, a written report can be generated automatically.

The article: ; Vahid Pooryousef, Maxime Cordeil, Lonni Besan莽on, Christophe Hurter, Tim Dwyer, and Richard Bassed. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI 鈥23), April 23鈥28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 15 pages. DOI: 10.1145/3544548.3580768

Contact

More visualisation research

Latest news from LiU

En grupp m盲nniskor som sitter vid ett bord framf枚r en folkmassa.

Participants in UN climate meetings want greater focus on implementation

UN climate negotiations are often criticised for moving too slowly. A new study published in Nature Climate Change examines what changes government delegates and other participants at the COP29 UN climate conference would like to see.

Neil Lagali vid utrustning f枚r att unders枚ka 枚gonen.

Eye problems after COVID-19 can now be explained

Mild COVID-19 can cause severe and long-lasting eye problems, according to a study from LiU. The study also explains why it has been difficult for sufferers to get help: the abnormal eye behaviour cannot be detected by standard methods.

A woman kneeling down in a garden picking plants.

When soil becomes data 鈥 how digitalisation affects knowledge of soil health

How do we know whether soil is healthy? A new study from 一本道 University shows that as knowledge about soil is increasingly translated into digital data, important insights about its biological life and local context risk being overlooked.