A collaboration between opto-technicians at Darmstadt University of Applied Sciences and ecologists at Darmstadt Technical University has spawned results far beyond expectations. Working together they have developed a device that can help to preserve insect specimens which would otherwise be irredeemably lost. Moreover, its working method renders the Darmstadt insect scanner globally unique.
By Daniel Timme, 11.9.2018
Insects are crawling, scuttling and flying into the public gaze with increasing tenacity, as their huge significance to the planet’s well-being bores deeper into our collective consciousness. We read of how bees’ untiring busyness is utterly essential to Nature, and to our species as well, but that they are dying out; of an alarming reduction in biodiversity as a result of catastrophic levels of intensive farming, for should we fail to curb certain aspects of our behaviour patterns, we can be sure the generations to follow will never meet most of the many insect species that swarmed around us as children, landing on our own, outstretched fingers. However, a similar effect, yet with distinctly more scientific profundity, can now be produced using a technical device developed by a collaborative project between the Darmstadt University of Applied Sciences (h_da) and Darmstadt Technical University (TU Darmstadt). The ‘DISC3D’ (Darmstadt Insect Scanner 3D) focuses, quite literally, on insects, capturing every facet of them and enabling the Darmstadt Insect Scanner to play an important role in preserving knowledge of the various species.
A collaboration between opto-technicians at Darmstadt University of Applied Sciences and ecologists at Darmstadt Technical University has spawned results far beyond expectations. Working together they have developed a device that can help to preserve insect specimens which would otherwise be irredeemably lost. Moreover, its working method renders the Darmstadt insect scanner globally unique.
Insects are crawling, scuttling and flying into the public gaze with increasing tenacity, as their huge significance to the planet’s well-being bores deeper into our collective consciousness. We read of how bees’ untiring busyness is utterly essential to Nature, and to our species as well, but that they are dying out; of an alarming reduction in biodiversity as a result of catastrophic levels of intensive farming, for should we fail to curb certain aspects of our behaviour patterns, we can be sure the generations to follow will never meet most of the many insect species that swarmed around us as children, landing on our own, outstretched fingers. However, a similar effect, yet with distinctly more scientific profundity, can now be produced using a technical device developed by a collaborative project between the Darmstadt University of Applied Sciences (h_da) and Darmstadt Technical University (TU Darmstadt). The ‘DISC3D’ (Darmstadt Insect Scanner 3D) focuses, quite literally, on insects, capturing every facet of them and enabling the Darmstadt Insect Scanner to play an important role in preserving knowledge of the various species.
Graduate biologist Michael Heethoff is part of the ecological networks work group at TU Darmstadt, where one of the ecologist and entomologist’s fields is a morphological study of biodiversity. Morphology describes the scientific examination of a creature’s form, just as biodiversity describes the extent of biological variety in all living species. Heethoff and his colleagues had at their disposal instruments including state-of-the-art x-ray tomographs to help them study and catalogue the surviving global insect populations. Yet as the 45 year-old explains “to date there had been no simple, easy-to-use measurement procedure to measure the surface area and volume of an insect, for instance.” Such a tool would be an asset as both of these factors are important to understanding the specific physiology of a species. “Then a colleague who had studied at h_da suggested I get in touch with their opto-technicians” recalls Michael Heethoff. The first meeting occurred but a few weeks after Heethoff’s initial email to the h_da sent in September 2014. There, Heethoff and his colleagues Sebastian Schmelzle and Nico Blüthgen met with h_da professors Stephan Neser and Bernhard Ströbel from the mathematics and natural sciences faculties to discuss and assess possible approaches. The most promising appeared to be a suggestion from Stephan Neser: multi-image stereo photogrammetry, also known as ‘Structure from Motion’. “From our experience with optical 3D measurement techniques, this method seemed the most suitable” says Ströbel.
At 65 years of age and lecturing in his final semester in his specialist fields opto-technology and image processing at the time, physicist Bernhard Ströbel continued his interest in the project once he had officially retired. Impetus from Stephan Neser helped the project being managed by Heethoff and Ströbel to really take off. As part of their practical training, two students from the TU constructed the first provisional measuring station at the h_da towards the end of 2014. As Michael Heethoff says, the Darmstadt scientists all got on well together. “There aren’t that many natural overlaps between our fields, not regarding knowledge and vocabularies, but the fact that I’ve been interested in 3D imagery for quite a few years helped – it all went extremely well, working together.”
The first prototype during Summer 2015
The scanner was mostly developed on the fourth floor of building C 10, the high-rise on the h_da campus, in the laboratory for optical 3D measurement technology. As Bernhard Ströbel tells it, “our technician Ken Justice was such a great help. He assembled all of the parts together and came up with loads of ideas of how to integrate the mechanical and electronic components.” Components such as an industrial-quality camera, profiled aluminium struts and electric motors were gradually turned into ‘a system to capture all-round photographic images and subsequent three-dimensional modelling of pinned insects’. Which is the official terminology of what the creators themselves call ‘the Darmstadt Insect Scanner’. The first prototype was built during the summer semester of 2015 by students on the opto-technology and image processing study course. Over the following semesters around a dozen students formed themselves into project groups – supervised by Bernhard Ströbel – to take on the tasks of programming the measurement procedure, adjusting the camera and vibration isolation units and controlling the various motors.
The work-group ‘ecological network’ provided test specimens from their own collection, enabling the interdisciplinary and cross-University teams of scientists to measure beetles, wild bees, butterflies and snail shells. The scanner was give the name DISC3D and it soon proved capable of fulfilling the original remit of measuring the surface and volume of insects with style. The three dimensional chart of surface dots in true colour generated by the scanner could be used to create true-to-scale 3D models of the object, from which the surface area and volume of the insect can be calculated. The first phase of the project was clearly a success.
Problem Solved; Mission Accomplished – yet now a by-product of the scan process has aroused researchers’ curiosity. As Michael Heethoff explains “the photos were soon of such good quality of that we began considering other ways to put them to use, for instance, that the scanner would be capable of creating a digitalized archive of insects already preserved.” For herein lies a separate and especially urgent task for ecologists: more than a million species have been preserved worldwide, especially those parked in the collections of natural history museums. “These treasures are at huge risk of decaying” explains Heethoff. The ravages of time certainly do threaten the preserved exhibits – and pests, such as the museum beetle, for instance. Should they turn to dust then invaluable knowledge would be lost forever. Furthermore, as the specimens are in effect tied to a location, researchers are often forced to travel great distances in order to examine them. For these reasons alone, projects have sprung up worldwide aimed at digitalizing irreplaceable insect collections to preserve them for future generations.
Rotate, flip – and share
However, many of these attempts prove to be highly elaborate, or they only deliver results of a dubious quality. As Michael Heethoff explains, in cases where specimens were only photographed from two or three different perspectives, several of the characteristics specific to a species, and which need to be clearly apparent in order to clearly differentiate between similar species – such as the length of legs, the shape of jaws etc. – have still to be guessed at. By contrast, the Darmstadt insect scanner renders all of these facets clearly discernable, for its images reproduce the finest hairs, wing structures or true colours in full detail. They enable experts to rotate, flip and carefully inspect models of the insect specimen generated from the graphic data on the screen – moreover, the digitalized information can easily be stored and shared all over the world, meaning the DISC3D could make a huge contribution and provide impulses to the world-wide transfer of knowledge on bio-diversity. Michael Heethoff believes this development will enable ecologists to do much more in the future, because for along time, research was almost limited to lists of species being compiled, whereas “in the meantime, we are focusing increasingly on the changing characteristics of ecological systems and the organisms they comprise of – with these insights being related to phenomena and influencing factors such as climate change and the ever-increasing use of land for intensive farming.” The three dimensional perspectives afforded by the insect scanner make even the smallest, finest features apparent, enabling how these are changing to be easily assessed. “We’re now able to link these variations to simultaneous changes in environmental circumstance and provide explanations for them.” Even evolutionary biology cannot deliver definitive assertions on concrete causation of such variations, “yet at least this method of observation enables us to clearly identify potential mechanisms – and not merely patterns.”
The method employed by the Darmstadt approach differs markedly from other attempts to digitalize insect specimens, by dint of two techniques being combined: an automated all-round imaging of the specimen and scanning it with highly expanded depth of field. “Our scanner provides a huge advantage over other techniques in digitalizing collections” says Michael Heethoff, “for one thing, we no longer need to pick the delicate specimens up to change their pinned position, plus, the scanning process is fully automated.” Thus reducing effort, time and outlay.
A worldwide exclusive
“We’re the only team able to routinely create 3D models of insect specimens” says Bernhard Ströbel. The process is as follows: the specimen is pinned and mounted between two hemispheres where it is illuminated indirectly. Then the specimen is rotated at regular intervals along two axes by electric step-motors. “ Each insect gets to pose around 400 times for the camera“, says Bernhard Ströbel. At each interval the camera is moved backwards and forwards on a macro slide to record the very precise image of every single aspect of the specimen. The resulting roughly 25,000 images are then calculated to match one-another. These images with their expanded depth of field and true colour and are then used to generate true-to-scale and colour, three-dimensional models of the specimen. “We just load the specimen, press a few keys to set the parameters required then let it scan away automatically – without even anyone having to be there”, explains Ströbel, which makes our scanner unique across the world, so far as we can tell.”
The amounts of data generated are considerable. As Bernhard Ströbel points out “if we were to store the raw imaging data then we’d have half a terabyte, so 500 gigabyte, from each scan.” To this end, the data is processed during the scanning in parallel to reduce the amount; using this combination of processes the amount of data for the final 3D model of a specimen can be reduced to around only 600 to 700 megabyte, on average. As Ströbel concedes “what we are still finding a nuisance are extremely fine body parts, such as hairs, bristles and some incredibly thin and transparent wing parts – rendering these into three-dimensional models is tricky, to say the least.” Additionally, some of the partially hidden body parts and details, of dark-coloured insects in particular, are very difficult to capture: “we’re working on both.”
Noting the times required for each scan Bernhard Ströbel says “in January we were still looking at up to ten hours per scan, now we’re down to five hours at most.” A rule of thumb dictates that smaller takes longer. As Ströbel explains “small depth of field plays an important role with smaller insects because they need to be enlarged the most.” Processing and calculating the images takes up the most time. “In essence it comes down to a question of processing capacity and software. It’s our aim to be able to complete a scan within one hour – and that with an improved resolution, if possible!”
What comes after the dung beetle?
But for now, the team has its first major routine application to complete “we’re going to generate a digital atlas of domestic dung beetle species” explains biologist Heethoff. The DISC3D could soon be digitalizing the specimens available from renowned national collections, some of which are already over 100 year old. Ströbel tells us “several major natural history museums have told us they are interested in participating.” However, the creators of the Darmstadt Insect Scanner already have their sights set much higher, for if the scanner is freed of its biological origins, then the sky’s the limit as far as other objects are concerned. As Ströbel says “in theory, the scanner can generate 3D measurements of any small object, there are so many possible fields of application – whether for research centres, schools, firms or private individuals.” As Heethoff later confirms, the DISC3D could also be part of scientific projects conducted with the participation of interested laypersons – in other words ‘Citizen Science’. These people might take on the tasks of measuring or processing the data.
Open-Source theory is part and parcel of the project’s DNA. As Ströbel says “we’re not interested in commercial ventures, but we are interested in hearing ideas – the technology provides so many possibilities and it’d be great if others came forwards with their ideas on how to use it.” The team made sure that easily accessible components were used so that as many people as possible could join in – for re-producing the scanner is of great interest to them, emphasise both Ströbel and Heethoff. The construction plans will be made available to anyone who is interested. As Ströbel points out “the materials are not expensive, for instance, the camera, lens, macro-slide, mechanical and electronic parts only cost around €5,000, all in all” plus, of course, a suitable computer and working hours. At the moment, commercial software is also still being used, in part, although it is planned for this to be replaced eventually with Open-Source solutions. This means that although access to this technology is not entirely barrier-free, it is nonetheless a low-threshold, low hurdle affair..
Michael Heethoff has another vision as to how the scanner could be utilised. “Today, most people can no longer tell a hover fly from a wasp” says the biologist. So the DISC3D could be used to establish a databank, with access for all, in which insects and their characteristics are catalogued and presented as three-dimensional images. Heethoff continues, “it should then be possible to photograph an insect using a smartphone and access the databank with this via an App, for this would enable anyone to quickly and easily find something out about a species … without having to resort to a field guide or specialist literature.” Bernhard Ströbel nods and adds: “we’d really like it if as many people as possible joined in, so that a kind of community formed around the DISC3D, comprising both professionals and private users.”
Potential for Museums’ educational programmes
Bernhard Ströbel says yet another exciting use for the data sets generated by the DISC3D would be 3D prints. “Just to try it out we printed a beetle at a scale of 10:1 and it looked pretty impressive, and larger models are naturally feasible as well.” One problem that persists with 3D prints is that the objects don’t appear in true colour – but specialists are already working on this. Ströbel can well imagine that the DISC3D used in connection with 3D printing could pay dividends in museums’ educational programmes. Models of creeping, crawling and flying creatures could serve to inspire young and old to join in.
The die has since been cast, following their recent publication in the zoological online journal ‘ZooKeys’, leaving the creators of the Darmstadt insect scanner to wait and see how both the scientific community and the public at large react. Perhaps it could even help to generate a welcome wave of attention – that at the end of the day even benefits the industrious insects to whom we owe so much.
Contact details
Christina Janssen
Science editor
Press department
Tel.: +49.6151.16-30112
E-Mail: christina.janssen@h-da.de
And the numbers!
To date the smallest specimen captured by the Darmstadt Insect Scanner has been a fly that measured only 1.5 millimetres. The largest object was a walker, also known as a Turkish cockchafer, measuring around 27 millimetres in length. Scanning a specimen currently takes between two and five hours, but the researchers from TU Darmstadt and h_da aim to reduce this to one hour. At present the 25,000 single images of an insect in around 400 different poses – physicists also refer to ‘directions in space’ – are being taken using a 4-megapixel-camera. The next prototype of the device will be equipped with a twelve megapixel camera.
The raw data generated by scanning a single insect specimen amounts to around 500 gigabyte. This is reduced to around 600 megabyte, as the data is simultaneously processed in parallel to the scan. The inaccuracy inherent to the system is approximately one per cent of length, in other words, a leg measuring 5 millimetres is precisely determined to within 50 micrometre. The DISC3D thus delivers results which are sufficiently exact for its purpose in the biological field.
Additional information on the scanner, along with animations, models and pictures are available at the website of project DIS3D: www.econetlab.net/disc3d