Self-driving cameras: automated camera capture for biological imaging
Publication Date
March 15, 2021
Creator
Abstract
Efficient quantitative analysis of plant traits is critical to keep pace with advances in molecular and genetic plant breeding tools. Machine learning has shown impressive results in automating a lot of these analytical processes however, many of the algorithms rely on a surplus of high-quality biological imagery. This data is currently collected in labs via static camera systems, which provide consistent images but are challenging to tailor to individual plants, species, or tasks. Current research in autonomous camera systems use object detection or tracking methods to control the camera. Unfortunately, this quickly falls apart for static biological imagery as large inter- and intra-species variations, even within the same specimen, make object detection less robust and stationary targets make tracking unusable. Inspired by the success of deep learning in the autonomous driving space, we apply an end-to-end learned approach to directly map saliency-augmented input frames from an RGB monocular camera to a pan-tilt-zoom (PTZ) actuation. Our results show our model correctly classifies which direction to move the camera in 87% of instances and has an average offset error of 250 and 140 pixels for a 1920x1080 image, respectively. Results on a much smaller, plant-only dataset demonstrates the applicability of the model to biological imagery and we demonstrate saliency’s effectiveness in improving accuracy by up to 4%.
Item Type
ethesis
Thesis Type
MRes
Supervisors
Subjects (LC)
Associated Schools / Departments
School of Biosciences (UK)
eprints ID
64339
UoN Repository URI
Except where otherwise noted, this item's license is described as
File(s)![Thumbnail Image]()
Name
Self_driving_cameras__Automated_Camera_Capture_for_Biological_Imaging_corrected.pdf
Type
Full-text
Description
Examined. Self driving cameras: Automated Camera Capture for Biological Imaging (with corrections)
Size
2.46 MB
Format
Adobe PDF
Checksum (MD5)
36da8377b8a00ee8d84b6adb67a6bb07