The dataset consists of multispectral ortho mosaic images covering 16,550m2 sugar beet fields collected by five-band RedEdge-M and four-band Sequoia cameras in Rheinbach (Germany) and Eschikon (Switzerland). The spatiotemporal datasets contain high-resolution multispectral sugar beet/weed images with expert labeling.