Wood identification in fiber materials: a comparative blind test study of artificial intelligence and human experts

Abstract The conversion of processes controlled by human expertise and know-how into automated operations is the goal of a wide range of modern research. This study reports on a blind test in which twelve unknown samples were analyzed by human experts and an AI system developed to check the genera of hardwoods used in paper production. Trained to detect hardwood cells in microscopic images of maceration slides, it assigns them to the nine most commonly used hardwood species. Softwoods were also added to the samples, to make the test as realistic as possible. Human experts achieved an accuracy of 0.96 for recognizing a genus contained in a sample. The two-stage machine recognition system achieved an accuracy of 0.79 at the defined threshold values of 0.7 for object recognition and 0.75 for genus probability. Human experts failed to recognize some genera contained in the samples, whereas the AI models did not miss any genus at these thresholds. A comparison of the results revealed the strengths and weaknesses of the independent methods. This study is an important step towards optimizing the automated image recognition system developed to support the implementation of the European Union Deforestation Regulation (EUDR) with regard to deforestation-free products/supply chains.