Sketch recognition
Sketch recognition describes the process by which a computer, or artificial intelligence can interpret hand-drawn sketches created by a human being, or other machine.[1] Sketch recognition is a key frontier in the field of artificial intelligence and human-computer interaction, similar to natural language processing or conversational artificial intelligence[2][3]
Uses and Applications
Research in sketch recognition lies at the crossroads of artificial intelligence and human–computer interaction. Recognition algorithms usually are gesture-based, appearance-based, geometry-based, or a combination thereof.
Advances in the field of sketch recognition would have significant application in the field of forensic science, in which sketches are often used to identify suspects associated with a crime.[4][5]
In 2023, two developers used OpenAI's DallE-2 image generation platform to create a forensic sketch program. The program's results were described as "hyper-realistic" and purported the potential of exponentially decreasing the creation time of a forensic sketch, while increasing accuracy.[6]
Sketch recognition technology has also been linked to applications in the fields of architecture, videogame production, animation, construction, and academia, among others.[7][8][9][10]
See also
- Gesture recognition
- Handwriting recognition
- Human–computer interaction
- Multi-touch gestures
- Pen computing
- Sketch-based modeling
- Tablet computer
References
- ↑ Hammond, T. and Davis, R. (2005), "LADDER, a sketching language for user interface developers", Computers & Graphics, 2005, 29(4), pp. 518-532.
- ↑ Hammond, T., Logsdon, D., Peschel, J., Johnston, J., Taele, P., Wolin, A., and Paulson, B. A sketch recognition interface that recognizes hundreds of shapes in course-of-action diagrams. In Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems (CHI EA '10), 2010, pp. 4213-4218.
- ↑ Jorge, J. and Samavati, F. (2011), Sketch-Based Interfaces and Modeling, Springer
- ↑ IJRASET. "Forensic Face Sketch Construction and Recognition" (in en). https://www.ijraset.com/research-paper/forensic-face-sketch-construction-and-recognition.
- ↑ Lei, Haopeng; Chen, Simin; Wang, Mingwen; He, Xiangjian; Jia, Wenjing; Li, Sibo (2021-05-25). "A New Algorithm for Sketch-Based Fashion Image Retrieval Based on Cross-Domain Transformation" (in en). Wireless Communications and Mobile Computing 2021: e5577735. doi:10.1155/2021/5577735. ISSN 1530-8669.
- ↑ Xiang, Chloe (2023-02-07). "Developers Created AI to Generate Police Sketches. Experts Are Horrified" (in en). https://www.vice.com/en/article/qjk745/ai-police-sketches.
- ↑ "Papers with Code - Sketch Recognition" (in en). https://paperswithcode.com/task/sketch-recognition/codeless.
- ↑ "Sketch Recognition" (in en-US). https://www.microsoft.com/en-us/research/project/sketch-recognition/.
- ↑ Zhang, Lei (2021-08-21). "Hand-drawn sketch recognition with a double-channel convolutional neural network". EURASIP Journal on Advances in Signal Processing 2021 (1): 73. doi:10.1186/s13634-021-00752-4. ISSN 1687-6180. Bibcode: 2021EJASP2021...73Z.
- ↑ Korkut, Elif Hilal; Surer, Elif (2021). Baalsrud Hauge, Jannicke; C. S. Cardoso, Jorge; Roque, Licínio et al.. eds (in en). Sketch Recognition for Interactive Game Experiences Using Neural Networks. Lecture Notes in Computer Science. Cham: Springer International Publishing. 393–401. doi:10.1007/978-3-030-89394-1_31. ISBN 978-3-030-89394-1. https://link.springer.com/chapter/10.1007/978-3-030-89394-1_31.
External links
- Notes on the History of Pen-based Computing (Youtube)
- Annotated Bibliography in Tablets, Gesture and Handwriting Recognition, and Pen Computing
 |  |
