Intelligent Installation Design and Implementation of Automatic Performative Transcription for Plucked String Instrument

B. Qiu, Rongfeng Li, Linfeng Fan · 2023

Since the 20th century, synthesizers and MIDI keyboards offer composers more convenient operation and a higher creative ceiling. However, traditional Chinese plucked instruments like the Pipa have only just begun to explore the realms of electronic music and automatic notation. This study focuses on the Pipa as the subject, aiming to design and implement a device that captures performance-related data while maintaining the original conditions of the instrument, and automatically transcribes this data into musical notation.This study presents a data collection module based on Arduino hardware. This design involves detection by making certain modifications to the instrument and connecting wires to the instrument's frets which achieves real-time detection of the performer's finger movements via a hardware loop, collecting performance data for transcription. This setup allows performer to record and preserve details of their performance, including the fingering and string values for each note played. Through extensive research on sensors and underlying theories, this study has essentially achieved an intelligent device for the automatic notation of plucked instrument performances. Furthermore, with further refinements, it can also be applied to more complex,technically rich musical compositions and more instruments in the future.

Read the paper · More papers on PaperTik