Music information retrieval
This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these template messages)
|
Music information retrieval (MIR) is the interdisciplinary science of retrieving information from music. Those involved in MIR may have a background in academic musicology, psychoacoustics, psychology, signal processing, informatics, machine learning, optical music recognition, computational intelligence or some combination of these.
Applications
MIR is being used by businesses and academics to categorize, manipulate and even create music.
Music classification
One of the classical MIR research topics is genre classification, which is categorizing music items into one of the pre-defined genres such as classical, jazz, rock, etc. Mood classification, artist classification, instrument identification, and music tagging are also popular topics.
Recommender systems
Several
Music source separation and instrument recognition
Music source separation is about separating original signals from a mixture audio signal. Instrument recognition is about identifying the instruments involved in music. Various MIR systems have been developed that can separate music into its component tracks without access to the master copy. In this way, for example, karaoke tracks can be created from normal music tracks, though the process is not yet perfect owing to vocals occupying some of the same frequency space as the other instruments.
Automatic music transcription
Automatic
Music generation
The
Methods used
Data source
Feature representation
Analysis can often require some summarising,
Statistics and machine learning
- Computational methods for classification, clustering, and modelling — musical feature extraction for mono- and polyphonic music, similarity and pattern matching, retrieval
- music identification and recognition, such as score following, automatic accompaniment, routing and filtering for music and music queries, query languages, standards and other metadata or protocols for music information handling and retrieval, multi-agent systems, distributed search)
- Software for music information retrieval — acoustic fingerprinting
- Music analysis and knowledge representation — automatic summarization, citing, excerpting, downgrading, transformation, formal models of music, digital scores and representations, music indexing and metadata.
Other issues
- Human-computer interaction and interfaces — multi-modal interfaces, user interfaces and usability, mobile applications, user behavior
- Music perception, cognition, affect, and emotions — music similarity metrics, syntactical parameters, semantic parameters, musical forms, structures, styles and music annotation methodologies
- Music archives, libraries, and digital collections — music digital libraries, public access to musical archives, benchmarks and research databases
- Intellectual property rights and music — national and international copyright issues, digital rights management, identification and traceability
- Sociology and Economy of music — music industry and use of MIR in the production, distribution, consumption chain, user profiling, validation, user needs and expectations, evaluation of music IR systems, building test collections, experimental design and metrics
Academic activity
- International Society for Music Information Retrieval (ISMIR) conference is the top-tier venue for music information retrieval research.
- International Conference on Acoustics, Speech, and Signal Processing (ICASSP) is also a highly relevant venue.
See also
- Audio search engine
- Audio mining
- A Dictionary of Musical Themes
- Digital rights management
- Digital signal processing
- Ethnomusicology
- List of music software
- Multimedia information retrieval
- Automatic content recognition
- Music notation
- Musicology
- Optical music recognition
- Parsons code
- Sound and music computing
References
- ^ A. Klapuri and M. Davy, editors. Signal Processing Methods for Music Transcription. Springer-Verlag, New York, 2006.
- ISBN 978-3-8423-7917-6.
- ^ David Moffat, David Ronan, and Joshua D Reiss. "An Evaluation of Audio Feature Extraction Toolboxes". In Proceedings of the International Conference on Digital Audio Effects (DAFx), 2016.
- Michael Fingerhut (2004). "Music Information Retrieval, or how to search for (and maybe find) music and do away with incipits", IAML-IASA Congress, Oslo (Norway), August 8–13, 2004.
External links
- International Society for Music Information Retrieval
- Music Information Retrieval research
- M. Schedl, E. Gómez and J. Urbano: Music Information Retrieval: Recent Developments and Applications
- Intelligent Audio Systems: Foundations and Applications of Music Information Retrieval, introductory course at Stanford University's Center for Computer Research in Music and Acoustics
- Micheline Lesaffre: Music Information Retrieval: Conceptual Framework, Annotation and User behavior.
- Imagine Research: develops platform and software for MIR applications
- AudioContentAnalysis.org: MIR resources and matlab code
- Minz Won, Janne Spijkervet, and Keunwoo Choi: Tutorial - Music classification: Beyond Supervised Learning, Towards Real-world Applications