{"id":5906,"date":"2023-11-15T15:20:00","date_gmt":"2023-11-15T15:20:00","guid":{"rendered":"https:\/\/new.www.purdue.edu\/newsroom\/?p=5906"},"modified":"2024-07-17T15:24:10","modified_gmt":"2024-07-17T15:24:10","slug":"ai-knows-the-score-and-it-could-help-instrumentalists-make-beautiful-music","status":"publish","type":"post","link":"https:\/\/www.purdue.edu\/newsroom\/2023\/Q4\/ai-knows-the-score-and-it-could-help-instrumentalists-make-beautiful-music","title":{"rendered":"AI knows the score \u2014 and it could help instrumentalists make beautiful music"},"content":{"rendered":"

WEST LAFAYETTE, Ind. —<\/p> \n

Purdue University is putting artificial intelligence center stage with novel research examining the technology\u2019s potential to improve musical performance, both on an individual and group level.<\/p>\n<\/div>\n\n\n

The multidisciplinary project takes the lead on innovating STEM (science, technology, engineering and math) and art through AI. The project is funded by a National Science Foundation grant<\/a>.<\/p>\n\n\n\n

Yeon-Ji \u201cKristen\u201d Yun<\/a>, a performing cellist and the project\u2019s principal investigator, said music and AI already have been used together in areas like recording and composition.<\/p>\n\n\n\n

\u201cBut it\u2019s not been used much in music performance and education,\u201d said Yun, a clinical associate professor of music at the Patti and Rusty Rueff School of Design, Art, and Performance in Purdue\u2019s College of Liberal Arts. \u201cSo as a musician myself, I wondered if AI technology could actually provide a benefit to musicians and possible advantages to performance while keeping their creative ability.\u201d<\/p>\n\n\n\n

This project will develop and integrate techniques from computer vision, natural language processing and audio analysis to create two AI-enabled tools for string music performers. The first tool, the Evaluator, aims to improve individual practice and performance by analyzing audio and video of a musician, then comparing it to digitized music scores and a database of video performances. It will offer potential improvements by detecting deviations in the audio and posture adjustments in the video.<\/p>\n\n\n\n

The second tool, the Companion, is intended to play the part of absent instruments in an ensemble by using audio analysis of performances to match tempo and style of the musicians.<\/p>\n\n\n\n

The initial focus of the research is on stringed instrument performances, but the intent is for it to be used with any instrument.<\/p>\n\n\n\n

\u201cThese tools can be for string players with any level,\u201d Yun said. \u201cThey can be for professionals or for amateur musicians, young or old.\u201d<\/p>\n\n\n\n

Yun is joined in the research by Purdue co-principal investigators Yung-Hsiang Lu<\/a>, professor of electrical and computer engineering; Yingjie \u201cVictor\u201d Chen<\/a>, professor of computer graphics technology in Purdue Polytechnic Institute; Cheryl Zhenyu Qian<\/a>, chair of art and design at the Rueff School; and Mohammad Rahman<\/a>, the Daniels School Chair in Management at the Mitchell E. Daniels, Jr. School of Business.<\/p>\n\n\n\n

Yun said the Companion tool is much more in-depth than simply reading the music and reproducing the song.<\/p>\n\n\n\n

\u201cMusicians have freedom to create their own interpretations,\u201d she said. \u201cIf they place a note slightly longer or slightly slower, we need to separate the duration from frequency while still following the ensemble\u2019s tempo.\u201d<\/p>\n\n\n\n

The team is looking at the research from the perspective of when AI technology can provide measurable benefits to musicians\u2019 practice and performance as well as what factors affect future musicians\u2019 acceptance of AI technology in their work.<\/p>\n\n\n\n

Yun will collaborate on user studies for the project with Ka-Wai Yu, associate professor in music at Utah Tech University.<\/p>\n\n\n\n

About Purdue University<\/h2>\n\n\n\n

Purdue University is a public research institution with excellence at scale. Ranked among top 10 public universities and with two colleges in the top 4 in the United States, Purdue discovers and disseminates knowledge with a quality and at a scale second to none. More than 105,000 students study at Purdue across modalities and locations, with 50,000 in person on the West Lafayette campus. Committed to affordability and accessibility, Purdue\u2019s main campus has frozen tuition 12 years in a row. See how Purdue never stops in the persistent pursuit of the next giant leap, including its first comprehensive urban campus in Indianapolis, the new Mitchell E. Daniels, Jr. School of Business, and Purdue Computes at https:\/\/www.purdue.edu\/president\/strategic-initiatives<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

WEST LAFAYETTE, Ind. — Purdue University is putting artificial intelligence center stage with novel research examining the technology\u2019s potential to improve musical performance, both on an individual and group level. The multidisciplinary project takes the lead on innovating STEM (science,<\/p>\n","protected":false},"author":7,"featured_media":5907,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[7],"tags":[],"department":[115],"source":[29],"purdue_today_topic":[66],"coauthors":[40],"class_list":["post-5906","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-research-excellence","department-liberal-arts","source-purdue-news","purdue_today_topic-research"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/posts\/5906","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/comments?post=5906"}],"version-history":[{"count":2,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/posts\/5906\/revisions"}],"predecessor-version":[{"id":5909,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/posts\/5906\/revisions\/5909"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/media\/5907"}],"wp:attachment":[{"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/media?parent=5906"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/categories?post=5906"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/tags?post=5906"},{"taxonomy":"department","embeddable":true,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/department?post=5906"},{"taxonomy":"source","embeddable":true,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/source?post=5906"},{"taxonomy":"purdue_today_topic","embeddable":true,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/purdue_today_topic?post=5906"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.purdue.edu\/newsroom\/wp-json\/wp\/v2\/coauthors?post=5906"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}