With the help of staff from Bryn Mawr鈥檚 Educational Technology Services (ETS), four Bryn Mawr students are developing an app that uses augmented reality to move budding musicians from air guitar to concert stage.
The app is made for the , a visor-like device with oversized lenses that gives users a 鈥渕ixed reality鈥 experience.
Taking advantage of the HoloLens鈥 ability to impose virtual objects into a wearer鈥檚 real environment, the app, dubbed HoloMusic, teaches users the fundamentals of every instrument in the standard Western orchestra.
The user turns around and the 13 instruments appear behind them. When the user taps on one, he or she learns what the instrument looks like, what it sounds like, how to hold it, as well as facts about it. Eventually, the developers want to include a feature for minigames in which users can guess which song is playing and which instrument is playing it.
鈥淭he app allows anyone who doesn鈥檛 want to spend the money on an instrument to try it out and see if they like it,鈥 says Jocelyn Dunkley 鈥20, one of the app developers and a viola player in the Haverford orchestra. 鈥淭his would be a good introduction to see which instrument you鈥檇 actually want to play and what sounds nice to you.鈥
Kara Breeden '18, Hyunjung Kim '19, and Linghan Mei '19, also worked on developing the app. The students worked with Palak Bhandari 鈥16, a Mellon Digital Curriculum Assistant with ETS. The team developed the app during a winter-break internship and recently presented their work at an on-campus event. They have also submitted the app to the , which seeks next-generation educational simulations that strengthen academic, technical, and employability skills. The winner will be announced in the summer of 2017.
The developers see the app as a possible way to improve and expand music education in cash-strapped school districts with limited arts funding.
鈥淭his opportunity inspired me to think about the social responsibility that we STEM majors have,鈥 says Linghan, a biology major. 鈥淲e can advance technology in practical ways and make a real difference.鈥
Bryn Mawr is one of a few educational institutions chosen to partner with to explore how the HoloLens might enhance college teaching and learning.
The College was introduced to the technology in September by Linda Bush '85 who works at Pearson鈥檚 Smarthinking Services as their mathematics and sciences director.
鈥淥ur team immediately understood that we could find exactly what we were looking for at Bryn Mawr鈥攅ngaged and reflective students, innovative and collaborative faculty, and a campus culture open to merging traditional educational methods with high-tech approaches,鈥 says Bush.
Jennifer Spohrer, director of ETS, sees a bright future for other students who wish to work with the HoloLens.
鈥淭he winter internships show the potential synergies between a liberal arts education and emerging technologies,鈥 says Spohrer. 鈥淲e hope this will be the first of many such opportunities for Bryn Mawr students to exercise their analytical, critical thinking, communication, metacognitive and collaboration skills while exploring the potential and current capabilities of new digital technologies.鈥
ETS is for interns to work with the HoloLens over the summer. Another HoloLens tool, a chemistry application, is currently in development and will be tested at Bryn Mawr in the near future.
