WiMIR Workshop 2018: Modeling Repetition and Variation for MIR

Blog post by Iris Yuping Ren, Hendrik Vincent Koops, and Anja Volk.

(Materials are available at https://github.com/hvkoops/wimir2018)

Right after the main ISMIR2018 conference, the WiMIR workshop awaited. As planned, we gathered and formed a working group to tackle the problem of modeling repetition and variation in music for MIR, consisting of the following participants:

Anja Volk (Utrecht University) – Project Guide
Hendrik Vincent Koops (Utrecht University) – Project Guide
Iris Yuping Ren (Utrecht University) – Project Guide
Juan Pablo Bello (New York University)
Eric Nichols (Microsoft)
Jaehun Kim (Delft University)
Marcelo Rodriguez Lopez (Yousician)
Changhong Wang (Queen Mary University of London)
Jing Chen (Nanchang University)
Tejaswinee Kelkar (University of Oslo)

In the morning session, we first reflected on the background of repetitions and variations as central concepts in music observed by musicologists, and then the computational modeling thereof in Music Information Retrieval within different contexts. We discussed that there exists disagreement in annotations in many MIR tasks, such as automatic chord extraction and repeated pattern discovery. Comparable to many other subareas in machine learning and data science, we face complications brought by the unattainability of an absolute, all-encompassing ground truth annotation.

We then provided more detailed motivations and ideas on how to gather annotations on repetitions and variations in music. For example, one set of guidelines was:

Listen to the following pieces and annotate the salient melodic patterns with

  1. How relevant this pattern is to this piece
  2. One word to label the type of this pattern
  3. A short description on why you find it to be a pattern
  4. How difficult it was for you to decide whether it’s a pattern

Using the prepared materials, we had a very active discussion on topics such as: how to define the concepts for specific annotation tasks? How can we use tools such as wearable sensors, a wrist band for example, to help the annotation process?  How can we compare the annotations and annotation methods? (For more, please refer to the github link).

In the afternoon, after a very interesting and useful lunch breakout session, we started with the actual annotation process on the first page of the String Quartet No. 1 in F major, Op. 18, No. 1, Ludwig van Beethoven (1798 and 1800), Violin I. We provided the sheet music, midi and audio files. The participants used different tools to their liking to mark the repetitions and variations on the sheet music. During the annotations, there were already some interesting discussions in some subgroups: how repetitive the young Beethoven was!

In the second part of the afternoon, using the individual annotations, we began our exchange on the experience of the annotation process. We discussed how we can improve on the current designs of annotation processes and tools for annotation tasks, and how the annotated patterns could be used to design an automatic pattern discovery system. We concluded the day with a short presentation.

Throughout the day, we gained many new insights into what are the good and bad ways to create and employ annotations on repetitions and variations. We warmly thank the participants for a great a day of discussions, listening to music, and annotating repetitions and variations!

Iris Yuping Ren is a second year PhD candidate in the Information and Computing Sciences department, Utrecht University, under the supervision of dr. Anja Volk, dr. Wouter Swierstra and dr. Remco C. Veltkamp. She obtained Bachelor degrees in Statistics and Cultural Industry Management from Shandong University, Master degrees in Complex System Science from the University of Warwick and École Polytechnique, Computer and Electrical Engineering in the University of Rochester, and a diploma in violin performance from the Eastman Community Music School. Her current research has a focus on the computational modelling and statistical analysis of musical patterns in various corpora. She is comparing both generic and domain-specific approaches, such as data mining methods, times series analysis, machine learning based clustering and classification algorithms. To discover useful patterns in music, she makes use of functional programming languages to compute pattern transformations and similarity dimensions. Her research contributes to a computationally- and quantitatively-based understanding of music and algorithms. Music wise, she enjoys playing with local orchestra projects and sessions.

Hendrik Vincent Koops is a PhD candidate at Utrecht University under supervision of Dr. Anja Volk and Dr. Remco C. Veltkamp. Vincent holds degrees in Sound Design and Music Composition from the HKU University of the Arts Utrecht, and degrees in Artificial Intelligence from the Utrecht University. After a research internship at Carnegie Mellon University, he started his PhD in Music Information Retrieval. His PhD research concerns the computational modeling of variance in musical harmony. For example, he studied annotator subjectivity to better understand the amount of agreement we can expect among harmony annotators. Using data fusion methods, he investigated how to integrate multiple harmony annotations into a single, improved annotation. For a deep learning study, he created new features for chord-label personalization. Vincent’s research contributes to a better understanding of computational harmony analysis tasks, such as automatic chord estimation. Vincent is also active as a composer for film and small ensembles. Currently, he’s working towards work for a string quartet.

Anja Volk (Utrecht University), holds master degrees in both mathematics and musicology, and a PhD in the field of computational musicology. The results of her research have substantially contributed to areas such as music information retrieval, computational musicology,  music cognition, and mathematical music theory.  In 2016 she launched together with Amélie Anglade, Emilia Gómez and Blair Kaneshiro the Women in MIR (WIMIR) Mentoring Program.  She co-organized the launch of the Transactions of the International Society for Music Information Retrieval, the open access journal of the ISMIR society, and is serving as Editor-in-Chief for the journal’s first term. Anja received the Westerdijk Award 2018 from Utrecht University in recognition of her efforts on increasing diversity.


WiMIR 1st Annual Workshop


WiMIR 1st Annual Workshop

WiMIR is excited to partner with Spotify to offer the first-ever WiMIR Workshop, taking place on Friday, 28 September 2018 at Télécom ParisTech in Paris, France. This event is open to all members of the MIR community.

The goal of this event is to provide a venue for mentorship, networking, and collaboration among women and allies in the ISMIR community, while also highlighting technical work by women in MIR in different stages of completion. This is the first time we’ve organized such an event, and we’d love to see you there!


An ISMIR Satellite Event

The workshop will take place following the ISMIR2018, featuring a WiMIR reception and the Late-breaking & Demos session. This satellite event aims to complement the conference in three notable ways:

  • Further amplify the scientific efforts of women in the field.
  • Encourage the discussion of proposed or unfinished work.
  • Create additional space for networking.


Opportunities for Research, Networking, and Mentorship

The WiMIR Workshop will combine a variety of activities, including a poster session (see below), networking lunch, and small-group ideation and prototyping sessions under the mentorship of senior members of the WiMIR community. From the poster session to the group activities, the event will emphasize early research ideas that can be shaped and developed through discussions that occur throughout the day!

Who Can Participate?

The WiMIR Workshop is open for everyone to attend, and is free! You do not need to attend ISMIR to attend the WiMIR workshop.

Researchers who self-identify as women are invited to submit short abstracts for poster presentations on projects at any stage of completion, from proposal to previously published work. Preliminary and early results are especially encouraged so that presenters can get feedback from peers and mentors. Any topic broadly related to the field of MIR is welcome and encouraged. Click here to submit a poster. Poster submissions close on August 15, 2018, and acceptance notifications will be sent by August 31, 2018.

Please don’t hesitate to send questions to wimir.workshop@gmail.com.







Opening Remarks



Mentoring Session I (intros and big picture)



Poster Session



Lunch/theme breakout



Mentoring Session II (deep dive into the topic)



Group Presentations



Closing remarks

We look forward to seeing you at the Women in Music Information Retrieval 1st Annual Workshop!

The WiMIR Workshop Organizers

Abstract submission form here: https://goo.gl/forms/hy3ygYnKKS9fTLa13

Thank You ISMIR 2017 WiMIR Sponsors!

The recent ISMIR 2017 conference in Suzhou, China continued a recent trend of sponsor contributions specifically for Women in Music Information Retrieval (WiMIR) initiatives during the conference. This year, sponsors funded a guest speaker during the WiMIR plenary session, a WiMIR/Diversity reception in the social program, and substantial travel support for female researchers. These initiatives not only enabled more women to attend the conference, but also provided opportunities for the MIR community to come together as a whole to show support for women in the field, and to learn more about the challenges and benefits of fostering a diverse community.

WiMIR Session @ ISMIR 2017

As part of this year’s WiMIR plenary session, Shawn Carney (Head of Global IT at Spotify) spoke about the importance of diversity in an “increasingly interdependent, interconnected world.” Ms. Carney’s talk, Bye Bye Bias: Promoting Diverse Teams, provided insights into the value of diversity and actionable steps we can all take to work toward it (slides available here). Thank you, Shawn Carney and Spotify, for the talk!


WiMIR/Diversity Reception

For the second year, Amazon Music hosted a WiMIR/Diversity reception during the conference. This year’s reception was open to all conference participants and included full dinner along with a Human Bingo activity to encourage attendees to talk to and learn more about the people around them. Thank you Amazon Music for bringing the community together!


WiMIR Travel Awards

Thanks to contributions from Spotify, Smule, Amazon Music, Gracenote, iZotope, Microsoft, and Steinberg, we were able to offer conference travel support to 22 female attendees of ISMIR 2017 – that’s 40% of the women who attended the conference! Importantly, women of any career stage could apply for travel support, and author eligibility included both accepted full papers (first or supporting author) or a presentation during the late-breaking/demo session on the last day of the conference. In the end, ISMIR 2017 WiMIR travel award recipients ranged from high school students to early faculty, over half of whom were attending the ISMIR conference for the first time.

Some feedback from WiMIR travel award recipients:

I am so glad to be in this community where people care and encourage women in MIR. I am so grateful that you are so supportive. Your support and encouragement, both mentally and financially, mean a lot to many female students like me. I’ll pass on this spirit to help many more people in the future. Thank you.
– Kitty Shi, Stanford University

I am so grateful to have had the opportunity of attending ISMIR for the first time thanks to the WiMIR travel award. Throughout my undergraduate experience, I sought ways to connect my electrical engineering education to my passion for music but had a hard time finding a community that sought to do the same. ISMIR has given me the chance to turn my curiosities into real research. The conference gave me the opportunity to immerse myself in a community of people who are clearly passionate about both music and the technologies that help advance our understanding of it. I am currently applying for PhD programs, and this travel award has helped me confirm that MIR research is the direction in which I want to head.
– Camille Noufi, University of Colorado

Many thanks to our sponsors! Being a junior faculty member, I have been in academia for about 15 years, and this is the only conference, and one of the very few occasions, where I feel female researchers are truly privileged. I especially feel grateful that some female students were able to attend this internationally well-known conference only because of the support of WiMIR travel award. To them, this was their first international conference, first poster, and/or first research presentation. To many of us, ISMIR is the most friendly and inspiring conference, which is certainly related to the diversity of attendees, in terms of disciplines, research topics, place of origins, levels of study/experience, gender, etc. It is essential to keep this merit of ISMIR in the future, so that we can continue attracting and retaining precious talent in MIR. The generous support of sponsorship is highly appreciated, and I believe it will be repaid with a greater future of the field, the community, and the world.  
– Xiao Hu, University of Hong Kong

I truly appreciate that ISMIR can provide this opportunity for me to join this conference. I got tremendous and important insights into my projects through this conference. I also got some very important connections through this energetic community. Thank you!
– Sonia

ISMIR 2017 was the first ISMIR Conference I attended and it was a great opportunity to be able to meet the MIR community empowering underrepresented groups in the field. The WiMIR travel award was one of the major support for me attending the conference. I am grateful to have the support of this encouraging community. I would like to thank the ISMIR 2017 WiMIR travel award sponsors again for their generous and continuous support.
– Doga Cavdir, Stanford University

The WiMIR grant allowed me to attend ISMIR with minimal stress. As an early career researcher, I often have to pay out large sums of money for conferences months in advance and hope to be reimbursed at some point. Having the WiMIR grant not only pay for registration and lodging, but also find my lodging was more helpful and supportive than I can articulate.
– WiMIR travel award recipient

I’m very grateful for your support to make my trip to ISMIR 2017 possible. It is an incredible opportunity for my research career to present my work in the world’s most influential MIR community and receive valuable feedback from researchers all over the world. Also, invigorating talks from the foremost researchers of the field of MIR did inspire me a lot. Thanks again for funding me on this invaluable experience.
– Simin Yang, Queen Mary University of London

Thank you so much for your support for my ISMIR 2017 travel. I have learnt a lot from people in the conference and made progress on my research. This was a great opportunity for me and will be one of the most precious gifts in my life.
– WiMIR travel award recipient

Thank you to the ISMIR 2017 WiMIR travel award sponsors so much for having me, an undergraduate student, joining in the top international conference in MIR. I really enjoyed my time there and was excited to learn about so many inspiring projects and ideas. I look forward to next year’s conference in Paris!
– Shuqi Dai, Peking University

It was because of the generous WiMIR travel award that I was able to attend ISMIR for the first time and present my poster. At this conference, I was able to meet with great professors, researchers, and industry affiliates, as well as have interesting conversations that have encouraged me further in my research endeavors. Hence, I’d like to thank the sponsors for giving me the opportunity.
– So Yeon Park, Stanford University

I am in the last year of my PhD and attending ISMIR was a huge opportunity for networking. Thanks to the WiMIR sponsors and especially Smule for making this happen!
– WiMIR travel award recipient

It was my first ISMIR, and I’m happy to become a member of the society. Thanks to the scholarship I was able to attend the conference and present my ongoing work. It was inspiring by itself, and even more, I received some positive comments and helpful feedback about my research. I’m sincerely grateful to the WiMIR organisers for their efforts to create the program, and, of course, to the sponsors for making it possible.
– Olga Slizovskaia, Universitat Pompeu Fabra

Thank you for so generously providing WiMIR travel awards. As a high school student, I submitted a late-breaking paper to ISMIR with no expectations, so receiving the WiMIR grant was beyond exciting and gave me so much encouragement to keep pursuing my research. ISMIR 2017 in Suzhou, China was incredible. I spoke with researchers from universities around the world and companies like Spotify, Pandora, and Smule; my conversations with people equally passionate about math, computer science, and music allowed me to learn about their projects and gain valuable feedback to expand on my own research. I got a taste of the synergy of working with people from many backgrounds and am discovering how to apply tools from one discipline to another to cross-fertilize ideas. Coming from an all-girls school especially, I am super appreciative of the work WiMIR does to increase opportunities for women in STEM like me.
– Hanna Yip, The Spence School

Thank you for the travel grant, without which it would have not been possible for me to attend ISMIR. Apart from the finances itself, what really stood out was the kinship and the immediate connection that I felt towards other WiMIR grantees. It was great to meet WiMIR researchers from across the globe and get to know them and their research. I also loved the session on Women in MIR. As someone who has worked in the industry for nearly 20 years, I am quite aware of the abysmal number of women in the field and their daily struggles. Many of the suggestions that were brought out resonated with me. Thank you once again for making it happen.
– Vidya Rangasayee, San Jose State University

Looking Forward

We believe that facilitating conference travel, as well as providing an inclusive and welcoming experience at the conference, are critical steps toward building a diverse and vibrant MIR community. We will continue to work with sponsors and other members of the community to welcome women and other individuals from underrepresented backgrounds at future conferences.

Regarding ongoing initiatives, WiMIR-specific sponsorship levels and benefits are now included in the ISMIR 2018 Call for Sponsors. In addition, the WiMIR mentoring program is entering its third round, and mentor/mentee signups are open through November 30. We also welcome feedback from the community at any time on other ways to support women in the field. Email ismir2018-sponsorship@ircam.fr and wimir-mentoring@ismir.net if you are interested in participating as a sponsor of WiMIR at ISMIR 2018, or have ideas for other initiatives!

The ISMIR 2017 WiMIR initiatives would not have been possible without the support of our sponsors, as well as the help and cooperation of the entire ISMIR 2017 Conference Committee, who came together to handle the many organizational and logistical tasks related to the travel grants and conference programming. Thank you also to the WiMIR travel award recipients for participating in the conference, and to those who provided feedback to the sponsors.

Thank You ISMIR 2017 WiMIR Sponsors!

PLATINUM smule-e1497583384943              PLATINUM Spotify_Logo_RGB_Green_WEBSITE

PLATINUM Amazon Music_RGB_Gradient WEB

PLATINUM Gracenote_A_Nielsen_Company_Logo_BLUE (1)   SILVER izotope-logo-black   PLATINUM Microsoft-logo_cmyk_c-gray   GOLD Steinberg_LOGO

Blair Kaneshiro (Sponsorships Co-Chair for the ISMIR 2017 conference) is a Research Scientist in the department of Otolaryngology Head & Neck Surgery at Stanford University School of Medicine. Her current research focuses primarily on objective assessment of auditory function and music cognition using electrophysiological responses. She earned her BA in Music, MA in Music, Science, and Technology, MS in Electrical Engineering, and PhD in Computer-Based Music Theory and Acoustics, all from Stanford. She is active in the Women in Music Information Retrieval (WiMIR) community as co-organizer, with Emilia Gómez and Anja Volk, of the WiMIR mentoring program; as well as with the First-Gen/Low-Income (FLI) community and mentoring program at Stanford. She is an incoming board member of the International Society for Music Information Retrieval.