Tag Archives: Computer applications

Adaptive digital instruments and disability

The creation, distribution, and deployment of the Adaptive Use Musical Instrument (AUMI) software represents a project that redefines our understanding of music—its creation, its meaning, and who can make it. AUMI also serves as a broader invitation to embrace innovative thinking beyond the realm of music, challenging traditional notions of normativity, difference, and democratic social relations. The existence of AUMI and the new social dynamics it encourages underscore the significant influence of disability rights and justice advocates, activists, and allies, highlighting their impact across diverse social and cultural spheres.

As a digital instrument available for free download, AUMI fosters democratic access to music making. It allows individuals who were previously excluded from composing and performing music to generate a wide range of sounds by controlling a visual cursor through eye, head, hand, and body gestures. AUMI’s technology can track even the smallest body movements, such as eye or chest movements from breathing, enabling users with limited voluntary mobility to create notes, chords, rhythms, and melodies using an apparatus that registers the slightest degrees of motion. When programmed to reduce sensitivity to motion, AUMI supports music composition and performance by individuals with active involuntary movements. This adaptability has significant implications for disability and social justice, highlighting its broader impact on inclusivity and access.

A demonstration video of AUMI.

By overcoming the limitations of outdated technologies and conventions, AUMI creates new opportunities for a diverse range of individuals to engage in music-making. It paves the way for the creation of innovative musical sounds and fosters new social connections among musicians. In doing so, AUMI frees artistic expression from the physical and social constraints that have defined Western art music, allowing for creativity beyond conventional norms.

Instead of perceiving disability as an embarrassing impairment or a deficiency to be fixed or reluctantly accommodated, the disability rights movement embraces the value and potential difference. It draws attention to the harm caused not just to individuals, but to society, by narrow definitions of normalcy and normativity. Disability activism reveals how framing able-bodiedness as the standard leads to artificial, arbitrary, and irrational exclusions that misallocate resources, waste talents, and stifle creativity, invention, and innovation.

This according to “AUMI as a model for social justice” by George Lipsitz, Improvising across abilities: Pauline Oliveros and the Adaptive Use Musical Instrument, ed. by Thomas Ciufo, Abbey L. Dvorak, Kip Haaheim, et al. (Ann Arbor: University of Michigan Press, 2024, 47–63; RILM Abstracts of Music Literature, 2024-9475).

Today is the International Day of Persons with Disabilities.

Leave a Comment

Filed under Instruments, Medicine and health, Science, Therapy

The dervish sound dress

The dervish sound dress is a piece of wearable technology inspired by the sacred experience of the whirling dervishes of Turkey.

The garment is a body instrument that emits musical sounds when the wearer moves in it, as well as triggering a haptic vibration response. It emulates the vibrations that are felt while a musician plays an instrument, and the emotional response that the musician and a performer such as a dervish feels.

The construction of the dress involves a variety of sensors that perform according to how the sound is triggered by the movement of the wearer. These determine the output based on the rotation of the dress using gyroscopes, accelerometers that measure the speed of the dress as it is turning, and flex sensors that trigger sounds when the arms are in certain positions.

The sound design component relies on organic sound samples of the classical Turkish ṭanbūr recorded by a musician and manipulated in computer music design software. This gives the garment a unique edge by functioning as a computer digitized representation of an instrument that is activated by motions of the body. The sounds are triggered using algorithms created in Max Cycling ’74 software. These patches will detect a threshold of movement by the wearer before a sound is triggered.

This according to “Dervish sound dress: Odjevni predmet sa senzorima koji emitiraju zvuk i haptičkim odzivom/The dervish sound dress: A garment using sensors that emit sound and haptic feedback” by Hedy Hurban, an essay included in Muzika–nacija–identitet/Music–nation–identity (Sarajevo: Muzikološko Društvo Federacije Bosne i Hercegovine, 2020).

Video documentation of the dervish sound dress is here.

Comments Off on The dervish sound dress

Filed under Curiosities, Dance, Science

Gamelunch

 

Gamelunch

Gamelunch is a sonically augmented dining table that exploits the power and flexibility of physically-based sound models towards the investigation of the closed loop between interaction, sound, and emotion.

Continuous interaction gestures are captured by means of contact microphones and various force transducers, providing data that are coherently mapped onto physically-based sound synthesis algorithms. While performing usual dining movements, the user encounters contradicting and unexpected sound feedback, thus experiencing the importance of sound in the actions of everyday life.

This according to “Gamelunch: A physics-based sonic dining table” by Stefano Delle Monache, Pietro Polotti, Stefano Papetti, and Davide Rocchesso, a paper included in Proceedings of the 33rd International Computer Music Conference (San Francisco: International Computer Music Association, 2007, pp. 41–44).

Above and below, Gamelunch in action.

Comments Off on Gamelunch

Filed under Food

SMUG: Scientific Music Generator

SMUG

 

SMUG is a system for generating lyrics and melodies from real-world data, in particular from academic papers.

The developers of SMUG wanted to create a playful experience and establish a novel way of generating textual and musical content that could be applied to other domains, in particular to games.

This according to “SMUG: Scientific Music Generator” by Marco Scirea, Gabriella A. B. Barros, Noor Shaker, and Julian Togelius, a paper included in Proceedings of the Sixth International Conference on Computational Creativity (Provo: Brigham Young University, 2015, pp. 204–211).

Many thanks to Improbable Research for bringing this to our attention! Above, an excerpt from the score generated from Charles Darwin’s On the origin of species by means of natural selection. Below, an app that generates music from barcodes.

 

Comments Off on SMUG: Scientific Music Generator

Filed under Curiosities, Humor, Science

Folkways in Wonderland

Frishkopf fig. 1

Folkways in Wonderland (FiW) is a cyberworld for musical discovery with social interaction, allowing avatar-represented users to explore selections from the Smithsonian Folkways world music collection while communicating through text and audio channels. FiW is built on Open Wonderland, a framework for creating collaborative 3D virtual worlds.

FiW is populated with track samples from Folkways Recordings. Since acquiring the label in 1987, Smithsonian Folkways has expanded and digitized the Folkways collection while enhancing and organizing its metadata, all of which are now available electronically.

FiW is collaborative: multiple avatars can enter the space, audition track samples, contribute their own sounds (speech or other) to the soundscape, and also communicate through text chat. Nearby users can hear music together, as well as hear and see each other. Wonderland also provides in-world collaborative applications, such as a shared web browser or whiteboard. Thus users are provided with a real-time, immersive, audiovisual representation of the virtual sociomusical environment, together with multiple means of communicating within it.

This according to “Folkways in Wonderland” by Rasika Ranaweera, Michael Frishkopf, and Michael Cohen (Sound matters 3 March 2015).

Above, a screenshot of a typical session (click to enlarge); below, a brief demonstration.

Comments Off on Folkways in Wonderland

Filed under Resources, World music

Musik und Klangkultur

Musik--Raum--Technik

In 2014 transcript Verlag launched the series Musik und Klangkultur with Musik—Raum—Technik: Zur Entwicklung und Anwendung der graphischen Programmierumgebung Max.

The book discusses the visual programming language for music and multimedia known as Max. After over two decades of development and application, Max has become a sort of international lingua franca in practically-oriented music, art, and media institutions. A complete cultural-historical survey is presented, in which the software figures as the product of a specific sphere of aesthetic practice, which retroactively evokes innovative production structures. The focus of the analysis thus becomes the reciprocal influences of technological and artistic production.

Below, a demonstration of Percussa AudioCubes, an electronic musical instrument that allows users to create Max/Msp patches using an OSC server.

Comments Off on Musik und Klangkultur

Filed under 20th- and 21st-century music, New series, Science

Slime mold music

Physarum polycephalum

Die Lebensfreude is a pioneering piece of music composed with the aid of an amoeba-like plasmodial slime mold called physarum polycephalum.

The composition is for an ensemble of five instruments (flute, clarinet, violin, cello and piano) and six channels of electronically synthesized sounds. The instrumental parts and the synthesized sounds are musifications and sonifications, respectively, of a multi-agent based simulation of physarum foraging for food.

Physarum polycephalum inhabits cool, moist, shaded areas over decaying plant matter, and it eats nutrients such as oat flakes, bacteria, and dead organic matter. It is a biological computing substrate, and has been enjoying much popularity within the unconventional computing research community for its astonishing computational properties.

This according to “Harnessing the intelligence of physarum polycephalum for unconventional computing-aided musical composition”by Eduardo R. Miranda, an article included in Music and unconventional computing (London: AISB, 2013).

Many thanks to the Annals of Improbable Research for bringing this to our attention! Above, the co-composer; below, the work’s premiere.

Comments Off on Slime mold music

Filed under 20th- and 21st-century music, Curiosities, Nature, Science

Computational ethnomusicology

Block diagram

The June 2013 issue of Journal of new music research (XLII/2) is a special issue devoted to computational ethnomusicology.

The editors, Emilia Gómez, Perfecto Herrera, and Francisco Gómez-Martin, explain that the term computational ethnomusicology is over 30 years old, but it has recently been redefined as “the design, development, and usage of computer tools that have the potential to assist in ethnomusicological research.”

Above, a diagram of the Tarsos platform from “Tarsos, a modular platform for precise pitch analysis of Western and non-Western music” by Joren Six, Olmo Cornelis, and Marc Leman (pp. 113–29). Below, a vintage computer cover of The house of the rising sun.

1 Comment

Filed under Ethnomusicology, Science