final project

The idea becomes a machine that makes the art.

Sol LeWitt

The final project will be a polished, hand crafted/coded interactive and/or generative musical system published on the web. If it’s an interactive system, like a digital instrument, it should allow users to interact with it and generate sounds in a meaningful way. This should not be a web-based version of an existing instrument (like a guitar or piano) but rather something more experimental which embraces the creative possibilities of the Web. If you create a generative (non-interactive) musical composition, it should not be coded version of a pre-existing song or melody and ideally not something that could be easily written as a classical score, rather it should be a composition that leverages the generative potential of the Web. Submit a publicly accessible URL on canvas and be prepared to present it in a class for critique. You’ll be expected to demo/perform and briefly explain your concept, approach, and key challenges.

Points to Consider

1. Level of Abstraction, think about which tools you'd like to use to generate sound. we've introduced multiple layers of abstraction, the higher the level the easier to use (but the more pre-defined the sound will be) the lowest level is most difficult to use (but the least defined and most malliable). These break down as follows (from high-level to low-level):

• Tone.js "Instruments" (docs / demos) Tone.js provides a list of classes (which it calls "instruments") for generating sounds, most are created using some pre-built combination of Oscillators (one exception being the Tone.js Sampler: docs / demo) attached to an AmplitudeEnvelope (so that our sounds have that more natural sounding ADSR envelope when we play them). These come with a variety of different settings we can modify, either by setting them manually (as with the present examples) or adjusting them with UI we create (like buttons or input range sliders) or algorithmically (ex: by "modulating" them with an LFO)
• Tone.js "Sources" (docs / demos) Tone.js also provides different types of Oscillators (beyond the basic "sine", "square", "triangle" and "sawtooth") which are made from some combination of nodes and thus have other properties besides frequency (or pitch) volume (or amplitude) and type (or shape). Similarly, the Tone.js Player (docs / demo) and Players (docs) allow us to create instruments from pre-recorded sound files without having to work directly with audio buffers.
• Keep in mind that the Tone.js classes (both the oscillators and higher level "instruments") are really just different combinations of a small set of lower level nodes, namely the basic Oscillator, the basic GainNode and the LFO (with occasional help from some of Tone.js's signal math classes). The big difference between the Tone.js Oscillators and Instruments is that the latter all have an AmplitudeEnvelope plugged in at the end (for that ADSR).
• At the lowest level you can work directly with audio buffers, at the end of the day all the interfaces/nodes mentioned above are just ways of creating buffers by describing higher level concepts (like "frequency") as opposed to thinking mathematically about the actual values representing that signal (or sound wave), you could of course create any sound from pure maths, which is what working with buffers directly allows for.

2. Timbre, think about what you want your sounds to sound like. On one end of the spectrum we have a simple sine wave, on the other end we have pure noise, there's loads of space in-between. a big part of making your sound your own will be shaping it's timbre (it's texture or flavor).

• Besides adjusting the properties built into the Oscillators and Instruments in Tone.js, we can also shape our sound by adding to our audio graph (or signal chain) some of Tone.js's Effects classes (docs / demos). These too have their own properties which can be modified, controlled (with UI) or modulated (with code like LFOs), and don't forget, as with the source nodes themselves, u can create your own types of effects from some of the more "core" or basic types of effect nodes, namely Delay, Reverb and Distortion (most of the other effects are really some combination of those with Oscillators and LFOs)

3. Controls, If your piece is interactive, think about what aspect of the sound generation you want to be able to control and in what way. Some might be obvious (most instruments let you control the frequency, ie. which note/pitch is played) but some controls might be less obvious and more specific to the design of your piece. We've gone over some basic UI as well as how to use the mouse/trackpad and the keyboard as inputs, as well as MIDI controllers and even our video camera (with the help of AI).