/webaudio

This is the base repository for all WebAudio classes and experiments

Primary LanguageTeX

▪ Welcome to WA-HEM

HEM WebAudio

Description

Can we understand the Internet as one of the major tasks that our generation must interpret, shape, and re-discover?

From studying the historical-societal and cultural environment of its foundation until the last implemented technologies on the browser, this class will focus on the creation of online instruments and art-pieces.

We'll exploring topics ranging from the philosophical basis of networked logic to more advanced coding of web-audio generators, interfaces and ML/IA algorithms. Examples will be demonstrated using js-html code editors (both online and offline), with a focus on musical aesthetics.

Presentations

Each student is required to make a personal repository on gitpod, repl.it, or github ,where all the class can access and share each other's projects. Also, students can propose a research presentation once during the course. The format for the presentations is quite open. They could be focused on performatic, instructional, theoretical or conceptual aspects of the materials presented in previous classes. You should include a link to documentation of your talk on the participatory webaudio-wiki.

Timeline

week 1. Hello Sound: Intro to Internet and Javascript-webaudio API.

week 2. Functions. Synthesis, variables, net-art, IMI.

week 3. Structures. loops, audioparams, css, git.

week 4. Interfaces. DOM, mouse and keyboard.

week 5. Scheduling. procedural music, intro to toneJS

week 6.Integration. toneJS synths and time notation.

week 8. Intro to LiveCoding, examples in Hydra, p5live and faust-live.

week 9. Networking. webRTC, streamJS, socketJS, kimi and youtube API.

week 10. Big data and machine learning. Python and Google Colab.

week 11.Scores. Liliypond, vexflow, guido-abc, kimi.

week 12. Sync. connections with OSC-JS. Miraweb- Max/MSP, and pd interpreters.

week 13. Metaverses. Mozilla Hubs, three.js, a-frame.

week 14. Projects.

week 15.Integrations.

Contents

Part I: The Network as a philosophy

  1. History of Internet
    • The internet Timeline. 40 maps of internet. Network studies
  2. Internet in Literature and Philosophy
    • From Plato, Aristotle, Spinoza, Kant to the linguistic studies, Pierce and Turin.
    • Twain, Forster, Asimov, Clarke, Lyotard, Gibson and Anderson.
  3. Highlights of Internet Art, net-art and Net-sound-art

Part II: The browser as a musical instrument

  1. Broswer as sound generator
    1. Intro to webaudio API
    2. simple sound generator
    3. Sampling
    4. Convolution and simple FX with js
  2. Browser as controller
    1. OSC-js
    2. Miraweb and Max/msp
  3. Browser as Dynamic Score Client-Server
    1. Video Sync, Bach, Kimi, P5js and different possibilities of visualization.
  4. Livecoding
    1. Orca and Code-golfing
    2. hydra
    3. p5live
    4. faust-live
  5. Intro to Machine Learning and IA
    1. Google collabs and Python servers.
    2. Text and Lyric generators: Aitextgen
    3. GAN-Network applied to AI orchestration.
    4. Vocalities: TTS, STT, and GPT2-3, Eleuther, Tacotron,
  6. Big data
    1. Music Information Retrieval (MIR) and big-data adquisition
    2. APIs and Node for Max. NPM: tonal, chords.js, freesound, wikipedia.

Part III: The Web as art

  1. Spatial audio, Mozilla hubs and Three.js
  2. Chatbots and Avatars-Performers
  3. Internet as topos: Net-poetry, hackitivism, the subject-object dicotomy, autonomous agency, emergency and complexity.

[Possible] Assignments

  • Assignment 1: Simple instrument using web-audio API
  • Assignment 2: Construction of an OSC Network-Controller
  • Assignment 3: Hubs or Three.js piece with Spatial Audio
  • Assignment 4: Adding ML, IA, MIR, APIs and BigData to prior projects.
  • Assignment 5: Final project.

Reading Materials

Required

Ropolyi, Lázló. Toward a Philosophy of the Internet. no. October, 2018.

Feenberg, Andrew. “Introduction toward a Critical Theory of the Internet.” (Re)Inventing The Internet: Critical Case Studies, vol. 9789460917349, 2012, doi:10.1007/978-94-6091-734-9_1.

Smus, Boris. Wed Audio API: Advanced Sound for Games and Interactive Apps. 2013.

Turner, William, and Steve Leonard. JavaScript for Sound Artists: Learn to Code with the Web Audio API. 2017,

Suggested

Internet studies and philosophy

Alcalá Casillas, Miryam Georgina. “La Galaxia Internet. Reflexiones Sobre Internet.” Revista Mexicana de Ciencias Políticas y Sociales, vol. 62, no. 231, 2017.

Daigle, Leslie. “On the Nature of the Internet.” Global Commission on Internet Governance, no. January 2013, 2015, pp. 1–28, https://www.cigionline.org/publications/nature-internet.

Dreyfus, Hubert L., et al. On the Internet. Routledge, 2009.

Feenberg, Andrew. (Re)Inventing The Internet: Critical Case Studies. Edited by Sense, vol. 9789460917, 2012, doi:10.1007/978-94-6091-734-9_1.

Manovich, Lev. Post-Media Aesthetics. 2001.

Ropolyi, Laszlo. An ‘Aristotelian’ Philosophy of the Internet. no. June, 2021, pp. 80–84, doi:10.1145/3462741.3466811.

Ropolyi, László. “Virtuality and Reality—Toward a Representation Ontology.” Philosophies, vol. 1, no. 1, 2015, pp. 40–54, doi:10.3390/philosophies1010040.

Ropolyi, Lázló. Toward a Philosophy of the Internet. no. October, 2018.

Net art

R., Catlow, et al. “Artists Re:Thinking the Blockchain.” Artists Re:Thinking the Blockchain, 2017, http://torquetorque.net/wp-content/uploads/ArtistsReThinkingTheBlockchain.pdf.

Taylor, Claire. “Place and Politics in Latin American Digital Culture: Location and Latin American Net Art.” Place and Politics in Latin American Digital Culture: Location and Latin American Net Art, 2014, pp. 1–206, doi:10.4324/9781315850238.

Javascript and webaudio

Smus, Boris. Wed Audio API: Advanced Sound for Games and Interactive Apps. 2013.

Haverbeke, Marijn. “Eloquent JavaScript.” International Immunology, vol. 24, no. 7, 2018, doi:10.1190/1.9781560801597.index.

Atencio, Luis. The Joy of JavaScript. Manning, 2021.

Flanagan. “JavaScript: The Definitive Guide: Master the World’s Most-Used Programming Language.” Packt Publishing Ltd, 2018.

Marcus, O. A. Javascript Simplified. 2021.

Frisbie, Matt. “Javascript Quick Reference Card.” Professional JavaScript® for Web Developers, 2019, pp. 13–24, doi:10.1002/9781119366560.ch2.

Turner, William, and Steve Leonard. JavaScript for Sound Artists: Learn to Code with the Web Audio API. 2017, http://hym-2017.corpuscodea.es/pdf/Leonard &Turner - JavaScript for sound artist (2017).pdf%0Ahttps://www.amazon.com/JavaScript-Sound-Artists-Learn-Audio/dp/1138961531/ref=sr_1_1?s=books&ie=UTF8&qid=1499323809&sr=1-1&keywords=JavaScript+for+sound+artists.

Vickler, Andy. Javascript Basics for Beginners. 2021.

Vickler, Andy. Javascript 3 Books in 1. 2021.

Lentzner, Remy. Getting Started with Javascript. Remylent, 2021.

P5js

Greenberg, Ira. “Processing: Creative Coding and Computational Art.” Processing, vol. 1, 2007, http://books.google.com/books?id=WTl\_7H5HUZAC\&pgis=1.

Mccarthy, Lauren, et al. Introducción a P5.Js. Processing Foundataion, 2016.

Terzidis, Kostas. Algorithms for Visual Design. 2009.

Three.js

Dirksen, Jos. Three.Js Cookbook. 2015, http://www.eskom.co.za/CustomerCare/TariffsAndCharges/Documents/RSA Distribution Tariff Code Vers 6.pdf%0Ahttp://www.nersa.org.za/.

Dirksen, J. Learning Three. Js: The JavaScript 3D Library for WebGL. 2013, http://books.google.com/books?hl=en\&lr=\&id=6TVeAQAAQBAJ\&oi=fnd\&pg=PT10\&dq=Learning+Three+.+js+:+The+JavaScript+3D+Library+for+WebGL\&ots=oZje\_vkIfH\&sig=8E-JDs88BoaFo2qi1rZEFajzk9M%5Cnhttp://books.google.co.uk/books?id=6TVeAQAAQBAJ.

Dirksen, Jos. Learn Three. 2018.

Josa, Jordi. How to Design 3d Games with Web Technology Three.Js. O'Reilly, 2017.

Games, Virtual and Expanded Reality

Gualeni, Stefano. “Virtual Worlds as Philosophical Tools.” Virtual Worlds as Philosophical Tools, 2015, doi:10.1057/9781137521781.

Gualeni, Stefano, and Daniel Vella. Virtual Existentialism: Meaning and Subjectivity in Virtual Worlds. 2020.

Gee, James Paul. “Unified Discourse Analysis.” Africa’s Potential for the Ecological Intensification of Agriculture, vol. 53, no. 9, 2013.

Yee, Nick. The Proteus Paradox. Yale University Press, 2014, http://marefateadyan.nashriyat.ir/node/150.

Phillips, Louise, and Ursula Plesner. Researching Virtual Worlds. 2014.

Doyle, Denise. “New Opportunities for Artistic Practice in Virtual Worlds.” New Opportunities for Artistic Practice in Virtual Worlds, 2015, doi:10.4018/978-1-4666-8384-6.

Kallmann, Marcelo, and Mubbasir Kapadia. “Geometric and Discrete Path Planning for Interactive Virtual Worlds.” Synthesis Lectures on Visual Computing, vol. 8, no. 1, 2016, doi:10.2200/s00687ed1v01y201512vcp023.

Gunkel, David J. “Gaming The System.” Africa’s Potential for the Ecological Intensification of Agriculture, vol. 53, no. 9India, Indiana University Press, 2018.

Magerstädt, Sylvie. Body, Soul and Cyberspace in Contemporary Science Fiction Cinema. Palgrave Macmillan, 2014, doi:10.1057/9781137399410.0001.