Skip to article frontmatterSkip to article content
Disclaimer: Textbook in development

Introduction

Introduction

Book cover

This textbook is written for the course MUS2640 Sensing Sound and Music at the University of Oslo, a foundation course for later studies in music psychology and music technology. You will be introduced to fundamental principles of acoustics, psychoacoustics, and perception. This includes knowledge about how sound is produced in instruments, reflected in space, and perceived by humans. This is the basis for how we experience pitch, timbre, harmony, and rhythm in music. You will also learn about computer-based representations of sound and music, and get an overview of digital audio, sound synthesis, and analysis. The course provides theoretical knowledge and practical skills for further studies of music psychology and technology.

Pedagogical Strategy

Students in the course typically have mixed backgrounds. Everyone usually has some kind of musical background, ranging from classical performance on acoustic instruments to electronic studio production. Some come from musicology, others from psychology, informatics, media studies, philosophy, linguistics, medicine, and more. Everyone is welcome! In-class activities will be adjusted to cater to the collective knowledge and experience of the student group.

Active learning and “flipped classroom”

This course builds on the idea of active learning, an approach that emphasizes student engagement and participation in the learning process. Rather than passively receiving information through lectures, students are encouraged to interact with the material, ask questions, solve problems, and collaborate with peers. Activities may include group discussions, hands-on experiments, peer reviewing, and real-world projects. This method helps deepen understanding, improve retention, and develop critical thinking skills.

We also rely on a flipped classroom* approach, which is a teaching model where traditional lecture content is delivered outside of class, typically through readings, videos, or interactive resources. This frees up classroom time to apply concepts through discussion, exercises, and collaborative work. This structure allows students to learn foundational material at their own pace and use class sessions for deeper exploration, clarification, and practical application. The flipped classroom model fosters a more personalized and interactive learning environment, supporting diverse learning styles.

A research-based and research-led course

This is a research-based course, which means that the content builds on new research results. All the teachers are active researchers and will bring in perspectives from ongoing projects. Much of this is based on scientific methods, but given the nature of the subject, we also include research that is design-centered or based in artistic practice. We will dwell on these differences at times, since understanding the different epistemological foundations for our knowledge production is important.

The course is also research-led, meaning that students will take part in ongoing research. This makes it possible for students to see how “real” research is conducted in practice. It is also valuable for the ongoing projects in the department. Although it is not required, you are encouraged to participate in research activities, contributing to ongoing projects or initiating new ones. This hands-on involvement helps bridge the gap between learning and research, fostering a culture of inquiry and innovation.

Open Education

The course material is developed from the perspective of Open Education, meaning that all material is freely and openly available. This approach ensures that students have unrestricted access to resources, enabling them to revisit and explore the material beyond the course duration. Open Education also promotes collaboration and sharing of knowledge within and outside the academic community. This is important for societal innovation and the legitimization of ongoing research.

Open Education aligns closely with the principles of Open Research, which emphasize transparency, accessibility, and reproducibility. In this course, we aim to integrate these principles by providing access to:

By adopting these practices, the course not only supports students in their academic journey but also contributes to the global movement toward open and equitable access to knowledge. This approach empowers students to become active participants in the creation and dissemination of knowledge, preparing them for future roles as researchers, educators, and innovators.

Embracing AI

In this course, we will actively explore the use of artificial intelligence both for exploring the content of the course but also as a pedagogical tool. There are currently many available AI tools, yet they are underexploited. We will try different tools and evaluate their effectiveness.

This textbook is an example of AI-based co-creation. Sections of the text are partly written by large language models. However, the text has been going through a human “peer review” to ensure that everything makes sense. Throughout the course, we will explore when AI can safely be used for text generation and when it fails.

In this class, you are encouraged to use AI actively. AI-powered platforms can adapt content and feedback to individual learning styles and paces, helping you master concepts more effectively. However, AI-based tools should be used wisely; they are there to help learning, not to replace it. After all, the exam will be performed without any tools. Then you will need to think and write on your own!

Tools

We will explore various tools throughout the semester. You will not learn any of these in detail, but you will see how they work and understand their applications. These tools are designed to provide a broad overview of the possibilities in music technology and sound analysis.

PC Software

We will use the following software, most of which are free and/or open source. They are also all cross-platform, that is, they work on both Windows, OSX, and Linux-based systems.

  • Sonic Visualiser: A powerful application for viewing and analyzing the contents of audio files. It allows you to visualize waveforms, spectrograms, and other audio features, making it a valuable tool for music analysis and research.

  • Audacity: A free, open-source, cross-platform audio editor and recorder. Audacity is widely used for recording, editing, and processing audio files, making it a versatile tool for both beginners and advanced users in music and sound analysis.

  • Python - Jupyter Notebook: An open-source web application that enables you to create and share documents containing live code, equations, visualizations, and narrative text. It is widely used for data analysis, including audio and music data.

  • Pure Data (Pd): An open-source visual programming language for audio and multimedia. It is widely used for sound synthesis, audio processing, and interactive installations. It resembles the commercial package Max.

  • Audiostellar: A unique tool for exploring and organizing sound samples using a visual interface. It helps you discover relationships between sounds and create new compositions.

  • Freesound: A collaborative online database of sound samples. It provides access to a wide variety of sounds that can be used for music production, sound design, and research.

Phone apps
We will use these free and cross-platform apps, working on both Android and iOS devices.
  • Noise Capture: A mobile app for recording and analyzing environmental noise. It is useful for studying soundscapes and understanding the impact of noise in different environments.

  • SensorLogger: A mobile app for recording and visualizing sensor data from your smartphone, such as accelerometer, gyroscope, magnetometer, and more. SensorLogger enables you to collect, export, and analyze movement and environmental data, making it useful for experiments in sound, music, and motion research.

Hardware
We will explore these devices in class. You are not expected to purchase these yourself; we have them available to borrow.
  • LittleBits: A platform of modular electronic components that snap together to create interactive projects. It is a fun and creative way to explore sound synthesis and music-making.

  • Ambisonics - Zoom H3-VR: A portable recorder designed for capturing 360-degree spatial audio. It is ideal for creating immersive soundscapes and exploring 3D audio reproduction.

  • OptiTrack Motion Capture: A high-precision motion capture system used for tracking movement in 3D space. It is widely used in research, gaming, and performance arts to analyze and visualize motion, including applications in music and sound interaction.

  • Equivital Life Monitors: Wearable devices designed to monitor physiological data such as heart rate, respiration, and body temperature. These devices are useful for studying the relationship between physiological responses and musical experiences.

Curriculum

The current textbook comprises the core curriculum for this course. Interested readers can find a lot of more information in the texts listed below as well as in the references section for each chapter.

Some short introduction books
Some large reference works
Some books serve more as large-scale references of their respective fields:
  • Handbook of Systematic Musicology: Edited by multiple authors (2020), Springer. A detailed reference for interdisciplinary approaches to the study of musicology.

  • The Oxford Handbook of Music Psychology: Edited by Susan Hallam, Michael Thaut, Ian Cross (2018), Oxford: Oxford University Press. A comprehensive overview of research and theories in music psychology.

  • The Computer Music Tutorial, Second Edition: Curtis Roads (2023), Cambridge: The MIT Press. An extensively updated and expanded reference covering the latest developments in computer music, including new technologies, techniques, and applications.

Relevant Norwegian-language books
There are not many relevant books in Norwegian, but here are some:

Overview

This textbook is divided into chapters corresponding to the lectures in the course.

Learn more