Engineering:Sounds of New York City

From HandWiki
Short description: Noise monitoring research project


Acoustic sensor nodes deployed on New York City streets as part of the SONYC project.

Sounds of New York City (SONYC) is an urban noise monitoring research project led by researchers at New York University to study and mitigate noise pollution in New York City. The project combines a distributed acoustic sensor network, machine listening methods, data analytics, visualization tools and citizen science annotation of urban sound recordings.[1] Its published work uses the term machine listening for machine-learning and audio-signal-processing systems that identify or classify sources in urban sound scenes.[1][2]

SONYC was developed by researchers at NYU, including the Center for Urban Science and Progress, the Music and Audio Research Laboratory, NYU Tandon School of Engineering and NYU Steinhardt, with collaborators at Ohio State University.[3] The project received a US$4.6 million National Science Foundation grant as a multi-year cyber-physical system initiative.[4][5]

Background

New York City receives more 311 complaints about noise than about any other civic issue, but complaint records are limited by spatial, temporal and demographic biases and by the delay between a complaint and an inspection.[6] SONYC was designed to provide continuous, source-specific measurements that could supplement complaint-based enforcement and conventional sound-pressure-level measurements.[1][6]

A 2019 Communications of the ACM article described SONYC as a cyber-physical systems approach to monitoring, analysis and mitigation of urban noise pollution. The system was presented as a loop connecting intelligent sensing, city-scale noise analysis and data-driven mitigation by city agencies or other actors able to reduce emissions.[1]

Development

Low-cost acoustic sensors and MKI

Digital MEMS microphone module used in a SONYC acoustic sensor node.

Early SONYC work focused on whether inexpensive hardware could produce calibrated environmental noise measurements. A 2017 Applied Acoustics paper described a smart, low-cost, static acoustic sensing device based on consumer hardware, with a focus on calibrating a MEMS microphone to generate reliable decibel readings at type/class 2 accuracy.[7]

A 2022 ICCPS paper referred to the first deployed sensor platform as MKI or "Mach 1". The MKI network consisted of microphone-equipped Raspberry Pi 2B devices connected through Wi-Fi and managed by a private cloud infrastructure.[8] Earlier project materials also used the spelling "MK1" for the MEMS microphone platform.[9]

Sensor network

Operational data flow of the SONYC capture module, including audio processing and storage steps.

The first SONYC sensor was deployed in May 2016. By 2019, the sensor network consisted of 55 remote acoustic sensors across New York City and had collected more than 75 years of calibrated high-resolution sound-pressure-level measurements and 35 years of audio data.[6] The system also collected telemetry used to monitor sensor health and to develop a prototype pre-failure detection model.[6]

The 2019 sensor-network paper described the deployed nodes as low-cost acoustic sensors built largely from off-the-shelf hardware. Each node used a Raspberry Pi 2B single-board computer, an external network connection and a custom digital MEMS microphone module. The parts cost of the node core was reported as about US$80, excluding deployment, housing and other operational costs.[6] The custom acoustic module had an effective dynamic range of 32–120 dBA and was calibrated against a precision sound-level meter to comply with IEC 61672-1 Type 2 accuracy for sound-pressure-level data.[6]

SONYC sensors record sound-pressure-level data continuously and collect encrypted 10-second audio snippets at randomized intervals. The snippets are used to support supervised machine learning for automatic noise-source identification, while randomized sampling is intended to reduce the risk of reconstructing conversations.[6][3]

Machine listening and datasets

SONYC publications generally describe the automatic analysis of sound recordings as machine listening. The project has also described the approach as supervised machine learning: humans annotate recordings with the sound sources they hear, and the resulting database is used to train computers to recognize similar sounds.[3] In 2018 the project launched an audio annotation campaign on the Zooniverse citizen-science platform to teach machine-listening algorithms about urban sound.[10]

The SONYC Urban Sound Tagging dataset, known as SONYC-UST, was released for the development and evaluation of machine-listening systems for urban noise monitoring. The 2019 DCASE Urban Sound Tagging task used 10-second recordings from the SONYC acoustic sensor network and asked systems to detect the presence of 23 noise-source tags in each recording.[2] SONYC-UST v1.0 contained 2,794 recordings, while SONYC-UST v2.3, also known as SONYC-UST with Spatiotemporal Context, contained about 18,500 recordings with metadata describing when and where the audio was recorded.[11][12]

Data analysis and visualization

Infrastructure overview of the SONYC sensor network.

SONYC research also produced tools for analyzing large acoustic time series and audio collections. The Time Lattice data structure and Noise Profiler interface were developed for interactive visual analysis of sound-pressure-level data from SONYC sensors.[13] A later visual analytics system, Urban Rhapsody, combined audio representations, machine learning and visual analytics for interactive exploration of large urban soundscape datasets.[14]

MKII

A later phase of SONYC extended the original two-tier wireless sensor network into a three-tier in-situ noise-complaint monitoring network. A 2022 ICCPS paper described the added tier as a network of MKII or "Mach 2" low-power acoustic motes using long-range LoRa multi-hop networking and edge machine learning.[8] The MKII paper described the system as an infrastructure-free extension to the existing SONYC data-collection network, intended for locations such as construction zones where power and network infrastructure may not be readily available.[8]

MKII used a digital I2S MEMS microphone acoustic front end, a LoRa radio, solar energy harvesting, lithium-titanate cells, power-management and computing microcontrollers, and local machine-learning components including a convolutional-neural-network embedding model and a downstream noise-source classifier.[8] The paper reported overall runtime power consumption of 107 mW in classification mode and described SONYC-L3 as a mote-scale machine-listening CNN for urban sound classification.[8]

SONYC Home

In 2020 SONYC received a US$400,000 NSF Transfer to Practice supplement to translate lessons from the street-level sensor network into a domestic noise sensor for residents experiencing recurring noise problems. The team announced partnerships with the product development agency Loft LLC and the New York City Department of Environmental Protection to design sensors suitable for domestic deployment.[15]

The resulting work, referred to as SONYC Home in project repositories, used acoustic sensors deployed outside participants' apartments to collect sound-level data and support machine-learning classifications. The project repository describes a system combining sensors, central servers, visualization and reporting tools, and user engagement for monitoring domestic urban noise issues.[16]

Privacy

Public notice explaining nearby SONYC audio recording.

Because SONYC sensors use environmental audio, the project has addressed privacy concerns about incidental speech recording. The project FAQ states that SONYC is interested in identifying the presence of voice as a sound category rather than the content or identity of speakers, that raw audio access is restricted, and that a mature operational sensor network would transmit statistical descriptions rather than reconstructable audio.[3] The same FAQ says that sample recordings were reviewed by independent acoustical consultants for conversational recognizability and that NYU's Institutional Review Board reviewed the research.[3]

Funding

SONYC began with seed support from NYU's Center for Urban Science and Progress and later received a US$4.6 million National Science Foundation grant under NSF award CNS-1544753.[3][4] The project FAQ states that SONYC had not received funding from the City of New York or its agencies.[3] A 2019 paper on the SONYC sensor network also credited NSF award CNS-1544753 and initial CUSP seed funding, and acknowledged the New York City Department of Environmental Protection for input and support.[6]

Additional support included the 2020 US$400,000 NSF Transfer to Practice supplement for the domestic noise-sensor work.[15] In 2020, NYU Tandon's Center for K12 STEM Education announced a one-year US$25,000 grant from Con Edison to support a SONYC summer school program for middle-school students.[17]

Reception and coverage

SONYC has been covered by technology, urban-policy and public-radio outlets as an example of applying artificial intelligence and distributed sensing to environmental noise. Smart Cities Dive described the project in 2017 as an effort by researchers from NYU and Ohio State University to use sensors to understand New York City's soundscape.[5] The Verge covered the project's Zooniverse annotation work in 2019, explaining how volunteer labels could help train algorithms to distinguish sources of noise.[18]

In a 2019 article about noise pollution as a public-health issue, The New Yorker discussed SONYC alongside other technological approaches to measuring and reducing urban noise.[19] WBUR reported on the project's attempt to use citizen and expert annotations to train computers to recognize sound sources relevant to the New York City noise code.[20]

See also

References

  1. ↑ 1.0 1.1 1.2 1.3 Bello, Juan P.; Silva, Claudio; Nov, Oded; DuBois, R. Luke; Arora, Anish; Salamon, Justin; Mydlarz, Charles; Doraiswamy, Harish (February 2019). "SONYC: A System for Monitoring, Analyzing, and Mitigating Urban Noise Pollution". Communications of the ACM 62 (2): 68–77. doi:10.1145/3224204. 
  2. ↑ 2.0 2.1 "Urban Sound Tagging". https://dcase.community/challenge2019/task-urban-sound-tagging. 
  3. ↑ 3.0 3.1 3.2 3.3 3.4 3.5 3.6 "FAQ". SONYC, New York University. https://wp.nyu.edu/sonyc/faq/. 
  4. ↑ 4.0 4.1 "SONYC awarded major grant from the National Science Foundation (NSF)". SONYC, New York University. November 7, 2016. https://wp.nyu.edu/sonyc/2016/11/07/sonyc-awarded-major-grant-from-the-national-science-foundation-nsf/. 
  5. ↑ 5.0 5.1 Griffith, Erin (June 14, 2017). "Sounds of NYC project aims to dull noises in the city that never sleeps". https://www.smartcitiesdive.com/news/sounds-of-nyc-project-aims-to-dull-noises-in-the-city-that-never-sleeps/444903/. 
  6. ↑ 6.0 6.1 6.2 6.3 6.4 6.5 6.6 6.7 Mydlarz, Charlie; Sharma, Mohit; Lockerman, Yitzchak; Steers, Ben; Silva, Claudio; Bello, Juan Pablo (2019). "The Life of a New York City Noise Sensor Network". Sensors 19 (6): 1415. doi:10.3390/s19061415. PMID 30909428. Bibcode: 2019Senso..19.1415M. 
  7. ↑ Mydlarz, Charlie; Salamon, Justin; Bello, Juan Pablo (2017). "The implementation of low-cost urban acoustic monitoring devices". Applied Acoustics 117: 207–218. doi:10.1016/j.apacoust.2016.06.010. Bibcode: 2017ApAc..117..207M. 
  8. ↑ 8.0 8.1 8.2 8.3 8.4 Yun, Jihoon; Srivastava, Sangeeta; Roy, Dhrubojyoti; Stohs, Nathan; Mydlarz, Charlie; Salman, Mahin; Steers, Bea; Bello, Juan Pablo et al. (2022). "Infrastructure-free, Deep Learned Urban Noise Monitoring at ~100mW". pp. 56–67. doi:10.1109/ICCPS54341.2022.00012. https://par.nsf.gov/servlets/purl/10394256. 
  9. ↑ Mydlarz, Charlie (June 16, 2016). "First journal publication: The Implementation of Low-cost Urban Acoustic Monitoring Devices". SONYC, New York University. https://wp.nyu.edu/sonyc/2016/06/16/first-journal-publication-the-implementation-of-low-cost-urban-acoustic-monitoring-devices/. 
  10. ↑ Cartwright, Mark (November 26, 2018). "SONYC launches new audio annotation campaign". SONYC, New York University. https://wp.nyu.edu/sonyc/2018/11/26/sonyc-launches-new-audio-annotation-campaign/. 
  11. ↑ "Resources". SONYC, New York University. https://wp.nyu.edu/sonyc/resources/. 
  12. ↑ Cartwright, Mark; Cramer, Jason; Mendez Mendez, Ana Elisa; Wang, Yu; Wu, Ho-Hsiang; Lostanlen, Vincent; Fuentes, Magdalena; Dove, Graham et al. (2020). "SONYC-UST-V2: An Urban Sound Tagging Dataset with Spatiotemporal Context". 
  13. ↑ Miranda, Fabio; Lage, Marcos; Doraiswamy, Harish; Mydlarz, Charlie; Salamon, Justin; Lockerman, Yitzchak; Freire, Juliana; Silva, Claudio T. (2018). "Time Lattice: A Data Structure for the Interactive Visual Analysis of Large Time Series". Computer Graphics Forum 37 (3): 13–22. doi:10.1111/cgf.13398. 
  14. ↑ Rulff, Joao; Miranda, Fabio; Hosseini, Maryam; Lage, Marcos; Cartwright, Mark; Dove, Graham; Bello, Juan; Silva, Claudio T. (2022). "Urban Rhapsody: Large-scale exploration of urban soundscapes". Computer Graphics Forum 41 (3): 209–221. doi:10.1111/cgf.14534. 
  15. ↑ 15.0 15.1 Dove, Graham (February 7, 2020). "SONYC awarded NSF TTP supplement to work on a domestic noise sensor". SONYC, New York University. https://wp.nyu.edu/sonyc/2020/02/07/sonyc-awarded-nsf-ttp-supplement-to-work-on-a-domestic-noise-sensor/. 
  16. ↑ "SONYC Home". sonyc-project. https://github.com/sonyc-project/SONYC-Home. 
  17. ↑ Dove, Graham (November 4, 2020). "SONYC Summer School Program Receives $25,000 from ConEdison". SONYC, New York University. https://wp.nyu.edu/sonyc/2020/11/04/sonyc-summer-school-program-receives-25000-from-conedison/. 
  18. ↑ Chen, Angela (March 10, 2019). "Help fight noise pollution by identifying these sound clips collected from urban sensors". https://www.theverge.com/2019/3/10/18254773/noise-pollution-sounds-new-york-city-sonyc-machine-learning-artificial-intelligence. 
  19. ↑ Owen, David (May 6, 2019). "Is Noise Pollution the Next Big Public-Health Crisis?". The New Yorker. https://www.newyorker.com/magazine/2019/05/13/is-noise-pollution-the-next-big-public-health-crisis. Retrieved May 15, 2026. 
  20. ↑ Miller-Medzon, Karyn (May 29, 2019). "Noise Is New York City's Biggest Civic Complaint. Researchers Are Trying To Help Turn It Down". https://www.wbur.org/hereandnow/2019/05/29/nyc-sound-noise-sonyc-project. 



Retrieved from "https://handwiki.org/wiki/index.php?title=Engineering:Sounds_of_New_York_City&oldid=4558220"