Please use this identifier to cite or link to this item:
https://doi.org/10.1145/3581783.3612272
Title: | Elucidate Gender Fairness in Singing Voice Transcription | Authors: | Gu, X Zeng, W Wang, Y |
Issue Date: | 26-Oct-2023 | Publisher: | ACM | Citation: | Gu, X, Zeng, W, Wang, Y (2023-10-26). Elucidate Gender Fairness in Singing Voice Transcription. MM '23: The 31st ACM International Conference on Multimedia : 8760-8769. ScholarBank@NUS Repository. https://doi.org/10.1145/3581783.3612272 | Abstract: | It is widely known that males and females typically possess different sound characteristics when singing, such as timbre and pitch, but it has never been explored whether these gender-based characteristics lead to a performance disparity in singing voice transcription (SVT), whose target includes pitch. Such a disparity could cause fairness issues and severely affect the user experience of downstream SVT applications. Motivated by this, we first demonstrate the female superiority of SVT systems, which is observed across different models and datasets. We find that different pitch distributions, rather than gender data imbalance, contribute to this disparity. To address this issue, we propose using an attribute predictor to predict gender labels and adversarially training the SVT system to enforce the gender-invariance of acoustic representations. Leveraging the prior knowledge that pitch distributions may contribute to the gender bias, we propose conditionally aligning acoustic representations between demographic groups by feeding note events to the attribute predictor. Empirical experiments on multiple benchmark SVT datasets show that our method significantly reduces gender bias (up to more than 50%) with negligible degradation of overall SVT performance, on both in-domain and out-of-domain singing data, thus offering a better fairness-utility trade-off. | Source Title: | MM '23: The 31st ACM International Conference on Multimedia | URI: | https://scholarbank.nus.edu.sg/handle/10635/246634 | ISBN: | 9798400701085 | DOI: | 10.1145/3581783.3612272 |
Appears in Collections: | Staff Publications Elements |
Show full item record
Files in This Item:
File | Description | Size | Format | Access Settings | Version | |
---|---|---|---|---|---|---|
2023_ACM_MM2023_Fairness_Singing_camera_ready.pdf | Accepted version | 1.43 MB | Adobe PDF | CLOSED | None |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.