SSL

emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

We propose emotion2vec, a universal speech emotion representation model. emotion2vec is pre-trained on open-source unlabeled emotion …

Ziyang Ma, Zhisheng Zheng, Jiaxin Ye, Jinchao Li, Zhifu Gao, Shiliang Zhang, Xie Chen

emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representation

Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning

Recent years have witnessed significant advancements in self-supervised learning (SSL) methods for speech-processing tasks. Various …

Guanrou Yang, Ziyang Ma, Zhisheng Zheng, Yakun Song, Zhikang Niu, Xie Chen

Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning

Pushing the Limits of Unsupervised Unit Discovery for SSL Speech Representation

The excellent generalization ability of self-supervised learning (SSL) for speech foundation models has garnered significant attention. …

Ziyang Ma, Zhisheng Zheng, Guanrou Yang, Yu Wang, Chao Zhang, Xie Chen

Pushing the Limits of Unsupervised Unit Discovery for SSL Speech Representation

Unsupervised Active Learning: Optimizing Labeling Cost-Effectiveness for Automatic Speech Recognition

In recent years, speech-based self-supervised learning (SSL) has made significant progress in various tasks, including automatic speech …

Zhisheng Zheng, Ziyang Ma, Yu Wang, Xie Chen

Unsupervised Active Learning: Optimizing Labeling Cost-Effectiveness for Automatic Speech Recognition

FRONT-END ADAPTER: ADAPTING FRONT-END INPUT OF SPEECH BASED SELF-SUPERVISED LEARNING FOR SPEECH RECOGNITION

Recent years have witnessed a boom in self-supervised learning (SSL) in various areas including speech processing. Speech based SSL …

Xie Chen, Ziyang Ma, Changli Tang, Yujin Wang, Zhisheng Zheng

FRONT-END ADAPTER: ADAPTING FRONT-END INPUT OF SPEECH BASED SELF-SUPERVISED LEARNING FOR SPEECH RECOGNITION

MT4SSL: Boosting Self-Supervised Speech Representation Learning by Integrating Multiple Targets

In this paper, we provide a new perspective on self-supervised speech models from how the self-training targets are obtained. We …

Ziyang Ma, Zhisheng Zheng, Changli Tang, Yujin Wang, Xie Chen

MT4SSL: Boosting Self-Supervised Speech Representation Learning by Integrating Multiple Targets

EXPLORING EFFECTIVE DISTILLATION OF SELF-SUPERVISED SPEECH MODELS FOR AUTOMATIC SPEECH RECOGNITION

Recent years have witnessed great strides in self-supervised learning (SSL) on the speech processing. The SSL model is normally …

Yujin Wang, Changli Tang, Ziyang Ma, Zhisheng Zheng, Xie Chen, Wei-Qiang Zhang

EXPLORING EFFECTIVE DISTILLATION OF SELF-SUPERVISED SPEECH MODELS FOR AUTOMATIC SPEECH RECOGNITION