Abstract: Machine learning models based on artificial neural networks have been widely adopted to support diverse complex applications. However, the training of such models heavily relies on ...

Abstract: Transformer-based pre-trained models have gained much advance in recent years, Transformer architecture also becomes one of the most important backbones in natural language processing.