Best Fit Activation Functions for Attention Mechanism: Comparison and Enhancement.

Maan Alhazmi, Abdulrahman Altahhan

Browse the full IJCNN paper archive.