Ubuntu slows down and hangs while copying file from/to USB

I used to get this really bad back on Ubuntu 14.04/12.04 etc. It's a lot better now, barely have an issue on an 18.04+ machine.