Ejecting SD card takes a long time and CPU usage goes up

I'm on Mavericks and after I eject most SD cards, it takes a minute or two and process UASysAgent is taking 80% of the CPU... quite annoying, does anyone else experience this? Something that can be done about it?