Trim the middle of a file name

I have a lot of files in a directory that have [!] in the file name. Is there a way to trim that out with a command in the terminal? Here's an example filename. file001[!].ext