Can't delete apps that are no longer available in App Store

I have four apps that are no longer available in the App Store. They're not installed on my phone (which is fine). Every time I connect my iPhone to I get this message in iTunes: "Some of the apps in your iTunes library were not installed on the iPhone because one or more errors occurred." (Screenshot)

In iTunes I can search for the app and the icon is grayed out: http://ift.tt/1FMio2L Click Install does nothing.

I've searched for these apps on the App Store and they're not there. How do I remove all four of these apps to avoid getting that message when connecting my phone to my computer?