iPhone 4 would not turn on

I got an IPhone 4 yesterday and it would only turn on when it's plugged and I bought it new, and it would turn off when I remove from the plug. Please help!