Sounds like a faulty amplifier to me.
Have you tried shorting the input out (in effect ensuring the input is zero)?

Steve.