I sprayed soapy water on the belt and I had the exact same problem and the noise went away.
The bearing on the tensioner wheel of the serpentine belt is worked in my case. I confirmed after removing the belt. I still don't have the tensioner wheel changes though.
Hopefully the soapy water...