If you've had to turn up the head unit a lot to make it loud enough to hear, the head unit internal amplifiers could be working very hard - which might explain why it's getting hot.
What % of max volume are you having to use ?
As said, if fitted, the LR amplifier is located under the front...