Other than that, is your regular email working?
There were multiple problems with my setup from the start. I built my website using one of the Muse templates, so my reply email address was a fictional one from the template.
When I launched and switched my url from GoDaddy to Business Catalyst, my email quit working altogether because email was being hosted by GoDaddy. I needed to go in and change the 'name servers' at the GoDaddy site to point to Business Catalyst.
It was strange for me as well, because it seemed to work perfectly when I first launched the website. The next day the auto-reply stopped working. Then a day later, my email quit working.
If your email is working apart from the website issue, then I don't know what to say. I'm learning this stuff as I go.