Maybe your son is just really asking for more "down" time.  We ask a lot of our kids these days, and frankly, I'm not one who minds if kids just kind of veg  out and wear pajamas on the weekend if they've had a busy week.

You need to have peace with your need to go to church.  You're missing out on what it is you need if you're spending that time feeling guilty and/or anxious.  

I'll be honest.  I'd love it if all of my kids enjoyed and found meaning in all the things I enjoy and find meaning in.  It hasn't happened.  We share some things, and some things, well, we're different.  And that's all right.  They do however, share my values.  Sharing values really has little to do with sharing enjoyment of the same activities.