If you get out 4-5 times a month with kids your one of the lucky ones!  Wait until they start playing sports.  Your 4-5 times a month could turn into 4-5 times a season. 
Mine are getting older and more self dependant.  So my hunting and fishing days are on the increase again!
But, I  wouldn't have traded going hunting or fishing for doing something with the family for all the birds in the world.  It only lasts a short while so enjoy it while you can.  Even if it means a lot less hunting.
Concentrate on what you like the best.  For me it's always been waterfowling.  Ever since I was a kid so that's what I do 90 percent of the season.  This year however my plans are to quail hunt a little more than I have in the past.