Yeah the wool sweater with windshear is NOT something you would layer underneath anything, too heavy.
If your only going to be using it under a hoodie would it have to be blaze?
There are blaze jackets, 3/4 zip pull overs and such out there, but many can be quite expensive if they are lined with some form of windblocking fabric.
If money is not an object, here is one although not all blaze that could work:
https://www.ebay.com/itm/Cabelas-GO...rproof-Softshell-Hunting-Jacket-/351194700646
Forgot to mention I also have one of these which I have worn under a blaze shell which works pretty good.
https://www.amazon.com/Beretta-Mens-Barrier-Short-Sweater/dp/B00S0WXN8G
A lighter weight version of the Cabela's wool windshear sweater.