Gloves. This will vary depending on how cold blooded you are, how cold your hands get.
First of all, I _always_ wear gloves. Years and years ago I picked up a cripped rooster that was a young man 's first bird. While we looked for it his dad said they were going to mount it. When my Lab tracked the runner down and brought it in, I took it gently and it promptly spurred me and split my thumb. Gloves ever since. Plus, they're nice in the brambles.
Now, I don't use heavy gloves. I find if I keep my body core warm with clothing my hands don't get all that cold.
So, my choice: thin goatskin gloves, gunn cut, keystone thumb. These can be hard to find so when you find them and they fit, buy two pair. I pick mine up at a Cenex station in SD when I'm up there and I need some new ones. Generally $12-15/pair.
Second choice is the Plainsman Leather Gloves you can find at Sam's Club. $20 for two pair. They are cabretta (sheep skin) and don't last me as long as the goatskin ones. They are nice and thin though; great feel.
Either one of these are thin and flexible enough that manipulating safeties and triggers is not a problem.
I do have some thin silk glove liners that I will wear under the goat if it gets really cold. Generally though I can go with just the goatskin until it gets significantly below zero.
Just my two cents; your mileage may vary.