It really sounds like he was trying to make you uncomfortable enough not to come back.
I had something similar with local hunters trying to scare us off. My son, a friend and I were coming down a dirt section line in a truck with Utah plates. We were waived down by 2 hunters (local plates on truck) and told "they controlled the land on either side of the section line and we needed to turn around as they were hunting here, we needed to leave" and were pretty obstinate about it.
It didn't end well for them though, the friend with me is a state game warden (different district), the land they "controlled", was mine
I had something similar with local hunters trying to scare us off. My son, a friend and I were coming down a dirt section line in a truck with Utah plates. We were waived down by 2 hunters (local plates on truck) and told "they controlled the land on either side of the section line and we needed to turn around as they were hunting here, we needed to leave" and were pretty obstinate about it.
It didn't end well for them though, the friend with me is a state game warden (different district), the land they "controlled", was mine