The Labs I would really have no interest in owning (other than the invented colors which are total non-starters) are the NBP (No Black Pigment or "Dudley") yellow labs.
These, in the experience of friends that have owned them, seem to have a higher incidence of health related problems like allergies. For the most part they have also been so-so field dogs. Admittedly, it is a small sample size but I've yet to see a NBP that I'd want to own. I'm sure there are exceptions I haven't seen.