Just not always in a good way. As in, “Ow!”
Sure it matters, in the same way that big breasts matter to men. It’s an attention getter, and a symbol of pleasure. But it isn’t going to be a make-or-break kind of thing. Would you turn down sex with a woman you otherwise were attracted to because her breasts were too small? I didn’t think so.
No, what kills the deal is more likely to be your lack of bathing, or that big tattoo on your beer gut that says “Pussy Patrol”.
One of the ways that penises are enlarged is by surgery. They will inject silicone or graft on necrotic tissue to give it added girth, and they cut two ligaments so that more of it extends outside the body, resulting in a gain of about an inch. Getting that tattoo removed sounds to me like it would hurt a whole lot less.