Potentially. Alcohol consumption can lead to adverse effects to the male reproductive system. Source:
From that article: “Research with animals has consistently demonstrated an association between both acute (i.e., one time, one occasion) and chronic (i.e., long-term) alcohol consumption and low testosterone.”
So, to the extent that a healthy endocrine system and adequate testosterone is necessary to maintain or increase your penis size, alcohol could potentially hurt.