See remember he was called a glutton, and a drunkard by religious men
Matthew 11:19; Luke 7:34
When Jesus ate with the sinners and publicans he was ridiculed by the religious rulers. They couldn’t see how a teacher who taught about God could stand to tarnish his reputation by being seen at the homes of part of the most hated group of Jewish society. Publicans were people who were authorized by the Romans to hold office over other Jews; these people were generally hated because they used their offices and positions to take advantage of people, i.e. over taxing, charging high interest rates, etc. (these are not modern concepts).
To help improve the meaning of these lyrics, visit "Why I Hate Religion, But Love Jesus (Spoken Word)" by Jefferson Bethke and leave a comment on the lyrics box