Now let me clarify, I love the church, I love the Bible, and yes I believe in sin
A clear statement that delineates between the church and religion. The body of Christ is called the church; this does not refer to a building. Jefferson is saying he loves the body of Christ, he loves the bible (which absolutely includes rules about how Christians should live and conduct themselves) and he is acknowledging that their is a such thing as sin, which everyone has committed.
To help improve the meaning of these lyrics, visit "Why I Hate Religion, But Love Jesus (Spoken Word)" by Jefferson Bethke and leave a comment on the lyrics box