The Presbyterian Church was formed in the British Isles and was influenced by Christianity. The nymphs on the ceiling look very Christian-like to Wolfshiem, which probably annoys him, since he is Jewish.
The founder of the Presbyterian Church, John Calvin actually used this quote to express his feelings on Jews, so this could also be a reason why Wolfshiem isn’t pleased to see the painting.
The Jews rotten and unbending stiffneckedness deserves that they be oppressed unendingly and without measure or end and that they die in their misery without the pity of anyone.
To help improve the meaning of these lyrics, visit “The Great Gatsby (Chapter IV)” by F. Scott Fitzgerald and leave a comment on the lyrics box