Instead of the cross, the Albatross
About my neck was hung."
Suggests the divine nature of the Albatross, and how it functions as a sort of cross in its own right. Yet hung around his neck, it is a symbol of his sins.
This is also where the phrase “an albatross around my neck” comes from.
To help improve the meaning of these lyrics, visit "Rime Of The Ancient Mariner" by Samuel Taylor Coleridge and leave a comment on the lyrics box