These must be chiefly, if not wholly, effects of the unsteadiness and injustice with which a factious spirit has tainted our public administrations.
Factious spirit is the culprit. This is another way of saying that these factions are undermining the purpose of government (which is to serve the public good).
To help improve the meaning of these lyrics, visit "Federalist No. 10" by Alexander Hamilton, John Jay, James Madison and leave a comment on the lyrics box