I believe that on the first night I went to Gatsby’s house I was one of the few guests who had actually been invited
Nick is explaining that when Gatsby would throw these wild, crazy parties that people would just show up with no relation with Gatsby. The other guest that were not invited just went over to the party because of what they have heard about Gatsby and his outrageous parties. You can relate this to a Texas football game. Some of the people that go there don’t know what football is but they have heard that it is a popular event and that it is the place to be.
To help improve the meaning of these lyrics, visit "The Great Gatsby (Chapter III)" by F. Scott Fitzgerald and leave a comment on the lyrics box