Why does the rest of the world (namely Americans) think that Australia was just settled by convicts?

It makes for a cool sounding fun fact; nothing more, nothing less. And please don't try and single out any one country as to "who thinks what," generalizing just makes you look like a damn fool.