The symbol of the black square is an image of one of a geometric shapes. It came to Unicode from the Wingdings font set.