You can break this rule when you have a strong horizontal element in the scene. Align the camera so that the horizontal element is diagonal and take a picture.
Learn how to take great pictures, edit your photos, upload your pictures online, and shop smart for a new camera or accessories.