Why is The Scarlet Letter called The Scarlet Letter and not The Scarlet A?

Because "The Scarlet A" doesn't have as nice a ring to it as "The Scarlet Letter." Think about it. It's the basic rhythm of speech and what sounds pleasing to our ears.