Born to poor Irish immigrants to Massachusetts, Sullivan progressively became blind. After the death of her mother and her father’s abandonment, she entered an orphanage. In , a supervisor placed her in the Perkins School for the Blind in South Boston.