The Rose Bush: A rose bush that grew outside the prison was a symbol of survival, that there is life after the prison where Hester spent he beginning of the story. 

The Scarlet Letter 'A': The letter that Hester was forced to wear upon her bosom, the scarlet letter was not only a symbol of her adulterous sin, but of the women herself.  The letter masks her beauty and passion as the story goes until it is what she is known. 

The Black Man in the Woods: the peoples symbol for the devil.  The woods in those times were a very scary place, and they thought that people that went into it came out evil and corrupted.