SOME ARTIFACTS from the second temple period have been found outside the walls of the Old City of Jerusalem (Jerusalem Post via Archaeologica News.) Excerpt:

They include the remains of a mikva, various bronze and metallic utensils and coins, candles, and a stone oil-storage vessel decorated with shofarot.