As I have noted before, Pelusium is mentioned (cursed, actually) in Ezekiel 30:15-16.
Herodotus also tells a story of about the miraculous thwarting of the Assyrian King Sennacherib's invasion of Egypt at the city of Pelusium. This was on the same campaign as his invasion of Palestine and his unsuccessful attempt to capture King Hezekiah's Jerusalem. For details, see here and links.
UPDATE (28 April): This Jerusalem Post article has more on the mythological background of the Zeus temple: Remains of temple to god Zeus Kasios uncovered in Sinai. A merger of ancient religious traditions, Zeus Kasios is an example of the legacy of religious multiculturalism in antiquity (Judith Sudilovsky).
Visit PaleoJudaica daily for the latest news on ancient Judaism and the biblical world.