If you do not attack with Raiders they do 2 damage to you at end of turn. Raiders do no damage to you during the turn in which they are summoned.