If I buy back prior service, does it affect my seniority date?

YES, any buy back of time will affect your retirement benefit(w/restrictions), and your seniority date.