The Boulder Valley school board is set to vote at a Wednesday special meeting on whether to fire a sixth-grade math teacher accused of inappropriately touching students.