The center should be the people representing the country. There's a lot of room in there for a diverse, varied set of perspectives. The fact that 1/3 of the country hates the two extremes and is OK with the middle is exactly why the people in the middle are the ones who are supposed to be elected.
The middle will move over time as the electorate's value change. That's where progress happens. The 10% who are Neo Nazis should absolutely not have anyone make it into office. That's not what functional government is.