I don't mind pitchers throwing at hitters. If they allow the hitters to crowd the plate as they see fit, then pitching inside should not be a problem. IMO.
Crowding the plate or not, will you still not mind if say Cabrera or Fielder got drilled on the hand and something broke?