This can be applied to most scenarios. Rather than making neutrals impassable or giving them a point cost, all neutrals have 1 income and 1 infantry defending.
You may wish to keep 3 IPC penalty to reflect the political cost of attacking neutrals.
Truly impassable areas like the Himalayas can be kept as impassable. The Sahara and Afghanistan may also be impassable.