Turns out you can do a "animal crossing style camera" where things pop up over the horizon as you get closer with a very simple final camera hack like this in a vertex shader.

gl_Position.y-=pow(length(gl_Position.xz)*0.02,2.0);

Assuming your camera has no roll, y is vertical.