Ferrons are elementary excitations of ferroelectric order that can propagate and transport polarization when excited with light. Here, we show theoretically that ferron polaritons exhibit a Hall effect: an applied magnetic field generates polarization transport perpendicular to the propagation direction of a ferron polariton excited by an incident terahertz pulse. We demonstrate this effect for the example of ferroelectric SnTe using first-principles calculations and a microscopic theory of the phonon-polariton current. The direction and magnitude of the transverse polarization transport can be controlled by the polarization of the terahertz pulse and the applied magnetic field. Our results establish a route toward light-controlled directional transport of electric polarization in ferroelectrics.