Conventional field selection of magnetic order relies on the Zeeman coupling, which, however, vanishes in magnets without net magnetization, a rapidly growing class including altermagnets (AMs), noncollinear antiferromagnets (nc-AFMs), and PT-symmetric antiferromagnets (PT-AFMs). Here we show that the quantity that fundamentally couples a magnet to a uniform magnetic field is not the magnetization, but the binary order parameter eta that labels the two time-reversal-related minima of the Landau free energy. We develop a Landau theory of order selection based on eta under the constraints of magnetic point-group (MPG) symmetry, in which eta couples to odd-degree polynomials in the magnetic field. Within this framework, the linear term is the ferromagnetic Zeeman coupling, while higher-order couplings with leading degree n = 3, 5, 7, and 9 naturally appear in AMs and nc-AFMs. In contrast, combined PT symmetry forbids any such coupling. Consequently, it is the order-(n-1) magnetic susceptibility, rather than the net magnetization, that serves as the primary experimental observable for identifying the magnetic order of AMs and nc-AFMs. For all 122 MPGs, we classify the leading coupling degree and the corresponding polynomial forms. We demonstrate our framework in two representative materials: the AM MnF2 and the nc-AFM MnTe2. We further construct a symmetry-allowed spin model for an AM system to reveal the microscopic origin of the higher-order coupling and establish the coupling coefficient explicitly in terms of the spin-model parameters. Our work unifies the description of magnetic-order selection across magnets with and without net magnetization, offers a microscopic origin for this counterintuitive physics, and provides fingerprints for distinguishing intrinsic field selection from extrinsic switching.