The Rheological Universal Differential Equation (RUDE) framework embeds neural networks within a frame-indifferent tensorial constitutive backbone and so enables data-driven discovery of complex material rheological behavior. However, the flexibility that makes the RUDE framework attractive also makes it difficult to deploy: the learned neural network correction can make the constitutive equation numerically stiff during training, distribute corrections across non-unique combinations of tensor-basis terms, and extrapolate poorly with increasing nonlinearity, especially for industrially relevant materials with broad relaxation spectra. We develop a stability- and reliability-focused multi-mode RUDE framework that addresses three key challenges: thermodynamic admissibility, out-of-distribution prediction, and interpretability. Logarithmic compression of the input invariants and a split-network architecture improve numerical conditioning during training, while a differentiable projection layer enforces the Clausius–Duhem inequality at every time step. We illustrate the framework with both synthetic (a multi-mode Giesekus model) and experimental data on an entangled silicone polymer melt. Both models were trained on LAOS; they remain stable and accurate under unseen flow conditions, including steady shear, transient stress growth, and extensional flows, for which the unconstrained models may diverge numerically. To aid in interpretation of the contributions of each learned correction to the rheological behavior, we introduce the rheome, a compact way of representing the dominant weighted tensor-basis contributions to the overall rheological behavior. These improvements to the RUDE framework lead to stable and interpretable trained models, paving the way for implementation in computational fluid dynamics simulations and for guiding the rational design of soft material processing operations.