We perform 3D radiation magneto-hydrodynamic (RMHD) shearing-box simulations of local patches of optically thick accretion disks, applicable to sub-Eddington active galactic nuclei (AGN) at ∼ 1000 gravitational radii around a supermassive black hole (SMBH) of 10⁷-10⁸M_⊙. In particular, we set up zero-net-vertical-flux (ZNVF) simulations with strong net azimuthal fields (B_y) characterized by initial gas-to-magnetic pressure ratio β₀. We find that β₀ ∼ 1 simulations relax to the classical MRI state with steady-state β∼ 10-20 and slow periodic reversals of the mean azimuthal field (dynamo cycles), losing memory of their initial B_y configuration. The outcome of simulations starting from β₀=0.1 (superthermal magnetic pressures) depends upon the numerical resolution as quantified by the number of grid cells per thermal scale height Hth. Resolved simulations (Δ z≤ Hth/5) settle into final states similar to the larger-β₀ runs, exhibiting thermally dominated midplanes heated by MRI turbulence and undergoing dynamo cycles. In contrast, lower resolution β₀ = 0.1 runs evolve towards states dominated by a coherent mean field, similar to what is observed in recent isothermal MHD simulations. However, those disks fail to sustain sufficient turbulent heating near the midplane and undergo runaway cooling and contraction. While such states might be sustained in global models with even lower initial β₀ and/or continuous B_y injection, our results indicate that they could arise purely from under-resolving the midplane MRI dynamo that would otherwise be able to generate and emanate randomized fields. We highlight the need to resolve a fraction of the thermal scale height (the classical MRI wavelengths) for strongly magnetized initial conditions to obtain converged outcomes in RMHD simulations.