Exploring magnetic and topological complexity in MgMn₆Sn₆: from frustrated ground states to nontrivial Hall conductivity

We explore the intriguing topological itinerant magnet MgMn₆Sn₆, characterized by bilayer kagome Mn layers encasing a hexagonal Sn layer. Using \textit{ab initio} Density functional theory and Dynamical mean-field theory calculations, we uncover the complex electronic properties and many-body configuration of its magnetic ground state. Mn d-orbital electrons form a frustrated many-body ground state with significant quantum fluctuations, resulting in competing antiferromagnetic and ferromagnetic spin exchanges. Our band dispersion calculations reveal a mirror symmetry-protected nodal line in the \textit{k}_z = 0 plane. When spin-orbit coupling (SOC) is introduced, the gap is formed along the nodal line lifted due to broken time-reversal symmetry with magnetic ordering, leading to substantial intrinsic Berry curvature. We identify Dirac fermions, van Hove singularities, and flat band near the Fermi energy (\textit{E}_F), with SOC introducing a finite gap at key points. The unique proximity of the flat band to \textit{E}_F suggests potential instabilities. Spin-orbit coupling opens a 20 meV gap at the quadratic touching point between the Dirac and flat band, bestowing a nonzero Z₂ invariant. This leads to a significant spin Hall conductivity. Despite the presence of large incoherent scattering due to electronic interactions, band crossings and flat band features persist at finite temperatures. MgMn₆Sn₆ exhibits intriguing topological and magnetic properties, with promising applications in spintronics.