Van der Waals materials offer unprecedented control of electronic properties via stacking of different types of two-dimensional materials. A fascinating frontier, largely unexplored, is the stacking of strongly correlated phases of matter. We study 4Hb-TaS2, which naturally realizes an alternating stacking of 1T-TaS2 and 1H-TaS2 structures. The former is a well-known Mott insulator, which has recently been proposed to host a gapless spin-liquid ground state. The latter is a superconductor known to also host a competing charge density wave state. This raises the question of how these two components affect each other when stacked together. We find a superconductor with a Tc of 2.7 Kelvin and anomalous properties, of which the most notable one is a signature of time-reversal symmetry breaking, abruptly appearing at the superconducting transition. This observation is consistent with a chiral superconducting state.