Intersection of conjugate Hadamard subfactors arising from Fourier matrices