On $2$-categorical $\infty$-cosmoi