Try the
Application.Exit[
^] method.
An alternative is to hide Form1 when you display Form2, but use ShowDialog rather than the Show method. You can then use Close on Form1 when Form2 closes.
Or you could add an event handler in Form1 for the Form2 instance FormClosed event, and close Form1.