You can ship the MDF file along with application executable. Your set up project should check for SQLExpress and if not present should install it. Then, it should also copy the MDF file at desired location. The connection string should be like this:
Server=.\SQLExpress;AttachDbFilename=C:\MyFolder\MyDataFile.mdf;Database=dbname;
Trusted_Connection=Yes;