You can add an auto increment/IDENTITY column, it will keep the track of inserted data. You can use the IDENTITY column in where condition of DELETE
Example:
[ID] INT IDENTITY (1, 1) NOT NULL
DELETE FROM Employee WHERE ID in(SELECT MAX(ID) FROM Employee)