Categories
Programming

Performing Really Big Deletes in SQL Server

I am working on a database with a really big table. In total it contains something in the region of 50GB of data. This was a rare occasion where we wanted to re-generate the data in this table and wanted to completely clear down the table in a master database that has seven subscribers.

There are benefits to running one big DELETE statement to do this – it is likely to be the fastest way in this situation. However, there are a couple of drawbacks. If you have to “bin out” halfway through, you end up having achieved no deletions even after running a script for two hours. You also get a really big transaction log with everything in it… and have no visible progress to work out whether you have time to eat a pizza before the deletion will complete.

The following script chunks the delete into lots of 1,000 row transactions. This might take longer overall than just running a simple delete, but gives you a visible indication of progress and it limits the sudden and explosive growth of your transaction log in many cases. It also lets other commands get a turn, which would otherwise become blocked by your mega deletion. If you have to cancel the script, you’d get the benefit of having the already-committed transactions left alone, and a shorter cancellation time on the current smaller transaction.

SET NOCOUNT ON;
DECLARE @rows INT = 1
DECLARE @total BIGINT = 0

WHILE @rows > 0
BEGIN
    BEGIN TRANSACTION;
        DELETE TOP (1000)
        FROM MyBigTable
        SET @rows = @@ROWCOUNT;
    COMMIT TRANSACTION;
 
    SET @total = @total + @rows
    RAISERROR('Deleted %I64d', 0, 1, @total) WITH NOWAIT
END

You can tweak the number of rows per transaction if you want to. The error messages are just informational and let you know how many rows you have binned in total.

The RAISERROR call is used because it flushes the output immediately. Using PRINT doesn’t give you the feedback you need in this case (you’d need a GO statement in there to make it flush and that would ruin everything).