Performance problems with the publish loader are frequently database related.
-
Use tracing with performance switches as in described in Why is querying slow?.
-
Ensure that the database is optimized and tuned, as the load is inserting or updating very large amounts of data.