I'm trying to clean up customer list and job list, by doing this will my material summary be affected?
If there is a connection between the items you want to delete and the material summary, then yes, it will be affected. Alternatively, you can clear them but I think statistics will also be affected. Backup first and then perform the operations.