Instead of sanding deeper scratches, consider filling them in with patching compound. Choose a patching product that matches your pavers' color as closely as possible to help it blend in.