Pop-ups usually stick around because of malicious "Push Notifications" or sketchy extensions you accidentally allowed.