Heavy static in ANC or Transparency mode isn’t something I’d consider normal, especially on a new pair. Those modes rely on the AirPods’ microphones, so the fact that the noise disappears when Listening Mode is Off is worth noting.
I’d first make sure your iPhone and AirPods are up to date, then reset the AirPods and pair them again. Apple’s reset instructions for AirPods 5 are here: How to reset your AirPods and AirPods Pro - Apple Support
If the static is still there after that, I wouldn’t wait for a possible software fix that Apple hasn’t announced. Since they’re new, I’d exchange or return them while you’re still within the return period.