It's more a comment on whether personal fear was warranted. Not a comment on the seriousness of the pandemic. He literally talks about how millions died. He talks about how he got all the vaccines, wore all the masks. He did everything "right".
The point he's making is about whether letting fear consume him during the pandemic was justified or not. And I agree I don't think it was justified.
Appropriate concern vs total hysteria.