If you want to delete a comment in a modern SharePoint page, you have to make click in the “…” available just behind the comment to be deleted (Note: Bear in mind those “…” are a little bit hidden) and then click on the Delete option. Depending on the user’s permissions, it’s even possible to delete the comments posted by other users.