You can delete an existing editable pose.
Version 2024.1: It is now possible to bulk delete poses.
To delete a pose:
In the 3D window, click the current pose. The Poses pop-up pane is displayed.
Go to the pose you want to delete and hover over it.
Click X. The avatar pose is deleted.