On Android: You can delete a contact by long-pressing on the contact in the conversation list, and then pressing Delete.
On iOS: You can delete a contact by swiping left on the contact in the conversation list, and then pressing Delete.
On desktop: You can delete a contact by right-clicking on the contact in the conversation list, and then pressing Delete Contact.