Ok, I got rid of all pip and rpm packages related to certbot and started fresh. The aim is to have working certbot and Let's Encrypt app.
1. Manually installing an updated version of pyOpenSSL and its dependencies, because the one in the yum repo is outdated.
2. Installed certbot and the dashboard app: