In case it helps others. The solution was fairly simple.
ln -s /etc/ssl/certs/ca-certificates.crt /usr/lib/ssl/cert.pem
Ruby is looking for /usr/lib/ssl/cert.pem and it wasn’t there. Creating a symlink to ca-certificates.crt was the solution.
After creating the link, backups work as expected.