The certificate file format is PFX (also known as PKCS #12). Use the following command to generate .pfx file:
openssl pkcs12 -export -out jira_public_privatekey.pfx -inkey jira_privatekey.pem -in jira_publickey.cer