Welcome to the Atlassian developer community @AdamLeppek,
This problem is caused by a change in behavior in how Bitbucket Connect works:
It looks like the docs have not been updated to reflect. Please be sure to rank pages in the top right of the appropriate page and report problems.