Git clone from Azure DevOps gives remote: VS403463 error

If you get this error:

remote: VS403463: The conditional access policy defined by your Microsoft Entra administrator has failed.
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

while trying to git clone a repository from Azure DevOps, and you are sure you have an ssh key configured locally that should work, login to the azure devops instance from the same IP your trying to clone from and retry.