Unable to unselect use billing address

I was working through adding in the shipping components for my store.

Which I seem to have but on the checkout page it won't let me change the address from “use billing” to the shipping address.

Even tried and went into the admin interface to change it there for the user, and that didn't work either.

It always bounced back to the “use billing” address for shipping.

Any thoughts?