If you unlink one or more of your bank accounts or let them expire you will not lose points, but your Boost could be reduced and any repayments or transactions from this point onwards will earn fewer points.
If you unlink all your bank accounts your Boost will drop to 0x and you will not be able to get any further points