The councillor had posted on social media about her plans to defect from Reform UK after the election