The Jacksonville Sheriff’s Office is moving its administrative headquarters from the East Bay Street location to the Florida Blue building on Riverside, temporarily closing its public counter and one substation while keeping other substations open to maintain services.