Jelly Roll told fans threatening to stop listening to his music to “go right ahead.”