To unfollow someone on Twitter, access their profile by clicking their name. A pop-up will open with their profile page. You will see a blue button called Following. Hover the button and it will change into Unfollow. Click on Unfollow and the user's tweets will be removed from your timeline.
Before

After
