You see this person because he's on your friends list. Even if you block the user, the next time you remove the block or change your privacy settings without removing him, you'll see the stories, pictures, etc. This is not a bug, rather than a small-feature implemented by the developers of the application.