Learning to Read a Doctor's Books