late 14c., "in detail, plainly," from express + -ly (2). Meaning "for the express purpose" is c.1600.