Refers to the size of a Book; the most common book size since the early 17th century, an octavo book averages about 6” x 9”.
The term originally referred to the number of folds (8) in a standard book-printing sheet, but it now commonly refers to size.
Also see 8vo