When the word number is part of a sequential reference in front of a figure, it should be abbreviated “No.” The plural is “Nos.”
…I believe it is page No. 4.
…It is referenced here as Check No. 4543.
…They were listed in Chapters Nos. 5 and 7.