From Halopedia, the Halo wiki
The Second is most likely a title or role on a Covenant vessel. Second appears to be the second-in-command after the Shipmaster, comparable to an executive officer on a UNSC ship. Even ships as small as an intrusion corvette may assign a Second.
List of appearances