I’m deeply confused … what does this actually do? Mark your commit as having tests passed?

Yep: https://github.com/basecamp/gh-signoff/blob/0e402078ad1483cf...

  HTTP POST …/repos/:owner/:repo/statuses/${sha}
  state=success
  context=signoff
  description=${user} signed off