A sitemap.xml document is to give search engines and other automated services to slurp up a listing of unique documents on a given website. Pagination on the other hand is for humans to “page” long listings in a way that is easier for our brains to understand.
Paginated directories and their URLs has no place in a sitemap.xml. It is for bots, not humans. The bots know what their doing.
Do you have a use case that runs contrary to this? I’m open to it.