There is not much to configure with the Archive Paging widget. Using the default settings will be correct in almost all use cases.
It will use the settings in the Archive widget for how the paging works.
You can style almost everything that relates to how the paging is shown on the page.
Enabling Show icons will make settings for configuring the paging icons.