For Experience Cloud users to see the widget, they need to be assigned the correct permission set.
Clone and save the Archive View Archived Records permission set. After cloning, remove the View All permission since Archive does not adhere to the Salesforce Data Security Model. Finally, configure the setting to Public Read Only.
See more on How to Display Archived Data in Experience Cloud here.