In your WordPress dashboard, navigate to Appearance, when Widgets. Click the triangle in the top right of the widget to view its contents and edit it.

If you are unable to make edits, check to make sure accessibility mode is disabled. The blue text in the top right corner should say "Enable accessibility mode."