Try File - Application - Application Management. This gets a handle on all the plugins etc installed. The Extension Library is under the second group for "Lotus\Notes\Data\workspace". If you click on it there is a link to uninstall.
Bear in mind the Application management dialog does take quite a while to load.