I haven't done that in a long time as I prefer the flexability of repeat controls. But all you should need to do is:
1. turn on for the column to highlight as links
2. set the xpage to the form. Possibly you forgot that step.
In the Infobox of the Form design element - I think on the second tab as an area to associate the form to an xpage. you need to check that so Xpages knows what to do with the documents from your view. Since you could have multiple document types in that view. Another thing you could do is on the view control there's the ability to set the xpage at that level, but the form is preferred so you don't need to do it for each view control.
I THINK I might have covered this on my XPages Jumpstart video from my notesIn9 screencast. You can find the jumpstart easily at XPages.TV.
Hope that helps. If not let me know.
Dave