Yay!!
Posting an issue get's you thinking.
When viewing the button in the page source I noticed the button had attributes save="true" submit="true". Changed to save="false" -> only one save conflict per document. Also changed submit to "false" -> Yay no more conflicts!
So the button was a submit button, but should have been a normal button.
-- EDIT ---
No solution afterall.. changing submit to false just breaks the button obviously.