Sorry David, I'm pretty new to this forums and Xpages in general so I was so excited to have found the solution that I forgot to explain it.
Anyway, I declared a viewScope variable after xpage loades like this: sessionScope.put("showSC", false);
After certain user actions, "showSC" gets chaned to true (I used onclick event).
Computed visibility code for pannel looks like this: sessionScope.get("showSC");
That way I accomplished that my pannel on Xpage stays hidden on first load, but after user action, it becomes visible.
Success :D!!