2 Video streams from 2 different cameras->Transformation between views?

edit

Ok so here's the deal: Let's say I have a marker in my scene and I get 2 images of the markers(one per camera).After I find the Translation and Rotation matrices, can I apply these in a virtual object drawn in the OpenGL through the first camera and make it correctly rendered in the second camera.Also, if both cameras are moving together all the time(e.g they are connected together), do I have to calculate the Translation and Rotation matrices all the time?Or I just need it to happen only 1 time and then always apply thesame transformation to the view?

@marios.b though I have not work before with such a project, I do not see any problem to draw an object appeared in one camera view to another once you have the relation between the two cameras. Moreover, I do not think that you need to extract each time the translation and rotation matrices of the two cameras, once is enough. You can perform this procedure as a calibration step in the beginning. All these of course theoretically, because practically you might come up with parameters that you do not consider now, but will affect your result. For that reason, trial and error and a thorough testing/validation phase will lead you to any conclusion/result.

Ok thank you very much!