Can I calibrate Pinhole and Omnidirectional Cameras in one Setting to get the extrinsic parameters?

edit

Hi everyone, I'm working with cv::multicalib::MultiCameraCalibration. I'm initializing the Calibration with multicalib::MultiCameraCalibration multiCalib(cameraType, nCamera, inputFilename, patternWidth, patternHeight, verbose, showFeatureExtraction, nMiniMatches); So I have to decide wether I have Pinhole or Ominidircational Cameras in "cameraType". My Camera Setting has both and I need the extrinsic of them. Does anyone has an idea how to solve it ?

Cheers, Sergej