Calculating the vector corresponding to the pixel in the image

edit

I know the position of the camera (center), the direction of the optical axis, the line of the conditional horizon, and the viewing angles horizontally and vertically. The task is to calculate the world vector corresponding to each pixel. For example, I have a camera with normal lens (orthoscopic/rectilinear) and barrel distortion. How do I calculate the world vector corresponding to a pixel?