In my opinion, you should make your life easier by:
- putting the camera on a tripod and in a way that the book occupy the maximum of the image
- using an uniform background with a color different of the color of the page (for example black if the pages are white) in order to easily detect and extract the book
- detect still images using for example Background Subtraction
- extract left / right pages by dividing the bounding box of the book by 2
- correct the perspective by applying an homography (transform a trapezoid to a rectangle), with the real location of the 4 corners of the page and the desired location of the corners
