Assuming you are running in a straight course.
Yes they should be turning at the same RPM. Most boats today have synchronizers to make it easy to have both engines running at the same RPM.
If you turn the boat you will lose the synchronization. The outboard engine will have a higher RPM than...