Did you miss the non-breaking player giving the shot back? If it is the first rack, the incoming tram must say which of them is up. That player must decide. All later racks must be player due up.
If the incoming team's player gives the shot back, was that an inning?