If I'm the Indians I plan on Allen for 2 and Miller for 2. Possibly Shaw for 1 during a stretch of RH bats. I would try to avoid taking Kluber out before the 4th, but if he's in trouble in the 4, I would not hesitate to pull him.
The bigger question is why didn't the Indians find some scummy lefty to add to bullpen?
Well, but Kluber is a better pitcher than Allen, or at least as good. So I wouldn't necessarily go in with the plan to use Allen at the expense of Kluber. So I'd just let Kluber pitch until it looks like he's starting to lose his best stuff, then I'd take him out at the first sign of trouble. You just hope that's in inning 6 or so instead of inning 3 or 4.
And once I put Miller in, I'd go with the same plan. I wouldn't plan to use him for just 2, I'd let him pitch as long as he was effective. If that's close to 4 innings, then so be it.