Yeah you're right. I tend to give less credit when a guy's value is mostly defense, since I think defensive metrics are wrong towards the high end (I disagree that defensive contributions continue to be linearly additive all the way up the scale, and instead suffer from diminishing returns).
Baez just put up a 3 WAR season with a .273/.314/.423 (.737 OPS) line and elite defense, so that's pretty much exactly what we are talking about with TD. However, looking into what Baez did in the minors, I see an .886 career OPS with a 25% K rate, which is much better than TD's .824 OPS and 34% K rate.
Comparing the 2, I think I may have been overly optimistic on TD's most likely MLB line, which will probably be something like .230/.290/.380 if he keeps his current trajectory. That is unplayable bad. He will have to dramatically improve his K rate just to get to Baez's current offensive production and have a chance at being a 3+ WAR player.
If he doesn't maintain this recent improvement in his K rate he likely won't make it out of AA when those more advanced pitchers absolutely carve him up into shreds.