You'll most likely need an A/B Switch of some sort. This will allow you to combine the two inputs (Switch A: cable and Switch B:
DTV from the converter box), into a single output into your TV.
What does your setup look like right now? How are you able to use one converter box for all three TVs?