After sending an item to the other group by using one of the traveling merchants, that merchant specifically will be gone for good. There will only be a total of four traveling merchants of each character's path, with three being encountered in Act 4 alone, so use them wisely.