Of course you don't, because if you did, it would have never been assigned as a trigger. It doesn't say target something else, it's right back at the originator of the spell. Any other solution would just be, duel fails so why have a trigger that just makes the duel fail, when it already failed via the trigger.