There isn't. It looks like he just heard a report about someone apparently from Skifander and jumped straight to this conclusion. Which, of course, casts doubt on exactly how adequate his assessment of the situation was back there.

But even if hit squads sent specifically after him never existed, there still could be a non-negligible threat. If that cheesed-off opposition did try to go for round #2 (in which case it makes a perfect sense to start with removal of their Queen's unexpected ally) or just plain vengeance (if they were after lil Gil), and as a result wound up exiled or running away (via mirrors, one-way ticket), some might still feel bitter enough for pointless vengeance.