Click on the video to which you want to add a CTA, under the stories section

A side bar will appear on the right, scroll down to find the Add Custom Links section,

Here, input the link display name and its url and click on submit