Nice to see someone pursue this. I built something similar at a hackathon in NYC a few years back and won. I remember the tricky part was that in addition to uploading videos, I wanted people to just use a URL, like a YouTube video or something and process that. But the Vision API only worked with videos that were in storage on a bucket or something. Spent the whole night building a workaround.
Did you use an API from one of the big cloud providers? Tingy is based on a custom variant of CLIP, which is quite computationally expensive but worth it for the general querying ability.
