Umar Khalid \u201920MS \u201923PhD<\/strong> have developed novel text-to-video AI technology that can dramatically change videos in minutes.<\/p>\n\u201cOur system takes the \u2018brain\u2019 of an AI that\u2019s already skilled at generating images from text and adapts it for video, without losing the creative power that makes it effective in the first place,\u201d Rahnavard says. \u201cOur breakthrough came from recognizing a fundamental inefficiency in existing text-to-video editing approaches. Current systems either require massive text-to-video datasets for training or rely on computationally expensive, per-video adaptations of text-to-image models. We believed there had to be a more efficient and elegant solution.\u201d<\/p>\n
With Rahnavard\u2019s background in electrical engineering and Chen\u2019s background in computer science, the team used linear algebra techniques to examine the numerical parameters of an AI model that are optimized and adjusted while learning a new task. They realized that instead of fine-tuning the entire parameter set, they could update only the singular values, preserving the AI model\u2019s ability to generalize while speeding up its adaptation time.<\/p>\n
\u201cThe key was learning which parts of the AI\u2019s \u2018memory\u2019 to adjust, and which to preserve,\u201d Rahnavard says. \u201cBy focusing only on the most essential elements and leaving the rest untouched, we created a method that adapts much faster and more efficiently while still producing high-quality, expressive results.\u201d<\/p>\n
The AI model works best on existing video clips and can edit them in minutes. It can change the colors of clothing, swap a cat for a dog or transform the clip into a cartoon. The more complex the commands, the longer the editing time. But Rahnavard says the process can still be completed in minutes, not hours.<\/p>\n
The university was recently awarded a patent for the technology, which movie studios and social media companies could use.<\/p>\n
\u201cThis technology has the potential to revolutionize video editing across a wide range of industries,\u201d Rahnavard says. \u201cMovie studios could use it for rapid scene modifications without the need for costly reshoots, while social media platforms could offer their users instant, highly sophisticated video filters far beyond what\u2019s available today.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"
UCF was awarded a patent for the novel technology that can transform the style, texture and colors of a video in minutes.<\/p>\n","protected":false},"author":242,"featured_media":149456,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"lazy_load_responsive_images_disabled":false,"footnotes":"","_links_to":"","_links_to_target":"","_wp_rev_ctl_limit":""},"categories":[5,23,24],"tags":[54138,54657,973,1045,54837,4604,202],"tu_author":[],"class_list":["post-149454","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-colleges","category-research","category-science-technology","tag-artificial-intelligence","tag-chen-chen","tag-college-of-engineering-and-computer-science","tag-computer-science","tag-nazanin-rahnavard","tag-technology","tag-alumni"],"yoast_head":"\n
UCF Researchers Create AI Video Editing Technology | 海角直播 News<\/title>\n \n \n \n \n \n \n \n \n \n \n \n \n\t \n\t \n\t \n \n \n \n \n \n\t \n\t \n\t \n