Collaborative Geo and Text-Tagging of Images
Tag suggestion tool for use with geo-tagged Flickr data. Proof of concept work presented at ACM MIR Brave New Topics. Web interface to come.
Concepts: very large database management, web development, image search and retrieval, natural scene analysis, geographic footprints of abstract terms, multimodal learning, multimedia annotation.
Video Annotation Through Search and Mining
Patent pending. Use of mining to filter and extend existing tags for video, in automatic, unsupervised fashion.
Concepts: multimodal learning, video search and retrieval, multimedia annotation.
Video Search
Search and retrieval of concepts in videos using text, image, and video examples. Participation in TRECVID 2007.
Video Summarization
Creation of video summaries based on a user-attention model to find most salient 4% of original. Presented at ACM MM TRECVID Video Summarization workshop.
Concepts: video search and retrieval, feature selection, user attention modelling, multimodal learning and fusion.
Video Fingerprinting
Compact video "signature" creation that allows for speedy similar and duplicate video retrieval, presented at SPIE 2008.
Concepts: feature selection, video search and retrieval, dimensionality reduction.
Global News Visualization
Public installation that allows user-driven browsing of global news stories. Can be seen at UCSB's Davidson Library, and presented at SIGGRAPH 2007.
Concepts: document similarity and clustering, interactive spaces.
Emily Moxley, Jim Kleban and B.S. Manjunath,
"SpiritTagger: A Geo-Aware Tag Suggestion Tool Mined from Flickr," Proc. ACM International Conference on Multimedia Information Retrieval (MIR2008), Vancouver, Canada, Oct. 2008. PDF
Emily Moxley and Tao Mei and Xian-Sheng Hua and Wei-Ying Ma and B.S. Manjunath, "Automatic Video Annotation Through Search and Mining," Proc. IEEE International Conference on Multimedia and Expo (ICME), Hannover, Germany, Jun. 2008. PDF
Anindya Sarkar, Pratim Ghosh, Emily Moxley and B. S. Manjunath,
"Video Fingerprinting: Features for Duplicate and Similar Video Detection and Query-based Video Retrieval," Proc. SPIE - Multimedia Content Access: Algorithms and Systems II, San Jose, California, Jan. 2008. PDF
E. Drelie Gelasca, S. Joshi, J. Kleban, S. Mangiat, B.S. Manjunath, E. Moxley, A. Sarkar, and J. Xu, "The Vision Research Lab of UCSB at TRECVID 2007," Proc. Proceedings of the TRECVID 2007 Workshop, Nov. 2007. PDF
J. Kleban, A. Sarkar, E. Moxley, S. Mangiat, S. Joshi, T. Kuo and B.S. Manjunath, "Feature fusion and redundancy pruning for rush video summarization," Proc. International Workshop on TRECVID Video Summarization, Augsburg, Bavaria, Germany, pp. 84-88, Sep. 2007. PDF
Elisa Drelie Gelasca, Joriz De Guzman, Steffen Gauglitz, Pratim Ghosh, JieJun Xu, Emily Moxley, Amir M. Rahimi, Zhiqiang Bi and B. S. Manjunath, "CORTINA: Searching a 10 Million + Images Database", Technical Report, VRL, ECE, University of California, Santa Barbara, Sep. 2007. PDF
Alexander Villacorta, Karl Grossner, Jonathan Ventura, Anne-Marie Hansen, Emily Moxley, Joriz De Guzman, Matt Peterson. "Spheres of Influence," SIGGRAPH 2007. PDF--abstract only
Transactions on Multimedia, September 2008.
Transactions on Multimedia, Communities and Media Computing, July 2008.
ICIP 2008. Video Segmentation, October 2008.
Interactive Digital Multimedia
NSF IGERT Project Meeting Presentation, May 2008.
SACNAS Presentation, October 2006.
Internship, UCSB Dean of Students Yonie Harris, 2008-2009. |