Education

• Ph.D. at College of Computer Science, Zhejiang University
  Sept 2018 - July 2023       Hangzhou, China
  Supervised by Prof. Zhongfei (Mark) Zhang and Prof. Zhou Zhao.
  Dissertation: "Semantic Understanding-Aware Neural Network Architecture Design for Video Surveillance"
  Successfully defended at June, 2023
  
  
• Bachelor at College of Information Science and Electronic Engineering, Zhejiang University
  Sept 2014 - June 2018       Hangzhou, China
  Graduation Thesis: "Deep Learning based Video Semantic Analysis"

Work Experiences

• Research Intern at Taobao Research
  Taobao Lab
  June 2020 - Sep 2020       Hangzhou, China
  
• Research Intern at Kuake Research
  Kuake Lab
  Nov 2019 - Feb 2020       Hangzhou, China

Co-supervised Students

• School of Software, Zhejiang University
  Wang Lin (2021, linwanglw@zju.edu.cn), Linjun Li (2021, lilinjun21@zju.edu.cn),
  Xize Cheng (2021, chengxize@zju.edu.cn), Ye Wang (2021, yew@zju.edu.cn)
  

Publications(* denotes equal contributions)

1. Rethinking Missing Modality Learning from a Decoding Perspective
   Tao Jin, Zhou Zhao,
   ACM MM, 2023
   
   
2. Exploring Group-Based Video Captioning with Efficient Relational Approximation
   Wang Lin*, Tao Jin*, Ye Wang, Zhou Zhao,
   ICCV, 2023
   
   
3. Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition
   Xize Cheng*, Tao Jin*, Linjun Li, Zhou Zhao,
   ICCV, 2023
   
   
4. Multi-Granularity Relational Attention Network for Audio-Visual QA
   Linjun Li*, Tao Jin*, Wang Lin, Hao Jiang, Zhou Zhao,
   TCSVT, 2023
   
   
5. OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality Alignment
   Xize Cheng*, Tao Jin*, Linjun Li, Wang Lin, Xinyu Duan,
   ACL, 2023
   
   
6. TAVT: Towards Transferable Audio-Visual Text Generation
   Wang Lin*, Tao Jin*, Ye Wang, Wenwen Pan, Xize Cheng, Linjun Li, Zhou Zhao
   ACL, 2023
   
   
7. Semantic-Conditioned Dual Adaptation for Query-based Visual Segmentation
   Ye Wang*, Tao Jin*, Wang Lin, Xize Cheng, Linjun Li, Zhou Zhao
   ACL, 2023
   
   
8. Contrastive Token-Wise Meta-Learning for Unseen Temporal-Aligned Translation
   Linjun Li*, Tao Jin*, Xize Cheng, Ye Wang, Wang Lin, Rongjie Huang, Zhou Zhao,
   ACL, 2023
   
   
9. DATE: Domain Adaptive Product Seeker for E-commerce
   Haoyuan Li, Hao Jiang, Tao Jin, Mengyan Li, Yan Chen, Zhijie Lin, Yang Zhao, Zhou Zhao,
   CVPR, 2023
   
   
10. Interaction Augmented Transformer with Decoupled Decoding for Video Captioning
    Tao Jin, Zhou Zhao, Peng Wang, Jun Yu, Fei Wu,
    Neurocomputing, 2022
    
    
11. MC-SLT: Towards Low-Resource Signer-Adaptive Sign Language Translation
    Tao Jin, Zhou Zhao, Meng Zhang, Xingshan Zeng,
    ACM MM, 2022
    
    
12. Prior Knowledge and Memory Enriched Transformer for Sign Language Translation
    Tao Jin, Zhou Zhao, Meng Zhang, Xingshan Zeng,
    ACL, 2022
    
    
13. Generalizable Multi-Linear Attention Network
    Tao Jin, Zhou Zhao,
    NeurIPS, 2021
    
    
14. Contrastive Disentangled Meta-Learning for Signer-Independent Sign Language Translation
    Tao Jin, Zhou Zhao,
    ACM MM, 2021
    
    
15. Dual Low-Rank Multimodal Fusion
    Tao Jin*, Siyu Huang*, Yingming Li, Zhongfei Zhang
    EMNLP, 2020
    
    
16. SBAT: Video Captioning with Sparse Boundary-Aware Transformer
    Tao Jin, Siyu Huang, Ming Chen, Yingming Li, Zhongfei Zhang
    IJCAI, 2020
    
    
17. Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning
    Tao Jin, Siyu Huang, Yingming Li, Zhongfei Zhang,
    EMNLP, 2019
    
    
18. Recurrent Convolutional Video Captioning with Global and Local Attention
    Tao Jin, Yingming Li, Zhongfei Zhang,
    Neurocomputing, 2019
    
    

Contest

• AI Challenger Global Contest, 2018
  Organizers: Sinovation Ventures, ByteDance, Sogou
  Track: English-Chinese Simultaneous Interpretation Competition
  Ranked: 3rd/675 teams [news] [short slides]
  Team Members：Tao Jin (team leader), Ming Chen, Junwei Lang