Zhizhang Hu

Zhizhang Hu

Ph.D. Research Assistant

University of California, Merced

About Me

Hi! Welcome to my page! I am a Ph.D. candidate in Electrical Engineering and Computer Science at the UC Merced PANS Lab, advised by Dr. Shijia Pan. I have been working on algorithms in Multimodal Deep Learning (Signal, Image, Text), Transfer Learning, and applications for ubiquitous computing and healthcare from day one of my Ph.D. journey. I am actively exploring new fields including Graph Learning and Causal Machine Learning. Please feel free to contact me if you want to chat/ collaborate/ have a full-time job opportunity/ ask for the latest resume :-D.

Interests
  • Multimodal Deep Learning (CV, NLP, Signal, etc.)
  • Causal Machine Learning
  • Graph Learning
  • Ubiquitos Computing
Education
  • Ph.D. Student in Computer Science, 2020-Now

    University of California Merced

  • M.Sc in Building Science, 2020

    Carnegie Mellon University

Experience

 
 
 
 
 
University of California, Merced
Ph.D. Student
University of California, Merced
Aug 2020 – Present Merced, California

Working in following areas:

  • Physics-informed multimodal sensing and learning algorithms.
  • Causal inference for deep learning bias reduction.
  • Smart healthcare with heterogeneous Internet of Things(IoT) systems.
  • Representation learning and transfer learning algorithms.
 
 
 
 
 
Amazon Inc.
Applied Scientist Intern
Amazon Inc.
May 2023 – Aug 2023 Palo Alto, California
Working on the visual cues-guided online text denoising for robust multimodal learning. Advised by Dr.Shasha Li, Dr. Ming Du. Supervised and advised by Dr. Arnab Dhua. Full paper in submission.
 
 
 
 
 
Amazon Inc.
Applied Scientist Intern
Amazon Inc.
May 2022 – Aug 2022 Palo Alto, California
Working on the vision-language multimodal learning for language-guided compostional image-image retrieval. Advised by Dr.Xinliang Zhu, Dr. Son Tran and Dr. Rene Vidal. Supervised and advised by Dr. Arnab Dhua. Ourput paper: ProVLA @ ICCVW 2023.

Recent Publications

Quickly discover relevant content by filtering publications.
(2024). IOTeeth: Intra-Oral Teeth Sensing System for Dental Occlusal Diseases Recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (UbiComp).

PDF DOI

(2023). ProVLA: Compositional Image Search with Progressive Vision-language Alignment and Multimodal Fusion. 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW).

PDF DOI

(2022). MODES: multi-sensor occupancy data-driven estimation system for smart buildings. ACM e-Energy.

PDF Cite DOI

(2022). Demo: Real-Time Teeth Functional Occlusion Monitoring via In-Mouth Vibration Sensing. IPSN 2022.

PDF DOI

(2022). Poster: Sedentary Posture Muscle Monitoring via Active Vibratory Sensing. IPSN 2022 (Best Poster Award).

PDF DOI

(2021). AutoQual: task-oriented structural vibration sensing quality assessment leveraging co-located mobile sensing context. CCF Transactions on Pervasive Computing and Interaction.

PDF Cite

(2021). Footstep-Induced Floor Vibration Dataset: Reusability and Transferability Analysis. SenSys 2021 DATA Workshop.

PDF Cite Dataset

(2021). Vibration-based indoor human sensing quality reinforcement via Thompson sampling. Proceedings of the First International Workshop on Cyber-Physical-Human System Design and Implementation.

PDF Cite

(2020). A window-based sequence-to-one approach with dynamic voting for nurse care activity recognition using acceleration-based wearable sensor. UbiComp/ISWC 2020 Workshop(Best Paper Award).

PDF Cite

(2020). Fine-grained activities recognition with coarse-grained labeled multi-modal data. UbiComp/ISWC 2020 CML-IoT Workshop.

PDF Cite

(2020). Improving the Interoperability of gbXML Data Model through Redefining Data Mapping Rules of HVAC Systems. ASHRAE Transactions.

PDF Cite

(2019). Device-free sleep stage recognition through bed frame vibration sensing. BuildSys 2019 DFHS Workshop.

PDF Cite

Contact Me

  • 5200 Lake Road, Science & Engineering 2, Merced, CA 95348