CV
Research Interests
- Multimodal intelligence for healthcare
- Wearable sensing and physiological signal modeling
- Human-centered AI and real-world behavior understanding
- Multimodal learning across language, time series, medical imaging, and video
Education
- Korea University, Seoul, South Korea
Integrated Ph.D. Student in Mechanical Engineering, Sep. 2023 - Present - Harbin Institute of Technology (HIT), Harbin, China
Bachelor of Engineering in Robotics Engineering, Sep. 2019 - Jul. 2023
Research and Project Experience
- Korean ARPA-H Project, Seoul, South Korea
Lead Researcher (Foundation Model Development), Oct. 2025 - Present- Leading the end-to-end development of a multimodal healthcare foundation model integrating medical knowledge, bio-signals, medical imaging, and clinical videos.
- Designing a unified fusion architecture for cross-modal reasoning and high-fidelity medical inference.
- Managing large-scale training pipelines, including data curation and model fine-tuning for clinical relevance and scalability.
- Tech stack: PyTorch, multimodal fusion
- Hyundai Motor Company, Seoul, South Korea
Lead Researcher (Future PoC Project), Mar. 2024 - Dec. 2024- Led a proof-of-concept project on driver-state and takeover-request prediction in Level 3 autonomous vehicles using smartwatch-based bio-signals.
- Built the end-to-end pipeline from wearable hardware integration to simulation environments in CARLA.
- Implemented multimodal sensor fusion and deep learning models for analyzing driver cognitive load and readiness for control transition.
- Tech stack: PyTorch, CARLA Simulator
Publications
- Seokyong Sheem, et al. “MUST: Smartwatch-based Multimodal Framework for Predicting Driver State and Takeover Performance.” Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ‘26), 2026.
Technical Skills
- Languages: Korean (Native), Chinese (Fluent, HSK 6), English (Fluent)
- AI and Programming: Python, PyTorch, Scikit-learn
- Tools and Frameworks: CARLA Simulator, Hugging Face, Git, Docker, LaTeX
Awards and Honors
- Ilun Science and Technology Foundation Scholarship (19th Class), 2025
- Academic Excellence Award, Harbin Institute of Technology, 2023
Patents
- K. Kim, et al. (including S. Sheem), “Foley Catheter Urination Control Device and Control Method Thereof,” KR Patent Application No. 10-2026-0006080, Jan. 2026
