Saelyne Yang (양세린)

Postdoctoral Fellow @ CMU

Hi! I'm a Postdoctoral Fellow at Carnegie Mellon University's Human-Computer Interaction Institute (HCII), working with Jeff Bigham. I earned my Ph.D. from KAIST, advised by Juho Kim, with support from the NAVER PhD Fellowship and the Kwanjeong Scholarship. I've had the opportunity to intern at Adobe Research, Autodesk Research, and LG AI Research.

My research focuses on empowering both humans and AI agents to master new skills. I build collaborative and proactive AI agents designed to assist with complex tasks by leveraging diverse learning materials (e.g., documents, videos) to foster more effective knowledge capture and sharing.
Research Interests: Human-AI Interaction; Human-Agent Collaboration; Multimodal Understanding; Procedural Task Learning; Skill Learning

News

  • 👩‍💼 (Mar. 2026) Started as a Postdoctoral Fellow at CMU!
  • 📝 (Feb. 2025) 1 paper accepted to CVPR, 1 paper accepted to CHI!
  • 👩‍💼 (Feb. 2026) Serving as Program Committee for UIST 2026.
  • 🎓 (Dec. 2025) Successfully defended my Ph.D. Thesis!
  • 👩‍💼 (Jul. 2025) Serving as Program Committee for AAAI 2026.
  • 📝 (Jan. 2025) My Adobe internship paper has been accepted to IUI 2025!
  • 🏆 (Nov. 2024) Received a Special Recognition for Outstanding Reviews at CHI 2025.

Publications

GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI Tasks (to appear)

Saelyne Yang, Jaesang Yu, Yi-Hao Peng, Kevin Qinghong Lin, Jae Won Cho, Yale Song, Juho Kim

CVPR 2026
"I Can't Keep Up": Accessibility Barriers in Video-Based Learning for Individuals with Borderline Intellectual Functioning

Hyehyun Chu, Seungju Kim, Chen Zhou, Yu-Kai Hung, Saelyne Yang, Hyun W. Ka, Juho Kim

CHI 2026
[pdf]
VideoMix: Aggregating How-To Videos for Task-Oriented Learning

Saelyne Yang, Anh Truong, Juho Kim, Dingzeyu Li

IUI 2025
[pdf]
Enhancing How People Learn Procedural Tasks Through How-to Videos

Saelyne Yang

UIST 2024 Doctoral Symposium
[pdf] [poster]
Silent Impact: Tracking Tennis Shots from the Passive Arm

Junyong Park, Saelyne Yang, Sungho Jo

UIST 2024
[pdf]
Fine-Grained Action Understanding with Tools in Instructional Videos

Saelyne Yang, Jaesang Yu, Jae Won Cho, Juho Kim

[pdf] [poster]
AQuA: Automated Question-Answering in Software Tutorial Videos with Visual Anchors

Saelyne Yang, Jo Vermeulen, George Fitzmaurice, Justin Matejka

CHI 2024
[pdf]
ExpressEdit: Video Editing with Natural Language and Sketching

Bekzat Tilekbay, Saelyne Yang, Michal A Lewkowicz, Alex Suryapranata, Juho Kim

IUI 2024
Also presented at the HAI-GEN Workshop at IUI 2024
[pdf] [project website]
YTCommentQA: Video Question Answerability in Instructional Videos

Saelyne Yang, Sunghyun Park, Yunseok Jang, Moontae Lee

AAAI 2024
Also presented at the LPVL Workshop at CVPR 2024
[pdf] [poster] [dataset]
Towards Content-based Pixel Retrieval in Revisited Oxford and Paris

Guoyuan An, Woo Jae Kim, Saelyne Yang, Rong Li, Yuchi Huo, Sungeui Yoon

ICCV 2023
[pdf] [dataset]
Beyond Instructions: A Taxonomy of Information Types in How-to Videos

Saelyne Yang, Sangkyung Kwak﹡, Juhoon Lee﹡, Juho Kim

CHI 2023
[pdf] [project website] [talk]
AVscript: Accessible Video Editing with Audio-Visual Scripts

Mina Huh, Saelyne Yang, Yi-Hao Peng, Xiang ‘Anthony’ Chen, Young-Ho Kim, Amy Pavel

CHI 2023
[pdf]
CatchLive: Real-time Summarization of Live Streams with Stream Content and Interaction Data

Saelyne Yang, Jisu Yim, Juho Kim, Hijung Valentina Shin

CHI 2022
[pdf] [project website]
Improving Video Interfaces by Presenting Informational Units of Videos

Saelyne Yang, Sankyung Kwak, Tae Soo Kim, Juho Kim

[pdf]
SoftVideo: Improving the Learning Experience of Software Tutorial Videos with Collective Interaction Data

Saelyne Yang, Jisu Yim, Aitolkyn Baigutanova, Seoyoung Kim, Minsuk Chang, Juho Kim

IUI 2022
[pdf] [project website]
Snapstream: Snapshot-based Interaction in Live Streaming for Visual Art

Saelyne Yang, Changyoon Lee, Hijung Valentina Shin, Juho Kim

CHI 2020
[pdf] [project website] [video preview]
What Makes It Hard for Users to Follow Software Tutorial Videos?

Saelyne Yang, Juho Kim

HCI Korea 2020
[pdf]

Experiences

  • Adobe Research
    Research Intern, STORIE Lab (May. 2024 - Aug. 2024)
    Mentors: Dingzeyu Li, Anh Truong
  • Autodesk Research
    Research Intern, HCI & Visualization Group (Jun. 2023 - Sep. 2023)
    Mentors: Jo Vermeulen, Justin Matejka, George Fitzmaurice
  • LG AI Research
    Research Intern, Advanced ML Lab (Oct. 2022 - Feb. 2023)
    Mentor: Moontae Lee
  • Adobe Research
    Research Intern, Creative Technologies Lab (Jun. 2020 - Sep. 2020)
    Mentor: Hijung Valentina Shin
  • ACRYL
    Software Engineer Intern (Jan. 2018 - Feb. 2018)

Awards & Honors

  • Special Recognition for Outstanding Reviews (CHI 2025)
  • AAAI Student Scholar (2024)
  • Google Student Travel Grant (2023)
  • NAVER PhD Fellowship (2022)
  • Special Recognition for Outstanding Reviews (CSCW 2023)
  • Special Recognition for Outstanding Reviews (CHI 2022)
  • Inseong Fellow, KAIST (2021)
  • An Outstanding TA Award, KAIST (2021 Spring, 2022 Spring)
  • An Outstanding MS Thesis Award, KAIST (2021)
  • Kwanjeong Scholarship (2019-20)
  • Google WTM Scholarsip (2018)
  • Dean's List, School of Computing, KAIST (2018 Spring)

Education

  • Ph.D. in School of Computing, KAIST (Mar. 2021 - Feb. 2026)
    GPA: 4.16/4.3, Outstanding PhD Thesis Award
  • M.S. in School of Computing, KAIST (Mar. 2019 - Feb. 2021)
    Outstanding MS Thesis Award
  • B.S. in School of Computing, KAIST (Mar. 2015 - Feb. 2019)
    Graduated with Honors (Magna Cum Laude)