About Me

I am currently a Ph.D. candidate in the Department of Computer Science at the University of Toronto, where I am supervised by Professor Marsha Chechik. I also received my B.Sc. in Computer Science at the University of Toronto in June 2019.

My research focus is in Software Engineering. I am interesting in using software engineering techniques (e.g., requirements engineering, testing and verification) to study the safe deployment of Machine Learning into safety-critical systems.

Committee members: Professor Fan Long, Professor Nicolas Papernot, Professor Krzysztof Czarnecki

Contact Me

Email: boyue (at) cs (dot) toronto (dot) edu

Other: LinkedIn, Github, Google Scholar, DBLP.

Publications

A Software Engineering Perspective on Testing Large Language Models: Research, Practice, Tools and Benchmarks
Sinclair Hudson, Sophia Jit, Boyue Caroline Hu, Marsha Chechik
2030 Software Engineering
Concept-based Analysis of Neural Networks via Vision-Language Models
Ravi Mangal, Nina Narodytska, Divya Gopinath, Boyue Caroline Hu, Anirban Roy, Susmit Jha, Corina Pasareanu
SAIV 2024, [preprint]
Assessing Visually-Continuous Corruption Robustness of Neural Networks Relative to Human Performance
Huakun Shen, Boyue Caroline Hu, Krzysztof Czarnecki, Lina Marsso, Marsha Chechik
[preprint]
Towards Feature-Based Analysis of the Machine Learning Development Lifecycle
Boyue Caroline Hu, Marsha Chechik
ESEC/FSE 2023 IVR, [paper], [presentation]
DecompoVision: Reliability Analysis of Machine Vision Components Through Decomposition and Reuse
Boyue Caroline Hu, Lina Marsso, Nikita Dvornik, Huakun Shen, Marsha Chechik
ESEC/FSE 2023, [paper], [github], [presentation]
Reliability of Machine Vision Components in Safety-critical Systems
Boyue Caroline Hu, Marsha Chechik
SE4SafeML@ESEC/FSE 2023 Presentation
If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Components
Boyue Caroline Hu, Lina Marsso, Krzysztof Czarnecki, Rick Salay, Huakun Shen, Marsha Chechik
SEMLA 2022 Poster, [poster]
What to Check: Systematic Selection of Transformations for Analyzing Reliability of Machine Vision Components
Boyue Caroline Hu, Lina Marsso, Krzysztof Czarnecki, Marsha Chechik
ISSRE 2022, [paper], [github], [presentation]
If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Components
Boyue Caroline Hu, Lina Marsso, Krzysztof Czarnecki, Rick Salay, Huakun Shen, Marsha Chechik
ICSE 2022, [paper], [github], [presentation]
Towards Requirements Specification for Machine-learned Perception Based on Human Performance
Boyue Caroline Hu, Rick Salay, Krzysztof Czarnecki, Mona Rahimi, Gehan M. K. Selim, Marsha Chechik
AIRE@RE 2020, [paper], [presentation]
Support for user generated evolutions of goal models
Boyue Caroline Hu, Alicia M. Grubb
MiSE@ICSE 2019, [paper], [presentation]

Teaching

Lecturer
(CSC108) Introduction to Computer Programming, Fall 2022, University of Toronto
Lead Teaching Assistant
(CSC110) Foundations of Computer Science, Fall 2021, University of Toronto
Course Content Preparation
(CSC258) Computer Organization, Summer 2020, University of Toronto
Teaching Assistant
(CSC2125) Special Topics in Software Engineering: Software Engineering for ML-Enabled Systems (SE4AI), Fall 2023, University of Toronto
(CSC111) Foundations of Computer Science II, Winter 2021, University of Toronto
(CSC258) Computer Organization, Fall 2016, Winter 2017, Winter 2018, Fall 2020, Winter 2021, University of Toronto
(CSC209) Software Tools and Systems Programming, Winter 2020, University of Toronto
(CSC410) Software Testing and Verification, Fall 2019, University of Toronto

Mentoring

(2024) Sinclair Hudson and Sophia Jit, Master's students at University of Toronto
CSC2125 course project
(2023 - Now) Yuzhi Tang, Undergraduate at University of Toronto
Natural Sciences and Engineering Research Council (NSERC) Undergraduate Student Research Award Program (USRA)
CSC494 Computer Science Project
(2022) Kseniia Buzko, Undergraduate at V. N. Karazin Kharkiv National University
Summer Research Program
(2022) Natalie Ashgriz, Undergraduate at University of Toronto
Natural Sciences and Engineering Research Council (NSERC) Undergraduate Student Research Award Program (USRA)
(2021-2023) Huakun Shen, Undergraduate at University of Toronto
Natural Sciences and Engineering Research Council (NSERC) Undergraduate Student Research Award Program (USRA)
CSC494 Computer Science Project
Master of Science, Department of Computer Science, University of Toronto
(2021) Valentina Manferrari, Undergraduate at University of Toronto
Volunteering

Service

Program Committee NFM 2024,
Organizer SE4SafeML@ESEC/FSE 2023 workshop,
Sub-reviewer ESEC/FSE 2023,
Artifact Evaluation Reviewer FASE 2023,
Sub-reviewer SAFECOMP 2023,
Sub-reviewer ESEC/FSE 2022