Research
Publications
Multimodal Approaches to Fair Image Classification: An Ethical Perspective (Preprint)
Javon Hickmon Undergraduate Honors Thesis
[PDF]Machine Learning (ML) systems that depend on a single data modality—i.e., only images or only text—can exaggerate hidden biases present in the training data, if the data is not carefully balanced and filtered. This thesis explores the intersection of technology and ethics in the development of fair image classification models. Specifically, I focus on improving fairness and methods of using multiple modalities to combat harmful demographic bias. Integrating multimodal approaches, which combine visual data with additional modalities such as text and metadata, allows this work to enhance the fairness and accuracy of image classification systems.
Multimodal Ensembling for Zero-Shot Image Classification (Abstract)
Javon Hickmon AAAI 2024
[PDF]Despite recent advances in vision-language fields, multimodal image classification is still challenging. Models with low capacity underperform on fine-grained image classification, and high-quality data with rich cross-modal representations can be difficult to generate. Here, we propose ensemble learning to reduce the impact of these issues on pre-trained models.
Presentations
Multimodal Ensembling for Zero-Shot Image Classification
[Poster Presentation]- 2024 AAAI Undergraduate Consortium
- 2024 Gabriel E. Gallardo Symposium
Honeybee Swarm Dynamics: Investigating the Relationship Between Individual Decision-Making and Collective Foraging
[Poster Presentation]- 2023 SACNAS NDiSTEM Conference
Thinking Beyond Images: Using Chain-of-Thought Prompting to Harness the Power of Language in Multimodal Models
[Poster Presentation] [Oral Presentation]- 2023 STARS Celebration
- 2023 UCLA National McNair Conference
- Paul G. Allen School Undergraduate and Master’s Research Showcase
Teaching
Instructor (University of Washington)
- CSE 190W: Allen School Scholars Program CSE 121 Supplemental Course
September 2024 - Present
Lead Undergraduate Teaching Assistant (University of Washington)
- CSE 190Z: Allen School Scholars Program CSE 123 Supplemental Course
March 2024 - June 2024 - CSE 190Y: Allen School Scholars Program CSE 122 Supplemental Course
January 2024 - March 2024 - CSE 190X: Allen School Scholars Program CSE 121 Supplemental Course
September 2023 - December 2023
Undergraduate Teaching Assistant (University of Washington)
- CSE 190Z: Allen School Scholars Program CSE 123 Supplemental Course
March 2023 - June 2023 - CSE 190Y: Allen School Scholars Program CSE 122 Supplemental Course
January 2023 - March 2023 - CSE 190X: Allen School Scholars Program CSE 121 Supplemental Course
September 2022 - December 2022
Check-In Teaching Assistant (University of Washington)
- CSE 190Z: Allen School Scholars Program CSE 123 Supplemental Course
March 2022 - June 2022
AP CSA Content Presenter (Code.org)
- You can view the content here
March 2022
Talks and Panels
2024
- UW CSE 390R Student Research Panel, Nov. 2024
- LEAP REU Student Panel, Nov. 2024
- GEM Fellow Panel, July 2024
- UW GEN1 Career Panel, May 2024
- COM² & LEAP: Research Conferences 101, May 2024
- Gabriel E. Gallardo Symposium Student Leader Panel, April 2024
- National LEAP Alliance Webinar on Undergraduate Research, March 2024
2023
- COM² CS Ed Week Outreach Poster, Dec. 2023
- "Honeybee Swarm Dynamics" - Invited Lecture @ CU Boulder, Nov. 2023
- UW Direct Admit Seminar Student Leader Panel, Nov. 2023
- UW CSE 390R Student Research Panel, Nov. 2023
- MiT/LEAP Summer Research Program Student Panel, Nov. 2023
- COM² Git and Version Control Workshop, May 2023
- UW CSE Undergraduate Research Roundtable, April 2023
- BS/MS Student Panel, April 2023
- COM² React JS Workshop, Feb. 2023