Project Overview

Project Problem Statement

Client wants to create a system to help people with disabilities complete day-to-day activities by tracking eye movement. For example,
  • Using pupil movement to control mouse cursor
  • Prediction of the user’s state (predicting seizures, stress, fatigue, etc.)
Three different algorithms crucial for the success of this goal:
  • Blink Detection
  • Pupil Tracking
  • Semantic Segmentation
Functional Requirement:
  • Create a system with 3 models (blink, pupil detection, semantic segmentation) running in parallel. No timing requirements.
  • Create a system with blink and pupil detection running in parallel, and achieve throughput of 200 FPS.
Constraints:
  • Client provides 2 ML models (blink and pupil tracking).
  • Client wants it implemented on the Xilinx Kria KV260 evaluation board.

Team Members

Jonathan Tan

Petalinux and Profiling Engineer

Jonathan Tan is a senior in Computer Engineering and is working towards completing his undergrad and getting his master's in computer engineering. His area of interest is computer architecture and hardware accelerator design.

Josh Czarniak

DPU Manager Developer

Josh Czarniak is a senior in Computer Engineering and is working towards completing his undergrad. His main interests are embedded systems embedded software systems, computer architecture hardware, and machine learning.

Justin Wenzel

Multithreaded Program Developer

Justin Wenzel is currently a senior pursuing a Bachelor’s degree in Computer Engineering, complemented by a minor in General Business. His academic and professional interests primarily revolve around low-level system programming and the architecture of machine learning models on different platforms.

Kai Heng Gan

Semantic Segmentation Model Developer

Kai Heng Gan is a senior in Cybersecurity Engineer and is a research assistant with the Department of Civil, Construction and Environmental Engineering. His current research interest includes large-scale distributed system monitoring, chip architecture, and AI in cyber defense system.

Santiago Campoverde

Model Analysis Engineer

Santiago Campoverde is a Software Engineering senior working on completing his undergraduate degree. His main professional interests include app development, artificial intelligence, and machine learning.





CPR E 492 Bi-Weekly Reports

Report 1
Report 2
Report 3
Report 4
Report 5
Report 6


CPR E 491 Weekly Reports

Report 1
Report 2
Report 3
Report 4
Report 5
Report 6
Report 7
Report 8
Report 9
Report 10


Design Documents

Design Document - User Needs
Design Document - Requirements
Design Document - Project Plan
Design Document - Design
HAML Design Document V1
HAML CPRE 492 Presentation Slides
HAML Design Document V2


Lightning Talks

Lightning Talk 1 - Problems and Users
Lightning Talk 2 - User Needs and Requirements
Lightning Talk 3 - Project Plan
Lightning Talk 4 - Design Part 1
Lightning Talk 5 - Design Part 2
Lightning Talk 6 - Contexualization Design
Lightning Talk 7 - Ethics and Professional Responsibility


Final Deliverable

CPRE 492 - IRP Presentation PowerPoint
CPRE 492 - Poster