School of Electrical Engineering and Computer Science
Oregon State University
Tue & Thu at 4:00 - 5:20pm
Zoom
Prof. Minsuk Kahng
Assistant Professor, School of Electrical Engineering and Computer Science
E-mail: [email protected]
Website: https://minsuk.com
(See Canvas or send me an email for password)
This course will introduce advanced state-of-the-art research on interactive data visualization for machine learning (ML). Data visualization has recently been used as a powerful way to understand and interact with ML models and systems. Students will learn how to design and develop data visualization methods and tools for interpreting and interacting with complex ML models (e.g., deep learning models), for a variety of users (e.g., ML researchers, practitioners like ML engineers and data scientists, non-expert learners). Students will also discuss how data visualization can help address several critical human-side issues in artificial intelligence (e.g., explainability, inclusiveness).
Here are some examples of work which we will study this term:
At the completion of this course, students will be able to:
There is no requirement, but below are some guidelines:
| Wk | Date | Topic | Assignments |
|---|---|---|---|
| 0 | Thu, Sept 24 | Course Intro | |
| 1 | Tue, Sept 29 | Introduction (1): ML Interpretation and Workflow | |
| Thu, Oct 1 | Introduction (2): Data Visualization | * Project Team Formation | |
| 2 | Tue, Oct 6 | Analyzing Results (1): Summary to Indiv. Data: ModelTracker | |
| Thu, Oct 8 | Analyzing Results (2): Instances to Groups | * G1: Proposal | |
| 3 | Tue, Oct 13 | Analyzing Results (3): Explanations: LIME | |
| Thu, Oct 15 | Analyzing Results (4): In-depth Analysis & Bias: What-If Tool | * A1: Data Analysis | |
| 4 | Tue, Oct 20 | Model Visualization (1): High-dimensional data: t-SNE | |
| Thu, Oct 22 | Model Visualization (2): Graph Structure: TensorBoard Graph | * G2: Mid-Report 1 | |
| 5 | Tue, Oct 27 | VIS 2020 (either Tue or Thu) | |
| Thu, Oct 29 | Model Visualization (3): Image models (e.g., CNNs) | * A2: D3.js Programming | |
| 6 | Tue, Nov 4 | Model Visualization (4): Text models (e.g., Seq2Seq) | |
| Thu, Nov 6 | Project Poster | * G3: Mid-Report 2 | |
| 7 | Tue, Nov 11 | Refinement and Interaction (1): Interactive ML | |
| Thu, Nov 13 | Refinement and Interaction (2): Model Steering | * A3: D3.js Programming | |
| 8 | Tue, Nov 18 | Refinement and Interaction (3): Model Training or Debugging | |
| Thu, Nov 20 | Refinement and Interaction (4): Non-experts or Students | * G4: Mid-Report 3 | |
| 9 | Tue, Nov 25 | Refinement and Interaction (5): TBD | |
| Thu, Nov 27 | Thanksgiving | ||
| 10 | Tue, Dec 1 | Project Final Presentation | |
| Thu, Dec 3 | Project Final Presentation | * G5: Project Final Report | |
| 11 | No Final Exam |
CS 539 is a hands-on course. You will be expected to actively participate in paper discussion, in-class presentations, and term projects. Because of this highly interactive nature, it is mandatory to attend classes.
The typical structure of every class will be as follow. You will read papers before class. At the beginning of the class, the instructor will give a short lecture (~5-10 min). Then we'll spend 30-40 minutes for paper discussion. A group of discussion leads (2-3 people) will present paper summary, example use cases, and then students will discuss the paper during breakout. For the rest of the class time, we'll have some time for term projects. A team will present a short status update or have a breakout session to work on their project.
By the end of the term, you will likely develop a visualization tool, as a final product of your group project. Though it is not required, we suggest you implement a tool that runs on web browsers and written in JavaScript, which is the state-of-the-art way to implement interactive visualization tools. The individual assignments will involve programming exercises that help you learn how to implement a web-based interactive tool. It is not required to be familiar with JavaScript, but you should have some programming experience.
Your project does not have to involve implementing a new tool. I encourage you to develop your own research topic based on your research, especially if you are a PhD student. For example, your project Nov primarily involve human subject studies, algorithms for explainable AI, or scalable data systems. You can discuss project topics with the instructor.
Your performance will be evaluated via projects, individual assignments, nano-quizzes, readings and presentations, and participation. There will be no exams. The distribution of grading will be as follow (subject to change):
We use Canvas for all announcements and submissions.
We use Piazza for questions.
Dayeon Oh (M.S. student in CS)
The instructor and TA will hold office hours starting Week 2.
This class is our community. Every student should feel safe and welcome to contribute in this course, and it is all of our jobs to make sure this is the case. I will try to establish this tone whenever possible, but ultimately the responsibility for cultivating a safe and welcoming community belongs to the students---that means you! Fortunately, forming a safe and welcoming community is not too hard. A good place to start is to recognize (and continually remind yourself) of the following facts:
In addition, the OSU Expectations for Student Conduct apply.
In short, treat your classmates as respected colleagues, support each other when needed, have fun without spoiling it for anyone else, and everybody wins.
Accommodations for students with disabilities are determined and approved by Disability Access Services (DAS). If you, as a student, believe you are eligible for accommodations but have not obtained approval please contact DAS immediately at 541-737-4098 or at http://ds.oregonstate.edu. DAS notifies students and faculty members of approved academic accommodations and coordinates implementation of those accommodations. While not required, students and faculty members are encouraged to discuss details of the implementation of individual accommodations.
University students encounter setbacks from time to time. If you encounter difficulties and need assistance, it’s important to reach out. Consider discussing the situation with an instructor or academic advisor. Learn about resources that assist with wellness and academic success at oregonstate.edu/ReachOut. If you are in immediate crisis, please contact the Crisis Text Line by texting OREGON to 741-741 or call the National Suicide Prevention Lifeline at 1-800-273-TALK (8255).