Picture of Margrit Betke from 2018 PhD applicants: No new students AI & Emerging Media BU AIR @ HIC IVC Logo Camera Mouse Website Women in CS BU Logo
Margrit Betke, Professor, Department of Computer Science

Short Bio and Funding, Long CV

Education: Ph.D. in Computer Science and Electrical Engineering, Massachusetts Institute of Technology
Research: Computer vision, human-computer interfaces, human computation, medical image analysis, and application of machine learning. Sample projects:
Publications: Recent publications and full list of publications, Google Scholar profile, Microsoft Academic Search profile, ACM Digital Library profile, DBLP profile, https://orcid.org/0000-0002-4491-6868
Students: Current PhD students: Yiwen Gu, Stan (Sha) Lai, Wenda Qin, Hao Yu, Kaihong Wang, Yi Zheng. Current MS students: Divya Appapogu, Saurav Chennuri, Alex (Hantian) Liu, and Mahir Patel. Most recently graduated PhD students: Elham Saraee, Ajjen Joshi, Wenxin Feng, Andrew Kurauchi, Mehrnoosh Sameki, Former MA, UROP students: Qitong Wang. Ashutosh Sanan, Kratesh Ramrakhyani, Huy Le. Student Awards.
Former Postdocs: Randa Elanwar and Zheng Wu.
Teaching: Artificial Intelligence (CS 640) in Fall 2020, Room LAW AUD, Tue, Thu 9:30-10:45 am
Image and Video Computation (CS 585) in Spring 2021: Tue/Thu 9:30-10:45 am
Geometric Algorithms (CS 132) in Fall 2010
Graduate Initiation Seminar (CS 697) in Spring 2018: Fri 10:10-11:25, PHO 211.
Directed Study in Image and Video Computing: CAS CS 492, GRS CS 941, or GRS CS 979, or Directed Study in AI: GRS CS 941, ongoing.
Office Hours: Spring 2021: Mon 4-5:30. Tue, Thu after class at 10:45 in person & on zoom. Zoom link: https://bostonu.zoom.us/my/margritbetke
Honors & Awards: HERS Leadership Institute Award, Wellesley Class of 2018. Elected to Senior Member of the ACM and Senior Member of the IEEE in October 2012. One of two academics to win the "Top 10 Women to Watch in New England" Award in 2005. Many sponsored students and researchers have won awards.
In the Press: Feb. 2, 2022: ML reveals new factor for predicting a stroke survivor’s ability to regain language skills
Can the U.S. win the A.I. arms race? Interview by Futurity, March 4, 2019. Google Award, Group Behavior Award.
Camera Mouse: Video Interview, BU, Kablenet, Belfast Telegraph, MassHighTech, Bradford Telegraph & Argus
Empathic Painting: BBC, ABC News, SydneyMH, The Hindu, DigitalWorld Tokyo, Inky, Canada TecChannel - München, Frontpage - Netherlands
Free Software: Camera Mouse - a program that enables a person with severe disabilities to control the mouse pointer on the computer screen just by moving the head (see also research version).
Camera Canvas - image editing software developed for people with severe motor impairments who cannot use their hands to operate a mouse or keyboard. It can be used with the Camera Mouse or other mouse-replacement tools. Camera Canvas enables users to edit images and draw pictures just by moving their heads.
Patent: "Method and system for the detection, comparison and volumetric quantification of pulmonary nodules on medical computed tomography scans." Inventors Margrit Betke and Jane P. Ko., US Patent 7,206,462, issued on April 17, 2007.
Editor: Associate Editor, Editorial Board of the journal IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
Associate Editor, Editorial Board of the journal Computer Vision and Image Understanding (CVIU)


M. Betke and Z. Wu. 2016. Data Association for Multi-Object Visual Tracking. Morgan & Claypool Lecture Series on Computer Vision. 120 pages.

Recent Publications:

Journal Papers:

Nataniel Ruiz*, Hao Yu*, Danielle A. Allessio, Mona Jalal, Ajjen Joshi, Tom Murray, John J. Magee, Kevin Manuel Delgado, Vitaly Ablavsky, Stan Sclaroff, Ivon Arroyo, Beverly P. Woolf, Sarah Adel Bargal, and Margrit Betke. ATL-BP: A Student Engagement Dataset and Model for Affect Transfer Learning for Behavior Prediction. IEEE Transactions on Biometrics, Behavior, and Identity Science. 2022. Accepted. *Equal contribution.

Lei Guo, Chao Su, Sejin Paik, Vibhu Bhatia, Vidya Prasad Akavoor, Ge Gao, Margrit Betke and Derry Wijaya. Proposing an open-sourced tool for computational framing analysis of multilingual data. Digital Journalism. Available online, February 15, 2022. pdf. Open Framing Code

Anne Billot, Sha Lai, Maria Varkanitsa, Emily J. Braun, Brenda Rapp, Todd B. Parrish, James Higgins, Ajay S. Kurani, David Caplan, Cynthia K. Thompson, Prakash Ishwar, Margrit Betke and Swathi Kiran. Multimodal neural and behavioral data predict response to rehabilitation in chronic post-stroke aphasia. January 26, 2022. Stroke. 9 pp. DOI: 10.1161/STROKEAHA.121.036749

Alinani Simukanga, Misaki Kobayashi, Lauren Etter, Wenda Qin, Rachel Pieciak, Duarte Albuquerque, Yu-Jen Chen, Margrit Betke, William MacLeod, Jackson Phiri, Lawrence Mwananyanda, Christopher J Gill. The impact of ear growth on identification rates using an ear biometric system in young infants. Gates Open Research 5(179), December 15, 2021. doi:10.12688/gatesopenres.13459.1

Randa Elanwar, Wenda Qin, Margrit Betke, and Derry T. Wijaya. Extracting text from scanned Arabic books: a large-scale benchmark dataset and a fine-tuned Faster-R-CNN model. International Journal on Document Analysis and Recognition (IJDAR) 24: 349-362. June 2021. https://doi.org/10.1007/s10032-021-00382-4

Yi Zheng, Clarissa A Cassol, Saemi Jung, Divya Veerapaneni, Vipul C. Chitalia, Kevin Ren, Shubha S. Bellur, Peter Boor, Laura M. Barisoni, Sushrut S. Waikar, Margrit Betke, and Vijaya B. Kolachalama. Deep learning-driven quantification of interstitial fibrosis in digitized kidney biopsies. The American Journal of Pathology. May 2021. https://doi.org/10.1101/2021.01.03.21249179

Lei Guo, Kate Mays, Yiyan Zhang, Derry Wijaya, and Margrit Betke. What makes gun violence a (less) prominent issue? A computational analysis of compelling arguments and selective agenda setting. Mass Communication & Society:24(5):651-675, April 2021. https://doi.org/10.1080/15205436.2021.1898644

Peer-reviewed Conference Papers:

Ge Gao, Sejin Paik, Carley Reardon, Yanling Zhao, Lei Guo, Prakash Ishwar, Margrit Betke, and Derry Wijaya. Prediction of People's Emotional Response towards Multi-modal News. The 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (AACL-IJCNLP), November 2022. 10 pages.

Donghyun Kim, Kaihong Wang, Kate Saenko, Margrit Betke, and Stan Sclaroff. A Unified Framework for Domain Adaptive Pose Estimation. European Conference on Computer Vision (ECCV), Tel Aviv, October 23-27, 2022. 18 pages.

Carley Reardon, Sejin Paik, Ge Gao, Meet Parekh, Yanling Zhao, Lei Guo, Margrit Betke, and Derry Wijaya. NEmo: An Affective Dataset of Gun Violence News. Proceedings of the 13th Conference on Language Resources and Evaluation ( LREC 2022) Palais du Pharo, Marseille, France, June 20-25, 2022, pages 2507-2516, pdf.

Sha Lai, Yanru Jiang, Lei Guo, Margrit Betke, Prakash Ishwar, and Derry Tanti Wijaya. An Unsupervised Approach to Discover Media Frames. Proceedings of The LREC 2022 Workshop on Natural Language Processing for Political Science, Marseille, France, June 20-25, 2022, ISBN: 979-10-95546-88-7. Pages 22-31 pdf.

Will Lee, Danielle Allessio, William Rebelsky, Sai Satish Gattupalli, Hao Yu, Ivon Arroyo, Margrit Betke, Sarah Bargal, Tom Murray, Frank Sylvia, and Beverly P. Woolf. Measurements and Interventions to Improve Student Engagement through Facial Expression Recognition. HCI International 2022: The 24th International Conference on Human-Computer Interaction. 26 June - 1 July 2022. 18 pages.

Nataniel Ruiz, Hao Yu, Danielle Allessio, Mona Jalal, Ajjen Joshi, Thomas Murray, John Magee, Jacob Whitehill, Vitaly Ablavsky, Ivon Arroyo, Beverly Woolf, Stan Sclaroff, and Margrit Betke. Leveraging Affect Transfer Learning for Behavior Prediction in an Intelligent Tutoring System. IEEE International Conference on Automatic Face and Gesture Recognition 2021. December 15-18, 2021. 8 pages. Best Poster Award. DOI 10.1109/FG52635.2021.9667001

Isidora Tourni, Lei Guo, Taufiq Husad Daryanto, Fabian Zhafransyah, Edward Edberg Halim, Mona Jalal, Boqi Chen, Sha Lai, Hengchang Hu, Margrit Betke, Prakash Ishwar, and Derry Tanti Wijaya. Detecting Frames in News Headlines and Lead Images in U.S. Gun Violence Coverage. In Findings of the Assocation for Computational Linguistics: 2021 Conference on Empirical Methods in Natural Language Processing. November 2021, pages 4037-4050, Punta Cana, Dominican Republic. DOI 10.18653/v1/2021.findings-emnlp.339

Vibhu Bhatia, Vidya Prasad Akavoor, Sejin Paik, Lei Guo, Mona Jalal, Alyssa Smith, David Assefa Tofu, Edward Edberg Halim, Yimeng Sun, Margrit Betke, Prakash Ishwar and Derry Tanti Wijaya. OpenFraming: Open-sourced Tool for Computational Framing Analysis of Multilingual Data. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 242-250. Online and Punta Cana, Dominican Republic. November 2021. DOI 10.18653/v1/2021.emnlp-demo.28

Kevin Delgado, Juan Manuel Origgi, Tania Hasanpoor, Hao Yu, Danielle Allessio, Ivon Arroyo, William Lee, Margrit Betke, Beverly Woolf, and Sarah Adel Bargal. Student Engagement Dataset. ICCV 2021: 2nd Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW). October 11-17, 2021. 9 pages. DOI 10.1109/ICCVW54120.2021.00405

Y. Zheng, Q. Wang, and M. Betke. Semantic-Based Sentence Recognition in Images Using Bimodal Deep Learning. 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, AK, pages 2753-2757. September 2021. DOI: 10.1109/ICIP42928.2021.9506688.

H. Yu, A. Gupta, W. Lee, I. Arroyo, M. Betke, D. Allesio, T. Murray, J. Magee, B. P. Woolf Measuring and Integrating Facial Expressions and Head Pose as Indicators of Engagement and Affect in Tutoring Systems. In Adaptive Instructional Systems. Adaptation Strategies and Methods, Third International Conference, AIS 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings, Part II, pp.219-233. DOI: 10.1007/978-3-030-77873-6_16

Sha Lai, Anne Billot, Maria Varkanitsa, Emily Braun, Brenda Rapp, Todd Parrish, Ajay Kurani, James Higgins, David Caplan, Cynthia Thompson, Swathi Kiran, Margrit Betke, and Prakash Ishwar. An Exploration of Machine Learning Methods for Predicting Post-stroke Aphasia Recovery. PETRA 2021: The 14th PErvasive Technologies Related to Assistive Environments Conference. June 2021. Pages 556-564. https://dl.acm.org/doi/abs/10.1145/3453892.3461319

Wenxin Feng, Jiangnan Zou, Andrew Kurauchi, Carlos H Morimoto, and Margrit Betke. HGaze Typing: Head-Gesture Assisted Gaze Typing. ETRA '21 Full Papers: ACM Symposium on Eye Tracking Research and Applications. May 2021, 11 pages. https://doi.org/10.1145/3448017.3457379. Best Paper Award.

Kaihong Wang, Chenhongyi Yang, and Margrit Betke. Consistency Regularization with High-dimensional Non-adversarial Source-guided Perturbation for Unsupervised Domain Adaptation in Segmentation Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21), February 2021, 35(11), pages 10138-10146. http://ojs.aaai.org/index.php/AAAI/article/view/17216

Dennis Henneman, Yichen Li, John Ochsendorf, Margrit Betke and Emily Whiting. Augmented Reality for Sculpture Stability Analysis and Conservation. Eurographics Workshop on Graphics adn Cultural Heritage. November 2020. 4 pages. pdf

Abstract and Poster:

Mahir Patel, Yiwen Gu, Lucas Carstensen, Micheal E. Hasselmo, and Margrit Betke. 3D Multimodal Dataset and Token-based Pose Optimization. CV4Animals Workshop: Computer Vision for Animal Behavior Tracking and Modeling. In conjunction with Computer Vision and Pattern Recognition (CVPR), June 19-24, 2022, New Orleans, Lousiana. Poster.

Saurav Chennuri, Anne Billot, Sha Lai , Prakash Ishwar, Margrit Betke, and Swathi Kiran. 2022. Feature Analysis and Extraction for Post Aphasia Recovery Prediction. 26th UK Conference on Medical Image Understanding and Analysis. 27 - 29 July 2022, Centre for Mathematical Sciences, University of Cambridge. Poster.

Russel Thompson, Jason Li, Kaihong Wang, Lauren Etter, Ingrid Camelo, Ilse Castro, Bindu Setty, Hailey Chang, Margrit Betke, Rachel Pieciak, and Christopher Gill. Using Artificial Intelligence to Interpret Pneumonia CXR (chest X ray) Findings in Children with a Phone Application Platform. The Society of Pediatric Radiology (SPR) 2022 Annual Meeting, April 27-May 1, Denver, Colorado. Poster.

Technical Reports:

Kaihong Wang, Chenhongyi Yang, and Margrit Betke. Consistency Regularization with High-dimensional Non-adversarial Source-guided Perturbation for Unsupervised Domain Adaptation in Segmentation Sept. 2020. 11 pages. https://arxiv.org/abs/2009.08610

Earlier Publications:

Image of Research Results
Margrit Betke, Professor
Computer Science Department
Boston University
111 Cummington Mall, Rm MCS 295B
Boston, MA 02215 ( campus map )
Email: betke @ cs.bu.edu
URL: http://www.cs.bu.edu/faculty/betke
Phone: 617-353-8919 (or 6412)
Fax: 617-353-6457
Zoom: https://bostonu.zoom.us/j/6510753330
Last updated: September 2022
Valid CSS!
Valid HTML 4.01 Transitional