Picture of Margrit Betke from 2018 PhD applicants: No new students AI & Emerging Media BU AIR @ HIC IVC Logo OLD Camera Mouse Website Women in CS BU Logo
Margrit Betke, Professor, Department of Computer Science

Short Bio and Funding, Long CV

Education: Ph.D. in Computer Science and Electrical Engineering, Massachusetts Institute of Technology
Research: Computer vision, human-computer interfaces, medical image analysis, and machine learning. Sample projects:
Publications: Recent publications and full list of publications, Google Scholar profile, Semantic Scholar, ACM Digital Library profile, DBLP profile, https://orcid.org/0000-0002-4491-6868
Students: Current PhD students: Ge Gao (co-advised with Derry Wijaya), Yiwen Gu, Stan (Sha) Lai, Mahir Patel (co-advised with Bryan Plummer), Wenda Qin, Kaihong Wang, Hao Yu, and Yi Zheng (co-advised with Wijaya Kolachalama). Current MS research students: Sarah Bonner, Alex (Hantian) Liu, and Farid Karimli. Most recently graduated PhD students: Elham Saraee, Ajjen Joshi, Wenxin Feng, Andrew Kurauchi, Mehrnoosh Sameki. UROP students: Alex Lavaee, Junyi Li, Chloe Valcourt, Jialin Yu, Student Awards.
Former Postdocs: Randa Elanwar and Zheng Wu.
Teaching: Artificial Intelligence (CS 640) in Fall 2023, Room CAS 216, Tue, Thu 2:00-3:45 pm
Image and Video Computation (CS 585) in Spring 2024, Room CS 224, Tue/Thu 5-6:15 pm
Geometric Algorithms (CS 132) in Fall 2010
Graduate Initiation Seminar (CS 697) in Spring 2018. In Spring 2023: Mon 10:05-10:55, CCDS 701.
Directed Study in Image and Video Computing: CAS CS 491, GRS CS 941, or GRS CS 979, or Directed Study in AI: GRS CS 940, ongoing.
Office Hours: Spring 2023: Mon after class (11:05 - 11:55) in my office CCDS 827 or by arrangement. Zoom link: https://bostonu.zoom.us/my/margritbetke
Honors & Awards: HERS Leadership Institute Award, Wellesley Class of 2018. Elected to Senior Member of the ACM and Senior Member of the IEEE in October 2012. One of two academics to win the "Top 10 Women to Watch in New England" Award in 2005. Many sponsored students and researchers have won awards.
In the News: Nov. 10, 2023: 7 Investigates: Voice Cloning.
Feb. 2, 2022: ML reveals new factor for predicting a stroke survivor’s ability to regain language skills
Can the U.S. win the A.I. arms race? Interview by Futurity, March 4, 2019. Google Award, Group Behavior Award.
Camera Mouse: Video Interview, BU, Kablenet, Belfast Telegraph, MassHighTech, Bradford Telegraph & Argus
Empathic Painting: BBC, ABC News, SydneyMH, The Hindu, DigitalWorld Tokyo, Inky, Canada TecChannel - München, Frontpage - Netherlands
Free Software: Camera Mouse - a program that enables a person with severe disabilities to control the mouse pointer on the computer screen just by moving the head (see also research version).
Camera Canvas - image editing software developed for people with severe motor impairments who cannot use their hands to operate a mouse or keyboard. It can be used with the Camera Mouse or other mouse-replacement tools. Camera Canvas enables users to edit images and draw pictures just by moving their heads.
Patent: "Method and system for the detection, comparison and volumetric quantification of pulmonary nodules on medical computed tomography scans." Inventors Margrit Betke and Jane P. Ko., US Patent 7,206,462, issued on April 17, 2007.
Editor: Associate Editor, Editorial Board of the journal IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)


M. Betke and Z. Wu. 2016. Data Association for Multi-Object Visual Tracking. Morgan & Claypool Lecture Series on Computer Vision. 120 pages.

Recent Publications:

Journal Papers:

Zheng, Y., Conrad, R. D., Green, E. J., Burks, Betke, M., Bean, J. E., and Kolachalama, V. B. (2024). Graph attention-based fusion of pathology images and gene expression for prediction of cancer survival IEEE Trans Med Imaging. Online ahead of print. DOI: 10.1109/TMI.2024.3386108. PMID: 38587959

Lauren Etter, Margrit Betke, Ingrid Y. Camelo, Christopher J. Gill, Rachel Pieciak, Russell Thompson, Libertario Demi, Umair Khan, Alyse Wheelock, Janet Katanga, Bindu N. Setty, and Ilse Castro-Aragon. "Curated and Annotated Dataset of Lung US Images of Zambian Children with Clinical Pneumonia." Radiology: Artificial Intelligence, 6(2), Feb 12 2024. DOI 10.1148/ryai.230147

Lei Guo, Hao Yu, H. Denis Wu, and Margrit Betke. "The emotional power of partisan media: A computer vision analysis of the 2020 Democratic Party presidential primaries." Mass Communication and Society. March 2024. In press.

Nataniel Ruiz*, Hao Yu*, Danielle A. Allessio, Mona Jalal, Ajjen Joshi, Tom Murray, John J. Magee, Kevin Manuel Delgado, Vitaly Ablavsky, Stan Sclaroff, Ivon Arroyo, Beverly P. Woolf, Sarah Adel Bargal, and Margrit Betke. ATL-BP: A Student Engagement Dataset and Model for Affect Transfer Learning for Behavior Prediction. IEEE Transactions on Biometrics, Behavior, and Identity Science. 5(3): 411-424. July 2023. DOI 10.1109/tbiom.2022.3210479. *Equal contribution.

Hantian Liu, Claire Cordella, Prakash Ishwar, Margrit Betke, and Swathi Kiran. Consistent long-term practice leads to consistent improvement: Benefits of self-managed therapy for language and cognitive deficits using a digital therapeutic. Frontiers in Digital Health, Section Personalized Medicine. Vol. 5: 1095110. 13 pages. April 11, 2023. https://doi.org/10.3389/fdgth.2023.1095110

Guo, L., Zhang, Y., Mays, K., Akyürek, A. F., Wijaya, D., & Betke, M. (2023). Agenda Setting, Cross-cutting Effects, and Political Expression on Social Media: The Gun Violence Case. Communication Research. Published online March 29, 2023. doi.org/10.1177/00936502231151555

M Patel, Y Gu, LC Carstensen, ME Hasselmo, M Betke Animal Pose Tracking: 3D Multimodal Dataset and Token-based Pose Optimization. International Journal of Computer Vision 131 (2), 514-530. February 2023. https://doi.org/10.1007/s11263-022-01714-5

Lei Guo, Chao Su, Sejin Paik, Vibhu Bhatia, Vidya Prasad Akavoor, Ge Gao, Margrit Betke and Derry Wijaya. (2023) Proposing an open-sourced tool for computational framing analysis of multilingual data. Digital Journalism: 11(2):276-297. pdf. Open Framing Code

Peer-reviewed Conference Papers:

Hao Yu, Danielle A. Allessio, Will Lee, William Rebelsky, Frank Sylvia, Tom Murray, John J. Magee, Ivon Arroyo, Beverly P. Woolf, Sarah Adel Bargal, and Margrit Betke. COVES: A Cognitive-Affective Deep Model that Personalizes Math Problem Difficulty in Real Time and Improves Student Engagement with an Online Tutor. MM'23: Proceedings of the 31st ACM International Conference on Multimedia, (ACM MM) Ottawa, Canada, October 29-November 2, 2023. Pages 6152-6160. DOI 10.1145/3581783.3613965

Kaihong Wang, Donghyun Kim, Rogerio Feris, and Margrit Betke. CDAC: Cross-domain Attention Consistency in Transformer for Domain Adaptive Semantic Segmentation. Proceedings of the International Conference on Computer Vision (ICCV), Paris, France, October 2-6, 2023. 11 pages. pdf

Saurav Chennuri, Sha Lai, Anne Billot, Maria Varkanitsa, Emily J. Braun, Swathi Kiran, Archana Venkataraman, Janusz Konrad, Prakash Ishwar, and Margrit Betke. Fusion Approaches to Predict Post-stroke Aphasia Severity from Multimodal Neuroimaging Data. Proceedings of the International Conference on Computer Vision Workshop on Computer vision for Automated Medical Diagnosis (ICCV CVAMD 2023). Paris, France, October 2, 2023. Pages 2636-2645. pdf.

Wenda Qin, Lauren Etter, Alinani Simukanga, Christopher Gill, and Margrit Betke. Age-constrained Ear Recognition: The EICZA Dataset and SASE Baseline Model. Proceedings of the IEEE International Joint Conference on Biometrics ( IJCB 2023 ), Ljubljana, Slovenia, September 25-28, 2023. Best Poster Award. Paper pdf.

Thompson, R., Khan, U., Li, J., Etter, L. P., Camello, I., Pieciak, R. C., . . . Betke, M. (2023). Investigating effective transfer of deep learning models from adults to children for lung ultrasound data analysis. In 2023 IEEE International Ultrasonics Symposium (IUS). IEEE. doi:10.1109/ius51837.2023.10306962

Sejin Paik, Sarah Bonna, Ekaterina Novozhilova, Ge Gao, Jongin Kim, Derry Wijaya, Margrit Betke. The Affective Nature of AI-Generated News Images: Impact on Visual Journalism. Proceedings of the 2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII), Cambridge, MA, September 2023. 8 pages. Pdf, data, and codebook, and 10.1109/ACII59096.2023.10388166

Beverly Woolf, Margrit Betke, Hao Yu, Sarah Bargal, Ivon Arroyo, John J. Magee, Danielle Allessio, Will Rebelsky. Face Readers: The Frontier of Computer Vision and Math Learning. AIED2023 Workshop: Towards the Future of AI-Augmented Human Tutoring in Math Learning, Tokyo, Japan, July 7, 2023. 13 pages.

Mahir Patel, Lucas Carstensen, Yiwen Gu, Michael Hasselmo, and Margrit Betke. BU-CVKit: Extendable Computer Vision Framework for Species Independent Tracking and Analysis. CV4Animals: Computer Vision for Animal Behavior Tracking and Modeling, Workshop at the Computer Vision and Pattern Recognition Conference (CVPR), Vancouver, Canada, June 18, 2023. 5 pages. https://arxiv.org/abs/2306.04736

Sejin Paik, Lei Guo, Nan Zhou, Yanling Zhao, Ge Gao, Meet Parekh, Ishwar Prakash, Margrit Betke, and Derry Wijaya. Crowdsourcing Emotions on Multimodal Framing Effects of Gun Violence News. 73rd Annual International Communication Association Conference, Reclaiming Authenticity in Communication, Toronto, Canada, May 2023.

Conference Abstracts:

Russell Thompson, Umair Khan, Jason Li, Lauren Etter, Ingrid Camelo, Rachel Pieciak, Ilse Castro-Aragon, Bindu Setty, Christopher Gill, Libertario Demi, and Margrit Betke. Effectiveness of transferring ultrasound deep learning models from adults to pediatrics for frame based pneumonia classification. The Journal of the Acoustical Society of America: 153 (3_supplement), A189-A189 2023. https://doi.org/10.1121/10.0018616. Oral presentation at the International Lung Ultrasound Symposium (ILUS2023), Trento, Italy, 10-12 July, 2023.

Russell Thompson, Umair Khan, Lauren Etter, Ingrid Camelo, Rachel Pieciak, Ilse Castro-Aragon, Bindu Setty, Christopher Gill, Libertario Demi, and Margrit Betke. Anomaly Detection In Pediatric Lung Ultrasound Using Consistency BiGAN. Oral presentation at the International Lung Ultrasound Symposium (ILUS2023), Trento, Italy, 10-12 July, 2023.

Yanru Jiang, Sha Lai, Lei Guo, Prakash Ishwar, Derry Wijaya, and Margrit Betke. Community Detection of the Framing Element Network: Proposing and Assessing a New Computational Framing Analysis Approach. 105th Annual Conference of the Association for Education in Journalism and Mass Communication (AEJMC), Detroid, MI. August 2022. Oral Presentation. Top Method Paper Award.

Mahir Patel, Yiwen Gu, Lucas Carstensen, Micheal E. Hasselmo, and Margrit Betke. 3D Multimodal Dataset and Token-based Pose Optimization. CV4Animals Workshop: Computer Vision for Animal Behavior Tracking and Modeling. In conjunction with Computer Vision and Pattern Recognition (CVPR), June 19-24, 2022, New Orleans, Lousiana. Poster.

Saurav Chennuri, Anne Billot, Sha Lai, Prakash Ishwar, Margrit Betke, and Swathi Kiran. 2022. Feature Analysis and Extraction for Post Aphasia Recovery Prediction. 26th UK Conference on Medical Image Understanding and Analysis. 27 - 29 July 2022, Centre for Mathematical Sciences, University of Cambridge. Poster.

Russell Thompson, Jason Li, Kaihong Wang, Lauren Etter, Ingrid Camelo, Ilse Castro, Bindu Setty, Hailey Chang, Margrit Betke, Rachel Pieciak, and Christopher Gill. Using Artificial Intelligence to Interpret Pneumonia CXR (chest X ray) Findings in Children with a Phone Application Platform. The Society of Pediatric Radiology (SPR) 2022 Annual Meeting, April 27-May 1, Denver, Colorado. Poster.

Ingrid Camelo, Rachel Pieciak, Ilse Castro-Aragon, Bindu Setty, Margrit Betke, Lauren Etter, Jason Li, Russell Thompson, Christopher Gill. Concordance between Chest X Ray (CXR) and Point of Care Ultrasound (POCUS) Findings in Children Diagnosed with RSV Infection by Nasopharyngeal RT-PCR: The Zambia Experience. 9th Congress of the European Academy of Paediatric Societies (EAPS 2022), Barcelona, Spain, 7-11 October 2022. Poster.

Technical Reports:

Kaihong Wang, Donghyun Kim, Rogerio Feris, Kate Saenko, and Margrit Betke. Exploring Consistency in Cross-Domain Transformer for Domain Adaptive Semantic Segmentation. November 2022. 10 pages. https://arxiv.org/abs/2211.14703

Yi Zheng, Rushin H. Gindra, Emily J. Green, Eric J. Burks, Margrit Betke, Jennifer E. Beane, and Vijaya B. Kolachalama. A graph-transformer for whole slide image classification. May 2022. 16 pages. https://arxiv.org/abs/2205.09671

Donghyun Kim, Kaihong Wang, Kate Saenko, Margrit Betke, and Stan Sclaroff. A Unified Framework for Domain Adaptive Pose Estimation. April 2022. 24 pages. https://arxiv.org/abs/2204.00172

Earlier Publications:

Image of Research Results
Margrit Betke, Professor
Computer Science Department
Boston University
665 Commonwealth Ave, CCDS Room 827
Boston, MA 02215 ( campus map , Fly around and through our new building )
Email: betke @ cs.bu.edu
URL: http://www.cs.bu.edu/faculty/betke
Phone: 617-353-8919
Fax: 617-353-6457
Zoom: https://bostonu.zoom.us/j/6510753330
Last updated: February 1, 2023
Valid CSS!
Valid HTML 4.01 Transitional