• English
    • Tiếng Việt
  • Tiếng Việt 
    • English
    • Tiếng Việt
  • Đăng nhập
View Item 
  •   Trang chủ
  • The College of Engineering and Computer Science
  • Pham Huy Hieu, PhD.
  • View Item
  •   Trang chủ
  • The College of Engineering and Computer Science
  • Pham Huy Hieu, PhD.
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

A novel approach for pill-prescription matching with GNN assistance and contrastive learning

Thumbnail
Xem/Mở
A Novel Approach for Pill-Prescription Matching with GNN Assistance and Contrastive Learning.pdf (1.458Mb)
Năm xuất bản
2022
Tác giả
Nguyen, Trung Thanh
Nguyen, Hoang Dang
Nguyen, Thanh Hung
Pham, Huy Hieu
Ide, Ichiro
Nguyen, Phi Le
Metadata
Hiển thị đầy đủ biểu ghi
Tóm tắt
Medication mistaking is one of the risks that can result in unpredictable consequences for patients. To mitigate this risk, we develop an automatic system that correctly identifies pill-prescription from mobile images. Specifically, we define a so-called pill-prescription matching task, which attempts to match the images of the pills taken with the pills’ names in the prescription. We then propose PIMA, a novel approach using Graph Neural Network (GNN) and contrastive learning to address the targeted problem. In particular, GNN is used to learn the spatial correlation between the text boxes in the prescription and thereby highlight the text boxes carrying the pill names. In addition, contrastive learning is employed to facilitate the modeling of cross-modal similarity between textual representations of pill names and visual representations of pill images. We conducted extensive experiments and demonstrated that PIMA outperforms baseline models on a real-world dataset of pill and prescription images that we constructed. Specifically, PIMA improves the accuracy from 19.09% to 46.95% compared to other baselines. We believe our work can open up new opportunities to build new clinical applications and improve medication safety and patient care.
Định danh
https://vinspace.edu.vn/handle/VIN/368
Collections
  • Pham Huy Hieu, PhD. [36]

Liên hệ | Gửi phản hồi
 

 

Duyệt theo

Toàn bộ thư việnĐơn vị và Bộ sưu tậpNăm xuất bảnTác giảNhan đềChủ đềTrong Bộ sưu tậpNăm xuất bảnTác giảNhan đềChủ đề

Tài khoản

Đăng nhậpĐăng ký

Liên hệ | Gửi phản hồi