NLP in Healthcare workshop at Poornima University

Role of Natural Language Processing in Healthcare

Date of Event: May 05, 2020 Venue: Online Event Overview: In May 2020, Poornima University in Rajasthan hosted a groundbreaking workshop focusing on the Role of Natural Language Processing (NLP) in Healthcare. This event provided a unique platform for healthcare professionals, technologists, and students to explore the intersection of advanced linguistic technology and healthcare applications. Highlights of the Workshop: Introduction to NLP in Healthcare: The workshop started with an overview of NLP and its evolving role in the healthcare sector, emphasizing how it transforms patient care and medical data analysis. ...

May 5, 2020 · 2 min · Akshat Gupta

Understanding Attention in Transformers

Attention lets a model construct a new representation of each token by mixing information from other tokens. The mixing weights depend on the current input, so the same word can use different context in different sentences. That description is useful but incomplete. Attention does not inherently know token order. A causal mask is not a positional encoding. A key-value (KV) cache is not long-term memory. Retrieval-augmented generation (RAG) and mixture-of-experts (MoE) are not attention variants. Attention maps can also be informative without being faithful explanations of a prediction. ...

August 15, 2024 · 8 min · Akshat Gupta