Events Talk on Connecting Language and Vision: Hierarchical Image Classification

Talk on Connecting Language and Vision: Hierarchical Image Classification



Dr. Muhammad Imran Malik, National University of Sciences and Technology
Date: 23rd December 2022
Time: 09:30 am to 10:30 am
Venue: SEECS Seminar Hall

Brief Description

Multi-level hierarchical classification addresses the problem of classifying items into a multi-level hierarchy structure of classes. For example, an image of a ‘cat’' can be classified into `biological organism’', `animal’, and `cat’', depending on the taxonomy used. While there have been several methods proposed to solve this problem, they still suffer from several drawbacks. In particular, most existing methods: (i) do not embed the taxonomy structure used, (ii) use a complex backbone neural network with 'n$ disjoint output layers that do not constraint each other, and (iii) consequently, may output predictions that are often inconsistent with the taxonomy in place. This lecture addresses these deficiencies by introducing a novel mask- based output layer for multi-level hierarchical classification. Specifically, this lecture will cover a model-agnostic output layer that embeds the taxonomy and that can be combined with any

About the Speaker

Imran Razzak is a Senior Lecturer in Human-Centered Machine Learning and a Postgraduate Research Coordinator at the School of Computer Science and Engineering at the University of New South Wales, Sydney, Australia. Previously, he was a Senior Lecturer in Computer Science at Deakin University, Geelong, Australia. He is an Associate Editor of IEEE TNNLS, IEEE TCSS, and IEEE JBHI. He has attracted research grants of more than 1.5 million AUD. His area of research focuses on connecting language and vision for better interpretation. It spans three broad areas: Machine Learning, Computer Vision and Natural Language Processing with particular emphasis on healthcare.


1. National University of Sciences and Technology (NUST):
2. Deep Learning Lab (DLL):
3. National Center of Artificial Intelligence (NCAI):

For more information and event detail, please visit:

For any queries, feel free to email at

December 23,2022 - 23, 2022