Publications
2027
-
Loom: Multi-Region Analysis of Spatial Transcriptomics with Local Neighborhoods and Global TrajectoriesSiyuan Zhao, Nafiul Nipu, Hossein Fathollahian, and 4 more authorsIEEE Transactions on Visualization and Computer Graphics, 2027We present Loom, a spatial transcriptomics (ST) visual computing system to support the analysis of pseudo-temporal trajectories, comparative investigation across samples and regions of interest, and the examination of spatially structured processes within local microenvironments. ST is a molecular profiling technology that measures gene expression directly within a thin tissue section while preserving its spatial organization. For practical application-driven analyses, the ST local microenvironment data needs to be integrated with cell reference datasets and temporal simulations of cell behavior. This integration is challenging due to multi-modal registration issues and the complexity of the pseudo-temporal patterns, spatial enrichment data, and gene expression dynamics. Loom leverages a novel glyph coupled with a computational backbone to facilitate the detailed pseudo-temporal exploration of local microenvironments, cross-sample comparisons, and investigation of spatiotemporal biological mechanisms. We evaluate Loom through two case studies developed with experts in tissue pathology and oncologists and through an external usability study. The results demonstrate that Loom supports effectively the discovery of cellular transitions and spatiotemporal expression dynamics.
@article{zhao2026loom, title = {Loom: Multi-Region Analysis of Spatial Transcriptomics with Local Neighborhoods and Global Trajectories}, author = {Zhao, Siyuan and Nipu, Nafiul and Fathollahian, Hossein and Salahudeen, Ameen and Chen, Hao and Karginova, Olga and Marai, G. Elisabeta}, journal = {IEEE Transactions on Visualization and Computer Graphics}, year = {2027}, }
2026
-
Dysphagia Risk Stratification in Head and Neck Cancer via Two-Stage PRO-Clinical StackingSiyuan Zhao, Eric Ababio Anyimadu, Zachary G. Brumm, and 5 more authorsIn IEEE International Conference on Machine Learning and Applications (ICMLA), 2026Dysphagia is a debilitating late effect of head and neck cancer (HNC) treatment, yet timely identification of at-risk patients remains challenging in survivorship care. Definitive assessment relies on videofluoroscopic imaging, as captured by the Dynamic Imaging Grade of Swallowing Toxicity (CTCAE-DIGEST), which, while validated, requires specialized equipment, trained personnel, and significant patient burden, limiting its routine use in surveillance. Patient-reported outcomes (PROs), by contrast, are low-cost, scalable, and easily collected at any clinical encounter, making them an attractive alternative signal for identifying patients who may warrant further evaluation. However, a clear clinical framework for translating PRO responses into actionable interventions is still evolving. In particular, uncertainty remains regarding when a patient’s self-reported symptom burden should prompt escalation of care. This study addresses this gap by formulating a single-visit PRO-clinical prediction framework and introducing a clinically interpretable two-stage stacking model to predict swallowing impairment risk using PRO responses and structured clinical variables, without requiring videofluoroscopic imaging. The proposed framework quantifies the independent contributions of patient-reported symptoms and clinical factors within a unified and interpretable risk assessment model. Our findings demonstrate that individual MDADI responses contain predictive information beyond that captured by composite or global summary scores, while interpretability analyses reveal symptom patterns and clinical risk factors associated with swallowing impairment. Together, these results support the use of structured PRO-clinical integration as a practical, imaging-free approach for dysphagia risk stratification in HNC survivorship.
@inproceedings{zhao2026dysphagia, title = {Dysphagia Risk Stratification in Head and Neck Cancer via Two-Stage PRO-Clinical Stacking}, author = {Zhao, Siyuan and Anyimadu, Eric Ababio and Brumm, Zachary G. and Ma, Yue and Fuller, Clifton David and Zhang, Xinhua and Marai, G. Elisabeta and Canahuate, Guadalupe}, booktitle = {IEEE International Conference on Machine Learning and Applications (ICMLA)}, year = {2026}, } -
ConGAT: Context-aware graph attention network for 3D region of interest discovery in multiplexed microscopy imagesHossein Fathollahian, Siyuan Zhao, Nafiul Nipu, and 5 more authorsComputers & Graphics, 2026We present ConGAT, CONtext-aware Graph ATtention Network, a visual analysis system for identifying and analyzing cell–cell interactions in large tissue volumes, which leverages graph attention networks and self-supervised learning. Advanced multichannel microscopy techniques, such as Cyclic Immunofluorescence (CycIF), enable detailed, biomarker-based single-cell mapping, but yield large, densely packed volumes that are difficult to explore. ConGAT implements a machine learning-assisted visual analysis approach for these data. First, ConGAT constructs 3D spatial graphs from volumetric image data and applies a 3D graph attention network to model cell–cell relationships directly in 3D space. Next, we introduce a self-supervised feature refinement strategy that learns discriminative region-of-interest representations without labeled data. Through an interactive visual interface, ConGAT allows experts to define arbitrary combinations of biomarkers, enabling flexible ROIs identification and iterative exploration of spatial patterns. We assess ConGAT on synthetic ground truth and on real-world data. An evaluation with domain expert validation demonstrates that ConGAT identifies spatial patterns and candidate ROIs that show substantial agreement with expert assessments of biological relevance.
@article{fathollahian2026congat, title = {ConGAT: Context-aware graph attention network for 3D region of interest discovery in multiplexed microscopy images}, author = {Fathollahian, Hossein and Zhao, Siyuan and Nipu, Nafiul and Salahshour, Marziye and Duan, Lei and Tang, Wei and Boorboor, Saeed and Marai, G. Elisabeta}, journal = {Computers \& Graphics}, pages = {104728}, year = {2026}, publisher = {Elsevier}, } -
ChromPolymerDB: a high-resolution database of single-cell 3D chromatin structures for functional genomicsMin Chen, Lin Du, Siyuan Zhao, and 9 more authorsNucleic Acids Research, 2026The three-dimensional (3D) organization of chromatin plays a critical role in regulating gene expression and genomic processes like DNA replication, repair, and genome stability. Although these processes occur at the individual-cell level, most chromatin structure data are derived from population-averaged assays, such as Hi-C, obscuring the heterogeneity of single-cell conformations. To address this limitation, we developed a polymer physics-based modeling framework, the sequential Bayesian inference framework (sBIF), that deconvolutes bulk Hi-C data to reconstruct single-cell 3D chromatin conformations. To support a broader use of sBIF, we created ChromPolymerDB, a publicly accessible, high-resolution database of single-cell chromatin structures inferred by sBIF. The database contains 10^8 reconstructed 5 kb-resolution single cell structures, spanning over 60,000 genomic loci across 50 human cell types and experimental conditions. ChromPolymerDB features an interactive web interface with tools for 3D structural analysis and multi-omics integration. Users can explore associations between chromatin conformation and gene expression, epigenetic modifications, and regulatory elements. The platform also supports comparative analyses to identify structural changes across cell types, developmental stages, or disease contexts. ChromPolymerDB offers a unique resource for researchers studying the relationship between genome architecture and gene regulation, and for advancing comparative 3D genomics.
@article{chen2026chrompolymerdb, title = {ChromPolymerDB: a high-resolution database of single-cell 3D chromatin structures for functional genomics}, author = {Chen, Min and Du, Lin and Zhao, Siyuan and Ye, Bowei and Delafrouz, Pourya and Farooq, Hammad and Chattopadhyay, Debaleena and Marai, G. Elisabeta and Shao, Zhifeng and Liang, Jie and Czajkowsky, Daniel M. and Chronis, Constantinos}, journal = {Nucleic Acids Research}, volume = {54}, number = {D1}, pages = {D994--D1004}, year = {2026}, publisher = {Oxford University Press}, } -
Neurosurgery Network Pattern Analysis with 2nd Generation EnsemblesNafiul Nipu, Siyuan Zhao, Biswajit Maharathi, and 2 more authorsComputer Graphics Forum, 2026Evolving measuring and computing capabilities, along with increasingly complex problems or models, are resulting in a new type of dataset: second-generation ensemble data. Like first-generation ensemble data, these data consist of large-scale, repeated measurements of the same process or phenomenon, and often have a spatial component. Unlike older datasets, they typically require the extraction and aggregation of novel complex features, which may be generated through direct measurements rather than simulations, and appear in a wider range of application domains, including neuroscience. We describe an interactive visual analysis solution for this type of second-generation ensemble data, related to the study and planning of surgical interventions in epilepsy treatment. As part of this solution, we introduce a dynamic community abstraction in conjunction with analysis algorithms for feature extraction and aggregation, registration techniques to correlate and project sample data, and custom visual encodings to support the analysis of conserved network patterns. A quantitative and qualitative evaluation with domain experts at four sites demonstrates the effectiveness of this solution. We discuss this approach and solution in the context of second-generation ensemble data analysis, along with the challenges of working with this type of data.
@article{nipu2026neurosurgery, title = {Neurosurgery Network Pattern Analysis with 2nd Generation Ensembles}, author = {Nipu, Nafiul and Zhao, Siyuan and Maharathi, Biswajit and Loeb, Jeffrey and Marai, G. Elisabeta}, journal = {Computer Graphics Forum}, year = {2026}, publisher = {Eurographics and John Wiley \& Sons Ltd.}, }
2025
-
Attention-based ROI Discovery in 3D Tissue ImagesHossein Fathollahian, Siyuan Zhao, Nafiul Nipu, and 1 more authorIn IEEE VIS 2025 Bio+Med+Vis Challenge Workshop, 2025High-dimensional tissue imaging generates highly complex 3D data containing multiple biomarkers, making it challenging to identify biologically relevant regions without an expert user specifying manual labels for regions of interest. We introduce an approach to automatically identifying regions of interest (ROIs) in the 3D microscopy data. Our approach is based on a novel self-supervised multi-layer graph attention network (SSGAT), coupled with a React interactive interface wrapped around Vitessce. SSGAT employs an adversarial self-supervised learning objective to identify meaningful immune microenvironments through marker interactions. Our method reveals complex spatial bioreactions that can be visually assessed to assess their distribution across tissue.
@inproceedings{fathollahian2025attention, title = {Attention-based ROI Discovery in 3D Tissue Images}, author = {Fathollahian, Hossein and Zhao, Siyuan and Nipu, Nafiul and Marai, G. Elisabeta}, booktitle = {IEEE VIS 2025 Bio+Med+Vis Challenge Workshop}, year = {2025}, }
2024
-
A Part-to-Whole Circular Cell ExplorerSiyuan Zhao and G. Elisabeta MaraiIn IEEE VIS 2024 Bio+Med+Vis Challenge Workshop, 2024Spatial transcriptomics methods capture cellular measurements such as gene expression and cell types at specific locations in a cell, helping provide a localized picture of tissue health. Traditional visualization techniques superimpose the tissue image with pie charts for the cell distribution. We design an interactive visual analysis system that addresses perceptual problems in the state of the art, while adding filtering, drilling, and clustering analysis capabilities. Our approach can help researchers gain deeper insights into the molecular mechanisms underlying complex biological processes within tissues.
@inproceedings{zhao2024parttowhole, title = {A Part-to-Whole Circular Cell Explorer}, author = {Zhao, Siyuan and Marai, G. Elisabeta}, booktitle = {IEEE VIS 2024 Bio+Med+Vis Challenge Workshop}, year = {2024}, }