Skip to content
cs-conference-ranking.org

Shiwei Liu

Publication record assembled from the DBLP archive of ranked conferences.

Papers indexed

46

Venues

16

Active years

2020–2026

Best venue rank

A*

Where they publish

Papers

46 indexed papers, newest first.

YearVenueTitleAuthors
2026ACLO1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning.Haotian Luo, Haiying He, Yibo Wang, Shiwei Liu, Wei Li, Xiaochun Cao, Dacheng Tao, Naiqiang Tan, Li Shen
2026DATEFLARE: Finetuning ReLU With FIRE for Efficient Long-Context Inference.Michael Moffatt, Junyi Luo, Haoran Cheng, Qilong Wang, Xinting Jiang, Guanchen Tao, Shiwei Liu, Kauna Lei, Gregory Kielian, Mehdi Saligane
2025AAAIVisual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspective.Can Jin, Tianjin Huang, Yihua Zhang, Mykola Pechenizkiy, Sijia Liu, Shiwei Liu, Tianlong Chen
2025AAAISIDE: Socially Informed Drought Estimation Toward Understanding Societal Impact Dynamics of Environmental Crisis.Lanyu Shang, Bozhang Chen, Shiwei Liu, Yang Zhang, Ruohan Zong, Anav Vora, Ximing Cai, Na Wei, Dong Wang
2025ACLOutlier-weighed Layerwise Sampling for LLM Fine-tuning.Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei Liu
2025DACDRAFT: Decoupling Backpropagation from Pre-trained Backbone for Efficient Transformer Fine-Tuning on Edge.Zhirui Huang, Shiwei Liu, Haozhe Zhu, Qi Liu, Chixiao Chen
2025DACMcPAL: Scaling Unstructured Sparse Inference with Multi-Chiplet HBM-PIM Architecture for LLMs.Shiwei Liu, Zhirui Huang, Jiangnan Yu, Qi Liu, Chixiao Chen
2025ICASSPFull-Rank No More: Low-Rank Weight Training for Modern Speech Recognition Models.Adriana Fernandez-Lopez, Shiwei Liu, Lu Yin, Stavros Petridis, Maja Pantic
2025ICLRSPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training.Tianjin Huang, Ziquan Zhu, Gaojie Jin, Lu Liu, Zhangyang Wang, Shiwei Liu
2025ICLRComposable Interventions for Language Models.Arinbjrn Kolbeinsson, Kyle O'Brien, Tianjin Huang, Shanghua Gao, Shiwei Liu, Jonathan Richard Schwarz, Anurag Jayant Vaidya, Faisal Mahmood, Marinka Zitnik, Tianlong Chen, Thomas Hartvigsen
2025ICLRMix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN.Pengxiang Li, Lu Yin, Shiwei Liu
2025ICMLFrom Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications.Ajay Kumar Jaiswal, Yifan Wang, Lu Yin, Shiwei Liu, Runjin Chen, Jiawei Zhao, Ananth Grama, Yuandong Tian, Zhangyang Wang
2025ICMLLIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning.Zihang Liu, Tianyu Pang, Oleg Balabanov, Chaoqun Yang, Tianjin Huang, Lu Yin, Yaoqing Yang, Shiwei Liu
2025ICMLMask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More.Xialie Zhuang, Zhikai Jia, Jianjin Li, Zhenyu Zhang, Li Shen, Zheng Cao, Shiwei Liu
2024CSCWDMulti-behavior Enhanced Self-supervised Graph Learning for Social Recommendation.Shiwei Liu, Yong Xu
2024EMNLPIs C4 Dataset Optimal for Pruning? An Investigation of Calibration Data for LLM Pruning.Abhinav Bandari, Lu Yin, Cheng-Yu Hsieh, Ajay Jaiswal, Tianlong Chen, Li Shen, Ranjay Krishna, Shiwei Liu
2024EMNLPFFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping.Ajay Jaiswal, Bodun Hu, Lu Yin, Yeonju Ro, Tianlong Chen, Shiwei Liu, Aditya Akella
2024ICASSPHypergraph-Enhanced Self-Supervised Robust Graph Learning for Social Recommendation.Shiwei Liu, Yong Xu, Siliang Ma
2024ICCADConSmax: Hardware-Friendly Alternative Softmax with Learnable Parameters.Shiwei Liu, Guanchen Tao, Yifei Zou, Derek Chow, Zichen Fan, Kauna Lei, Bangfei Pan, Dennis Sylvester, Gregory Kielian, Mehdi Saligane
2024ICLRDynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs.Yuxin Zhang, Lirui Zhao, Mingbao Lin, Yunyun Sun, Yiwu Yao, Xingjia Han, Jared Tanner, Shiwei Liu, Rongrong Ji
2024ICLRNeurRev: Train Better Sparse Neural Network Practically via Neuron Revitalization.Gen Li, Lu Yin, Jie Ji, Wei Niu, Minghai Qin, Bin Ren, Linke Guo, Shiwei Liu, Xiaolong Ma
2024ICLRAdaMerging: Adaptive Model Merging for Multi-Task Learning.Enneng Yang, Zhenyi Wang, Li Shen, Shiwei Liu, Guibing Guo, Xingwei Wang, Dacheng Tao
2024ICMLCaM: Cache Merging for Memory-efficient LLMs Inference.Yuxin Zhang, Yuxuan Du, Gen Luo, Yunshan Zhong, Zhenyu Zhang, Shiwei Liu, Rongrong Ji
2024ICMLJunk DNA Hypothesis: Pruning Small Pre-Trained Weights Irreversibly and Monotonically Impairs "Difficult" Downstream Tasks in LLMs.Lu Yin, Ajay Kumar Jaiswal, Shiwei Liu, Souvik Kundu, Zhangyang Wang
2024ICMLOutlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity.Lu Yin, You Wu, Zhenyu Zhang, Cheng-Yu Hsieh, Yaqing Wang, Yiling Jia, Gen Li, Ajay Kumar Jaiswal, Mykola Pechenizkiy, Yi Liang, Michael Bendersky, Zhangyang Wang, Shiwei Liu
2024ICMLAdvancing Dynamic Sparse Training by Exploring Optimization Opportunities.Jie Ji, Gen Li, Lu Yin, Minghai Qin, Geng Yuan, Linke Guo, Shiwei Liu, Xiaolong Ma
2024ICMLSparse Cocktail: Every Sparse Pattern Every Sparse Ratio All At Once.Zhangheng Li, Shiwei Liu, Tianlong Chen, Ajay Kumar Jaiswal, Zhenyu Zhang, Dilin Wang, Raghuraman Krishnamoorthi, Shiyu Chang, Zhangyang Wang
2024InterspeechMSRS: Training Multimodal Speech Recognition Models from Scratch with Sparse Mask Optimization.Adriana Fernandez-Lopez, Honglie Chen, Pingchuan Ma, Lu Yin, Qiao Xiao, Stavros Petridis, Shiwei Liu, Maja Pantic
2024InterspeechDynamic Data Pruning for Automatic Speech Recognition.Qiao Xiao, Pingchuan Ma, Adriana Fernandez-Lopez, Boqian Wu, Lu Yin, Stavros Petridis, Mykola Pechenizkiy, Maja Pantic, Decebal Constantin Mocanu, Shiwei Liu
2023AAAILottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost.Lu Yin, Shiwei Liu, Meng Fang, Tianjin Huang, Vlado Menkovski, Mykola Pechenizkiy
2023CVPRMany-Task Federated Learning: A New Problem Setting and A Simple Baseline.Ruisi Cai, Xiaohan Chen, Shiwei Liu, Jayanth Srinivasa, Myungjin Lee, Ramana Kompella, Zhangyang Wang
2023ICCVData Augmented Flatness-aware Gradient Projection for Continual Learning.Enneng Yang, Li Shen, Zhenyi Wang, Shiwei Liu, Guibing Guo, Xingwei Wang
2023ICLRSparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers.Tianlong Chen, Zhenyu Zhang, Ajay Kumar Jaiswal, Shiwei Liu, Zhangyang Wang
2023ICLRRevisiting Pruning at Initialization Through the Lens of Ramanujan Graph.Duc N. M. Hoang, Shiwei Liu, Radu Marculescu, Zhangyang Wang
2023ICLRMore ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity.Shiwei Liu, Tianlong Chen, Xiaohan Chen, Xuxi Chen, Qiao Xiao, Boqian Wu, Tommi Krkkinen, Mykola Pechenizkiy, Decebal Constantin Mocanu, Zhangyang Wang
2023ICLRSparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, Ajay Kumar Jaiswal, Zhangyang Wang
2023ICMLAre Large Kernels Better Teachers than Transformers for ConvNets?Tianjin Huang, Lu Yin, Zhenyu Zhang, Li Shen, Meng Fang, Mykola Pechenizkiy, Zhangyang Wang, Shiwei Liu
2023ICMLGraph Ladling: Shockingly Simple Parallel GNN Training without Intermediate Communication.Ajay Kumar Jaiswal, Shiwei Liu, Tianlong Chen, Ying Ding, Zhangyang Wang
2023ICMLInstant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models.Ajay Kumar Jaiswal, Shiwei Liu, Tianlong Chen, Ying Ding, Zhangyang Wang
2023ISCASA Scalable Die-to-Die Interconnect with Replay and Repair Schemes for 2.5D/3D Integration.Jie Liao, Bo Jiao, Jinshan Zhang, Shiwei Liu, Hao Jiang, Jun Tao, Wenning Jiang, Qi Liu, Lihua Zhang, Haozhe Zhu, Chixiao Chen
2022ICLRDeep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity.Shiwei Liu, Tianlong Chen, Zahra Atashgahi, Xiaohan Chen, Ghada Sokar, Elena Mocanu, Mykola Pechenizkiy, Zhangyang Wang, Decebal Constantin Mocanu
2022ICLRThe Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training.Shiwei Liu, Tianlong Chen, Xiaohan Chen, Li Shen, Decebal Constantin Mocanu, Zhangyang Wang, Mykola Pechenizkiy
2021ACMLHierarchical Semantic Segmentation using Psychometric Learning.Lu Yin, Vlado Menkovski, Shiwei Liu, Mykola Pechenizkiy
2021ICMLSelfish Sparse RNN Training.Shiwei Liu, Decebal Constantin Mocanu, Yulong Pei, Mykola Pechenizkiy
2021ICMLDo We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training.Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy
2020IJCAILearning Sparse Neural Networks for Better Generalization.Shiwei Liu