Luo, Y., Ji, T., Sun, F., Zhang, J., Xu, H., Zhan, X. OMPO: A Unified Framework for Reinforcement Learning under Policy and Dynamics Shifts. ICLR 2024 Workshop on Bridging the Gap Between Practice and Theory in Deep Learning (BGPT).
Niu, H., Ji, T., Liu, B., Zhao, H., Zhu, X., Zheng, J., Huang, P., Zhou, G., Hu, J., Zhan, X. H2O+: An Improved Framework for Hybrid Offline-and-Online RL with Dynamics Gaps. ICLR 2024 Workshop on Data-centric Machine Learning Research (DMLR): Harnessing Momentum for Science.
Li, J., Zheng, J., Zheng, Y., Mao, L., Hu, X., Cheng, S., Niu, H., Liu, J., Liu, Y., Liu, J., Zhang, Y. Q., Zhan, X. DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning. arXiv preprint arXiv:2402.18137.
Niu, H., Hu, J., Zhou, G., Zhan, X. A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agents. arXiv preprint arXiv:2402.04580.
Wang, G., Niu, H., Zhu, D., Hu, J., Zhan, X., and Zhou, G. A Versatile and Efficient Reinforcement Learning Framework for Autonomous Driving. NeurIPS 2022 Reinforcement Learning for Real Life (RL4RealLife) Workshop.
Xu, H., Zhan, X., Li, J., and Yin, H. Offline Reinforcement Learning with Soft Behavior Regularization. NeurIPS 2021 Offline RL Workshop.
Ji, T., Zeng, Y., Luo, Y., Zhan, X. Leveraging Causal Policy-Reward Entropy for Enhanced Exploration. In 12th International Conference on Learning Representations (ICLR 2024) (Tiny Paper).
Hu, X., Li, J., Zhan, X., Jia, Q., and Zhang, Y. Q. Query-Policy Misalignment in Preference-Based Reinforcement Learning. In 12th International Conference on Learning Representations (ICLR 2024)(spotlight).
Wang, G., Cheng, S., Zhan, X., Li, X., Song, S., Liu, Y. OpenChat: Advancing Open-source Language Models with Mixed-Quality Data. In 12th International Conference on Learning Representations (ICLR 2024).
Mao, L., Xu, H., Zhang, W., Zhan, X. Revealing the Mystery of Distribution Correction Estimation via Orthogonal-gradient Update. In 12th International Conference on Learning Representations (ICLR 2024)(spotlight).
Zheng, Y., Li, J., Yu, D., Yang, Y., Li, S., Zhan, X., Liu, J. Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Model. In 12th International Conference on Learning Representations (ICLR 2024).
Cheng, P.*, Zhan, X.*, Wu, Z., Zhang, W., Song, S., Wang, H., Lin, Y., & Jiang, L. Look Beneath the Surface: Exploiting Fundamental Symmetry for Sample-Efficient Offline RL. Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023).
Wang, X., Xu, H., Zheng, Y., Zhan, X.. Offline Multi-Agent Reinforcement Learning with Implicit Global-to-Local Value Regularization. Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023).
Li, J., Hu, X., Xu, H., Liu, J., Zhan, X., Jia, Q., and Zhang, Y. Q. Mind the Gap: Offline Policy Optimization for Imperfect Rewards. In 11th International Conference on Learning Representations (ICLR 2023).
Xu, H., Jiang, L., Li, J., Yang, Z., Wang, Z., Chan, V., W., K., and Zhan, X.. Offline RL with No OOD Actions: In-Sample Learning via Implicit Value Regularization. In 11th International Conference on Learning Representations (ICLR 2023) (oral).
Li, J., Zhan, X., Xu, H., Zhu, X., Liu, J., and Zhang, Y. Q. When Data Geometry Meets Deep Function: Generalizing Offline Reinforcement Learning. In 11th International Conference on Learning Representations (ICLR 2023).
Jiang, L., Wang, X., Yang, A., Wang, X., Jin, X., Wang, W., Ye, X., Ouyang, Y., and Zhan, X.. An Efficient Multi-Agent Optimization Approach for Coordinated Massive MIMO Beamforming. In IEEE International Conference on Communications (ICC 2023).
Wang, X., and Zhan, X.. Offline Multi-Agent Reinforcement Learning with Coupled Value Factorization. In International Conference on Autonomous Agents and Multiagent Systems 2023 (AAMAS 2023) (Extended Abstract).
Xu, H., Li, J., Li, J., Zhan, X.. A Policy-Guided Imitation Approach for Offline Reinforcement Learning. In Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022) (oral).
Niu, H., Sharma, S., Qiu, Y., Li, M, Zhou G., Hu, J., Zhan, X.. When to Trust Your Simulator: Dynamics-Aware Hybrid Offline-and-Online Reinforcement Learning. In Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022).
Zhang, W., Xu, H., Niu, H., Cheng, P, Li, M., Zhang, H., Zhou G., Zhan, X.. Discriminator-Guided Model-Based Offline Imitation Learning. In Conference on Robot Learning (CoRL 2022).
Liu, S., Weng, D., Tian, Y., Deng, Z., Xu, H., Zhu, X., Yin, H., Zhan, X., Wu, Y. ECoalVis: Visual Analysis of Control Strategies in Coal-fired Power Plants. In IEEE Visualization Conference (VIS 2022).
Yu, Q., Lou, J., Zhan, X., Li, Q., Liu, J., Zuo W. and Liu, Y. Adversarial Contrastive Learning via Asymmetric InfoNCE. In 17th European Conference on Computer Vision (ECCV 2022).
Xu, H., Zhan, X., Yin, H. and Qin, H. Discriminator-Weighted Offline Imitation Learning from Suboptimal Demonstrations. In 39th International Conference on Machine Learning (ICML 2022).
Zhan, X., Zhu, X. and Xu, H. Model-Based Offline Planning with Trajectory Pruning. In 31st International Joint Conference on Artificial Intelligence (IJCAI-22), 3695-3701.
Zhan, X., Xu, H., Zhang, Y., Zhu, X. and Yin, H. DeepThermal: Combustion Optimization for Thermal Power Generating Units Using Offline Reinforcement Learning. In Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI2022).
Xu, H., Zhan, X., and Zhu, X. Constraints Penalized Q-Learning for Safe Offline Reinforcement Learning. In Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI2022).
Qin, H., Zhan, X., Li, Y., Yang, X. and Zheng, Y. Network-Wide Traffic States Imputation Using Self-interested Coalitional Learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD ’21), August 14–18, 2021, Virtual Event, Singapore. ACM, New York, NY, USA. https://doi.org/10.1145/3447548.3467424.
Qin, H., Ke, S., Yang, X., Xu, H., Zhan, X. and Zheng, Y. Robust Spatio-Temporal Purchase Prediction via Deep Meta Learning. In Proceedings of the AAAI Conference on Artificial Intelligence 35 (5), 4312-4319, 2021.
Zischg, J., Klinkhamer, C., Zhan, X., Krueger, E., Ukkusuri, S., Rao, P. S. C., Rauch, W. and Sitzenfrei, R. Evolution of Complex Network Topologies in Urban Water Infrastructure. In World Environmental and Water Resources Congress, Sacramento, May 2017.
Yang, C., Zhang, Y., Zhan, X., Ukkusuri, S. V., and Qiu, W. Activity Chain Inference Using Travel Survey and Mobile Phone data. In Proceedings of Transportation Research Board Meeting, Washington D.C., January 2017.
Zhan, X., Ukkusuri, S. V. A Probabilistic Urban Link Travel Time Estimation Model Using Large-scale Taxi Trip Data. In Proceedings of 94th Transportation Research Board Meeting, Washington D.C., January 2015.
Zhan, X., Qian, X., Ukkusuri, S. V. Measuring the Efficiency of Urban Taxi Service System. In Proceedings of the 3rd ACM SIGKDD International Workshop on Urban Computing, New York, August 2014.
Zhan, X., Ukkusuri, S. V.. Multi-User Class, Simultaneous Route and Departure Time Choice Dynamic Traffic Assignment with an Embedded Spatial Queuing Model. 5th International Symposium on Dynamic Traffic Assignment. Salerno, Italy, June, 2014.
Qian, X., Zhan, X., Ukkusuri, S. Characterizing Urban Dynamics Using Large Scale Taxicab Data. In Proceedings of 93nd Transportation Research Board Meeting, Washington D.C., January 2014.
Hasan, S., Zhan, X., and Ukkusuri, S. V. Understanding Urban Human Activity and Mobility Patterns Using Large-scale Location-based Data from Online Social Media. Proceedings of the 2nd ACM SIGKDD International Workshop on Urban Computing, August, 2013.
Feng, X., Jiang, L., Yu, X., Xu, H., Sun, X., Wang, J., Zhan, X. and Chan, W. K., 2023. Curriculum Goal-Conditioned Imitation for Offline Reinforcement Learning. In IEEE Transactions on Games.
Qin, H., Zhan, X., and Zheng, Y., 2022. CSCAD: Correlation Structure-based Collective Anomaly Detection in Complex System. In IEEE Transactions on Knowledge and Data Engineering (TKDE).
Yang, C., Zhang, Y., Zhan, X., Ukkusuri, S. V. and Chen, Y., 2020. Fusing Mobile Phone and Travel Survey Data to Model Urban Activity Dynamics. Journal of Advanced Transportation, 2020, 5321385.
Zhan, X., Li, R., and Ukkusuri, S. V., 2020. Link-based traffic state estimation and prediction for arterial networks using license-plate recognition data. Transportation Research Part C: Emerging Technologies, 117, 102660.
Zhan, X., and Ukkusuri, S. V., 2019. Spatial Dependency of Urban Sprawl and the Underlying Road Network Structure. Journal of Urban Planning and Development, 145(4), 04019014.
Zischg, J., Klinkhamer, C., Zhan, X., Rao, S. C., and Sitzenfrei, R., 2019. A Century of Topological Co-Evolution of Complex Infrastructure Networks in an Alpine City. Complexity, 2019, 2096749.
Gehlot, H., Zhan, X., Qian, X., Thompson, C., Kulkarni, M. and Ukkusuri, S. V., 2018. A-Rescue 2.0: A High Fidelity, Parallel, Agent-based Evacuation Simulator. Journal of Computing in Civil Engineering, 33(2), 04018059.
Zhan, X., Ukkusuri, S. V., and Rao, S. C., 2017. Dynamics of Functional Failures and Recovery in Complex Road Networks. Physical Review E, 96(5), 052301.
Li, R. Ye, Z., Li. B. and Zhan, X., 2017. Simulation of Hard Shoulder Running Combined with Queue Warning During Traffic Accident with CTM model. IET Intelligent Transport Systems, 11(9), 553-560.
Mo, B., Li, R., Zhan, X., 2017. Speed Profile Estimation Using License Plate Recognition Data. Transportation Research Part C: Emerging Technology, 82, 358–378.
Zhan, X., and Ukkusuri, S. V., 2019. Multiclass, Simultaneous Route and Departure Time Choice Dynamic Traffic Assignment with an Embedded Spatial Queuing Model. Transportmetrica B: Transport Dynamics, 7:1, 124-146.
Kreuger, E., Klinkhamer, C., Urich C., Zhan, X., and Rao, S. C., 2017. Generic Patterns in the Evolution of Urban Water Networks: Evidence from a Large Asian City. Physical Review E, 95(3), 032312.
Zhan, X., Zheng, Y., Yi, X., and Ukkusuri, S. V., 2016. Citywide Traffic Volume Estimation Using Trajectory Data. IEEE Transactions on Knowledge and Data Engineering (TKDE), 29(2), 272-285.
Aziz, H. M., Ukkusuri, S., Zhan, X., 2016. Determining the Impact of Personal Mobility Carbon Allowance Schemes in Transportation Networks. Network and Spatial Economics, 17(2), 505-545.
Ukkusuri, S., Hasan, S., Doan, K., Luong, B., Zhan, X., Murray-Tuite, P., Yin, W., 2016. A-RESCUE: An Agent-based Regional Evacuation Simulator Coupled with User Enriched Behavior. Network and Spatial Economics, 17(1), 197-223.
Hasan, S., Ukkusuri, S., Zhan, X., 2016. Understanding Social Influence in Activity-Location Choice and Life-Style Patterns Using Geo-location Data from Social Media. Frontiers in ICT, 3:10.
Zhan, X., Qian, X., Ukkusuri, S. V., 2016. A Graph Based Approach to Measure the Efficiency of Urban Taxi Service System. IEEE Transactions on Intelligent Transportation Systems, 17(9), 2479-2489.
Zhan, X., Ukkusuri, S., V., Yang, C., 2016. A Bayesian Mixture Model for Short-term Average Link Travel Time Estimation Using Large-scale Limited Information Trip-based Data. Automation in Construction, 72(3), 237-246.
Mesa-Arango, R., Zhan, X., Ukkusuri, S. V., Mitra, A., 2016. Direct Transportation Economic Impacts of Highway Networks Disruptions Using Public Data from United States. Journal of Transportation Safety & Security, 8(1), 36-55.
Zhan, X., Aziz, H. M., Ukkusuri, S. V., 2015. An Efficient Parallel Sampling Technique for Multivariate Poisson-Lognormal Model: Analysis with Two Crash Count Datasets. Analytic Methods in Accident Research, 8, 45-60.
Zhan, X., Li, R., Ukkusuri, S. V., 2015. Lane-based Real Time Queue Length Estimation Using License Plate Recognition Data. Transportation Research Part C: Emerging Technology, 57, 85-102.
Zhan, X., Ukkusuri, S., V., Zhu, F., 2014. Inferring Urban Land Use Using Large-Scale Social Media Check-in Data. Network and Spatial Economics, 14, 647-667.
Ukkusuri, S., Zhan, X., Sadri A., Ye, Q., 2013. Exploring Crisis Informatics Using Social Media Data: A Study on 2013 Oklahoma Tornado. Transportation Research Record, 2459, 110-118.
Zhan, X., Hasan, S., Ukkusuri, S. V., Kamga, C., 2013. Urban Link Travel Time Estimation Using Large-scale Taxi Data with Partial Information. Transportation Research Part C: Emerging Technologies, 33, 37-49.
Qian, X, Zhan, X., Ukkusuri, S. V. Characterizing Urban Dynamics Using Large Scale Taxicab Data. Engineering and Applied Sciences Optimization: Vol. 38, 17-32, Springer International Publishing, 2015.
Ukkusuri, S. V., Hasan, S., and Zhan, X.. Checking the Urban Pulse: Social Media Data Analytics for Transportation Applications. Best Practices for Transportation Agency Use of Social Media Data. Taylor and Francis/CRC Press, 2013.
Talk at Institute of Automation, Chinese Academy of Sciences, Beijing China
Talk at UMNI Lab, Purdue University, online
Talk at iDLab, Tsinghua University, Beijing China
Talk at DataFun Summit 2022, Beijing China
Talk at Didi Tech Salon, Beijing China
Talk at Haomo AI Day, Beijing China
Talk at Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI2022), Online
Talk at TalkRL: The Reinforcement Learning Podcast, online
Talk at DeeCamp 2021, online
Talk at University of Central Florida, online
Talk at IEEE Services - Industry Symposium, Online
Talk at Tsinghua University, Beijing, China
Talk at Tsinghua University, Beijing, China
Talk at Smart Cities and Urban Computing Forum, China National Computer Congress (CNCC 2018), Hangzhou, China
Talk at 3rd Workshop on Applications of the Mathematical Modeling in Enterprises, University of Chinese Academy of Sciences, Beijing, China
Talk at Tsinghua University, Beijing, China
Talk at INFORMS 2016, Nashville, US
Talk at INFORMS 2016, Nashville, US
Talk at Resilience Week 2016, Chicago, Illinois
Talk at 4th International Symposium on Water, Feedbacks, and Complexity, Purdue University, West Lafayette, Indiana
Talk at INFORMS 2015, Philadelphia, US
Talk at INFORMS 2015, Philadelphia, US
Talk at KDD 2014 International Workshop on Urban Computing, New York, US
Talk at MPE 2013+ Workshop on Sustainable Human Environments, Rutgers University, New Brunswick, New Jersey
Talk at INFORMS 2013, Minneapolis, Minnesota
Talk at INFORMS 2013, Minneapolis, Minnesota
Research projects at Institute of AI Industry Research (AIR), Tsinghua University, Beijing, China
Research projects at Institute of AI Industry Research (AIR), Tsinghua University, Beijing, China
Research projects at Institute of AI Industry Research (AIR), Tsinghua University, Beijing, China
Research projects at JD Intelligent Cities Research, Beijing, China
Research projects at JD Intelligent Cities Research, Beijing, China
Research projects at Microsoft Research Asia, Beijing, China
Research projects at Microsoft Research Asia, Beijing, China
Research projects at Purdue University, West Lafayette, Indinana, US
Research projects at Purdue University, West Lafayette, Indinana, US
Research projects at Purdue University, West Lafayette, Indinana, US
Research projects at Purdue University, West Lafayette, Indinana, US