About
I am Jue Zhang (张珏), a Principal Researcher at Microsoft, where I lead research on reliable and self-improving AI agents, AI efficiency, and privacy-preserving AI.
My recent research focuses on enabling AI agents to diagnose failures, learn from experience, and continuously improve their own capabilities. From failures to flywheels, I explore how reliable and efficient agentic systems can evolve beyond static, human-designed workflows.
My research has contributed to Microsoft products including Microsoft 365, Bing, and Azure, resulting in hundreds of millions of dollars in cost savings. I have authored nearly 50 peer-reviewed publications across leading AI/ML conferences and physics journals.
Beyond my individual research, I lead collaborative research initiatives and have mentored 10+ research interns.
Featured Research
Reliable and Self-Improving AI Agents
Developing agents that diagnose failures, learn from execution experience, and systematically improve their behavior and harnesses.
- DoVer (ICLR, 2026)
- AutoSaddler (NeurIPS, 2026)
- ActiveSaddler (arXiv, 2026)
AI Efficiency
Improving AI efficiency through prompt compression, inference optimization, and more effective agent workflows.
- LLMLingua-2 (Findings of ACL, 2024)
- TACO-RL (Findings of ACL, 2025)
- AutoRAG-HP (Findings of EMNLP, 2024)
Privacy-Preserving AI
Understanding, evaluating, and mitigating privacy risks in AI-powered systems, particularly enterprise agents handling sensitive information.
- CI-Work (ACL Industry Track, 2026)
- Privacy in Action (Findings of EMNLP, 2025)
- Meeting Delegate (HCI+NLP Workshop, 2025)
Mechanistic Understanding and Agent Debugging
Investigating why AI systems succeed or fail through intervention-based debugging, contrastive attribution, and model-level interpretability.
- DoVer (ICLR, 2026)
- Contrastive Attribution in the Wild (EMNLP, 2026)
- From Reasoning to Answer (EMNLP, 2025)
Selected Publications
See Google Scholar for my full publication list.
Reliable and self-improving agents
- ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimization
arXiv:2610.00906 · arXiv · GitHub - AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces
NeurIPS, 2026 · arXiv · GitHub · Publisher - Contrastive Attribution in the Wild: An Interpretability Analysis of LLM Failures on Realistic Benchmarks
EMNLP, 2026 · arXiv · GitHub · Publisher - A Tale of Two Graphs: Separating Knowledge Exploration from Outline Structure for Open-Ended Deep Research
ICML, 2026 · arXiv · Publisher - DoVer: Intervention-Driven Auto Debugging for LLM Multi-Agent Systems
ICLR, 2026 · arXiv · GitHub · Publisher - From Reasoning to Answer: Empirical, Attention-Based and Mechanistic Insights into Distilled DeepSeek R1 Models
EMNLP, 2025 · arXiv · GitHub · Publisher
AI efficiency
- AXIS: Efficient Human-Agent-Computer Interaction with API-First LLM-Based Agents
ACL, 2025 · arXiv · Publisher - TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learning
Findings of ACL, 2025 · arXiv · Publisher - Performance Aware LLM Load Balancer for Mixed Workloads
ACM EuroMLSys Workshop, 2025 · Publisher - AutoRAG-HP: Automatic Online Hyper-Parameter Tuning for Retrieval-Augmented Generation
Findings of EMNLP, 2024 · arXiv · Publisher - LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression
Findings of ACL, 2024 · arXiv · GitHub · Publisher
Privacy-preserving AI and Personalization
- CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agents
ACL Industry Track, 2026 · arXiv · Publisher - EgoMemory: Memory-Augmented Personalized Retrieval for Long-Context Egocentric Video
Findings of ACL, 2026 · Publisher - Privacy in Action: Towards Realistic Privacy Mitigation and Evaluation for LLM-Powered Agents
Findings of EMNLP, 2025 · arXiv · GitHub · Publisher - MEETING DELEGATE: Benchmarking LLMs on Attending Meetings on Our Behalf
HCI+NLP Workshop, 2025 · arXiv · Publisher - Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval
CVPR, 2025 · arXiv · GitHub · Publisher - Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Tasks
ACM IUI, 2025 · arXiv · Publisher - Sharingan: Extract User Action Sequence from Desktop Recordings
arXiv:2411.08768 · arXiv
Cloud Management and Resource Optimization
- RCInvestigator: Towards Better Investigation of Anomaly Root Causes in Cloud Computing Systems
IEEE Transactions on Visualization and Computer Graphics (PacificVIS Journal Track), 2026 · arXiv · Publisher - Enabling Autonomic Microservice Management through Self-Learning Agents
arXiv:2501.19056 · arXiv - Towards Workload-aware Cloud Efficiency: A Large-scale Empirical Study of Cloud Workload Characteristics
ACM/SPEC ICPE, 2025 · arXiv · Publisher - Workload Intelligence: Workload-Aware IaaS Abstraction for Cloud Efficiency
ACM/IEEE SC, 2025 · arXiv · Publisher - The Vision of Autonomic Computing: Can LLMs Make It a Reality?
arXiv:2407.14402 · arXiv · GitHub - Snape: Reliable and Low-Cost Computing with Mixture of Spot and On-Demand VMs
ACM ASPLOS, 2023 · Publisher - How Different are the Cloud Workloads? Characterizing Large-Scale Private and Public Cloud Workloads
IEEE/IFIP DSN, 2023 · Publisher - Contextual Self-attentive Temporal Point Process for Physical Decommissioning Prediction of Cloud Assets
ACM KDD, 2023 · Publisher - Spot Virtual Machine Eviction Prediction in Microsoft Cloud
ACM WWW Companion, 2022 · Publisher
AI for Physics
- Does Lorentz-symmetric design boost network performance in jet physics?
Physical Review D, 2024 · arXiv · Publisher - An efficient Lorentz equivariant graph neural network for jet tagging
Journal of High Energy Physics, 2022 · arXiv · GitHub · Publisher
Neutrino Physics
- Gravitational clustering of cosmic relic neutrinos in the Milky Way
Nature Communications, 2018 · arXiv · Publisher · Media: Guangming Daily (Chinese) - Viability of exact tri-bimaximal, golden-ratio and bimaximal mixing patterns and renormalization-group running effects
Journal of High Energy Physics, 2016 · arXiv · Publisher - Distinguishing Dirac/Majorana Sterile Neutrinos at the LHC
Physical Review D, 2016 · arXiv · Publisher - Improved Statistical Determination of Absolute Neutrino Masses via Radiative Emission of Neutrino Pairs from Atoms
Physical Review D, 2016 · arXiv · Publisher - Relic Right-handed Dirac Neutrinos and Implications for Detection of Cosmic Neutrino Background
Nuclear Physics B, 2016 · arXiv · Publisher - Confronting Four Zero Neutrino Yukawa Textures with N₂-dominated Leptogenesis
Physical Review D, 2015 · arXiv · Publisher - θ₁₃ and The Flavor Ring
Physical Review D, 2014 · arXiv · Publisher
Honors and awards
- Machine Learning, AI and Data Science (MLADS) Distinguished Contribution Award, Microsoft (2023, 2024, 2026).
- Best Poster Award, 28th International Symposium on Lepton Photon Interactions at High Energies (2017).
- China Postdoctoral Fellowship (First Grade), Peking University (2017).
- CLAS Dissertation Fellowship, University of Florida (2014).
Professional service
- Review Process Co-Chair, ICSE 2027.
- Silver Reviewer Award, ICML (2026).
- Area Chair, ACL Rolling Review.
- Reviewer, NeurIPS, ICML, ICLR, AAAI, and ACL Rolling Review.
- Journal Reviewer, Physical Review D and Journal of High Energy Physics.
Bio
Before joining Microsoft, I worked at JD.com on applied research and product development in wearable-based health monitoring and personalized recommendation systems. I contributed to ABC Health, a WeChat mini program that helped people monitor their health during the COVID-19 pandemic. According to 36Kr (in Chinese), the program reached an estimated 10 million users during its pandemic-era surge.
Before transitioning to AI/ML, I was a physicist with a Ph.D. in High Energy Physics from the University of Florida and a B.S. in Theoretical Physics from the University of Science and Technology of China.
