About

I am Jue Zhang (张珏), a Principal Researcher at Microsoft, where I lead research on reliable and self-improving AI agents, AI efficiency, and privacy-preserving AI.

My recent research focuses on enabling AI agents to diagnose failures, learn from experience, and continuously improve their own capabilities. From failures to flywheels, I explore how reliable and efficient agentic systems can evolve beyond static, human-designed workflows.

My research has contributed to Microsoft products including Microsoft 365, Bing, and Azure, resulting in hundreds of millions of dollars in cost savings. I have authored nearly 50 peer-reviewed publications across leading AI/ML conferences and physics journals.

Beyond my individual research, I lead collaborative research initiatives and have mentored 10+ research interns.

Featured Research

Reliable and Self-Improving AI Agents

Developing agents that diagnose failures, learn from execution experience, and systematically improve their behavior and harnesses.

AI Efficiency

Improving AI efficiency through prompt compression, inference optimization, and more effective agent workflows.

Privacy-Preserving AI

Understanding, evaluating, and mitigating privacy risks in AI-powered systems, particularly enterprise agents handling sensitive information.

Mechanistic Understanding and Agent Debugging

Investigating why AI systems succeed or fail through intervention-based debugging, contrastive attribution, and model-level interpretability.

Selected Publications

See Google Scholar for my full publication list.

Reliable and self-improving agents

  1. ActiveSaddler: Automated Curriculum Learning for Agent Harness Optimization

    arXiv:2610.00906 · arXiv · GitHub
  2. AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces

    NeurIPS, 2026 · arXiv · GitHub · Publisher
  3. Contrastive Attribution in the Wild: An Interpretability Analysis of LLM Failures on Realistic Benchmarks

    EMNLP, 2026 · arXiv · GitHub · Publisher
  4. A Tale of Two Graphs: Separating Knowledge Exploration from Outline Structure for Open-Ended Deep Research

    ICML, 2026 · arXiv · Publisher
  5. DoVer: Intervention-Driven Auto Debugging for LLM Multi-Agent Systems

    ICLR, 2026 · arXiv · GitHub · Publisher
  6. From Reasoning to Answer: Empirical, Attention-Based and Mechanistic Insights into Distilled DeepSeek R1 Models

    EMNLP, 2025 · arXiv · GitHub · Publisher

AI efficiency

  1. AXIS: Efficient Human-Agent-Computer Interaction with API-First LLM-Based Agents

    ACL, 2025 · arXiv · Publisher
  2. TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learning

    Findings of ACL, 2025 · arXiv · Publisher
  3. Performance Aware LLM Load Balancer for Mixed Workloads

    ACM EuroMLSys Workshop, 2025 · Publisher
  4. AutoRAG-HP: Automatic Online Hyper-Parameter Tuning for Retrieval-Augmented Generation

    Findings of EMNLP, 2024 · arXiv · Publisher
  5. LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

    Findings of ACL, 2024 · arXiv · GitHub · Publisher

Privacy-preserving AI and Personalization

  1. CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agents

    ACL Industry Track, 2026 · arXiv · Publisher
  2. EgoMemory: Memory-Augmented Personalized Retrieval for Long-Context Egocentric Video

    Findings of ACL, 2026 · Publisher
  3. Privacy in Action: Towards Realistic Privacy Mitigation and Evaluation for LLM-Powered Agents

    Findings of EMNLP, 2025 · arXiv · GitHub · Publisher
  4. MEETING DELEGATE: Benchmarking LLMs on Attending Meetings on Our Behalf

    HCI+NLP Workshop, 2025 · arXiv · Publisher
  5. Reason-before-Retrieve: One-Stage Reflective Chain-of-Thoughts for Training-Free Zero-Shot Composed Image Retrieval

    CVPR, 2025 · arXiv · GitHub · Publisher
  6. Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Tasks

    ACM IUI, 2025 · arXiv · Publisher
  7. Sharingan: Extract User Action Sequence from Desktop Recordings

    arXiv:2411.08768 · arXiv

Cloud Management and Resource Optimization

  1. RCInvestigator: Towards Better Investigation of Anomaly Root Causes in Cloud Computing Systems

    IEEE Transactions on Visualization and Computer Graphics (PacificVIS Journal Track), 2026 · arXiv · Publisher
  2. Enabling Autonomic Microservice Management through Self-Learning Agents

    arXiv:2501.19056 · arXiv
  3. Towards Workload-aware Cloud Efficiency: A Large-scale Empirical Study of Cloud Workload Characteristics

    ACM/SPEC ICPE, 2025 · arXiv · Publisher
  4. Workload Intelligence: Workload-Aware IaaS Abstraction for Cloud Efficiency

    ACM/IEEE SC, 2025 · arXiv · Publisher
  5. The Vision of Autonomic Computing: Can LLMs Make It a Reality?

    arXiv:2407.14402 · arXiv · GitHub
  6. Snape: Reliable and Low-Cost Computing with Mixture of Spot and On-Demand VMs

    ACM ASPLOS, 2023 · Publisher
  7. How Different are the Cloud Workloads? Characterizing Large-Scale Private and Public Cloud Workloads

    IEEE/IFIP DSN, 2023 · Publisher
  8. Contextual Self-attentive Temporal Point Process for Physical Decommissioning Prediction of Cloud Assets

    ACM KDD, 2023 · Publisher
  9. Spot Virtual Machine Eviction Prediction in Microsoft Cloud

    ACM WWW Companion, 2022 · Publisher

AI for Physics

  1. Does Lorentz-symmetric design boost network performance in jet physics?

    Physical Review D, 2024 · arXiv · Publisher
  2. An efficient Lorentz equivariant graph neural network for jet tagging

    Journal of High Energy Physics, 2022 · arXiv · GitHub · Publisher

Neutrino Physics

  1. Gravitational clustering of cosmic relic neutrinos in the Milky Way

    Nature Communications, 2018 · arXiv · Publisher · Media: Guangming Daily (Chinese)
  2. Viability of exact tri-bimaximal, golden-ratio and bimaximal mixing patterns and renormalization-group running effects

    Journal of High Energy Physics, 2016 · arXiv · Publisher
  3. Distinguishing Dirac/Majorana Sterile Neutrinos at the LHC

    Physical Review D, 2016 · arXiv · Publisher
  4. Improved Statistical Determination of Absolute Neutrino Masses via Radiative Emission of Neutrino Pairs from Atoms

    Physical Review D, 2016 · arXiv · Publisher
  5. Relic Right-handed Dirac Neutrinos and Implications for Detection of Cosmic Neutrino Background

    Nuclear Physics B, 2016 · arXiv · Publisher
  6. Confronting Four Zero Neutrino Yukawa Textures with N₂-dominated Leptogenesis

    Physical Review D, 2015 · arXiv · Publisher
  7. θ₁₃ and The Flavor Ring

    Physical Review D, 2014 · arXiv · Publisher

Honors and awards

  • Machine Learning, AI and Data Science (MLADS) Distinguished Contribution Award, Microsoft (2023, 2024, 2026).
  • Best Poster Award, 28th International Symposium on Lepton Photon Interactions at High Energies (2017).
  • China Postdoctoral Fellowship (First Grade), Peking University (2017).
  • CLAS Dissertation Fellowship, University of Florida (2014).

Professional service

  • Review Process Co-Chair, ICSE 2027.
  • Silver Reviewer Award, ICML (2026).
  • Area Chair, ACL Rolling Review.
  • Reviewer, NeurIPS, ICML, ICLR, AAAI, and ACL Rolling Review.
  • Journal Reviewer, Physical Review D and Journal of High Energy Physics.

Bio

Before joining Microsoft, I worked at JD.com on applied research and product development in wearable-based health monitoring and personalized recommendation systems. I contributed to ABC Health, a WeChat mini program that helped people monitor their health during the COVID-19 pandemic. According to 36Kr (in Chinese), the program reached an estimated 10 million users during its pandemic-era surge.

Before transitioning to AI/ML, I was a physicist with a Ph.D. in High Energy Physics from the University of Florida and a B.S. in Theoretical Physics from the University of Science and Technology of China.