Publications & preprints

Scalable multi-agent learning for autonomous systems.

I develop learning, planning, and control methods for autonomous systems operating under resource, information, communication, and sensing constraints.

Research threads

Scaling autonomy where coordination is constrained.

  1. Scalable Multi-Agent Learning

    Communication and coordination methods that remain effective as agent populations grow.

    SCoUT · scalable communication and coordination

    CurrentScalable sparse multi-agent diffusion

  2. Resource-Aware Decision-Making

    Planning and learning under limited budgets, capacity, and partial observability.

    IEEE Control Systems Letters · TMLR · IEEE RA-L

  3. Information-Efficient Robotics

    Robot control and planning that activate only the information and sensing needed for the task.

    ComTraQ-MPC · B-COD / just-enough sensing

    CurrentHeterogeneous-sensor multi-robot search and rescue

  4. Strategic Coordination & Prediction

    Planning and prediction when agents must resolve conflicts and act through uncertain occlusions.

    Predicted Reachability · strategic planning and control

    CurrentNash-bargaining foundation models for conflict resolution · game-theoretic long-tail trajectory prediction

Showing all publications.

2026

  1. TMLR
    2026

    Solving Truly Massive Budgeted Monotonic POMDPs with Oracle-Guided Meta-Reinforcement Learning

    Manav Vora , Jonas Liang , Michael N Grussing and Melkior Ornik

    Transactions on Machine Learning Research
    • multi agent
    • RL
    • planning
    • pomdps
    • Resource-aware

    Paper arXiv OpenReview Code

    BibTeX
    @article{vora2024solving,
      title = {Solving Truly Massive Budgeted Monotonic POMDPs with Oracle-Guided Meta-Reinforcement Learning},
      author = {Vora, Manav and Liang, Jonas and Grussing, Michael N and Ornik, Melkior},
      journal = {Transactions on Machine Learning Research},
      year = {2026},
    }
    
  2. RLC
    2026

    SCoUT: Scalable Communication via Utility-Guided Temporal Grouping in Multi-Agent Reinforcement Learning

    Manav Vora , Gokul Puthumanaillam , Hiroyasu Tsukamoto and Melkior Ornik

    Reinforcement Learning Journal Oral presentation
    • multi agent
    • RL

    Paper arXiv Project Code

    BibTeX
    @article{vora2026scout,
      title = {SCoUT: Scalable Communication via Utility-Guided Temporal Grouping in Multi-Agent Reinforcement Learning},
      author = {Vora, Manav and Puthumanaillam, Gokul and Tsukamoto, Hiroyasu and Ornik, Melkior},
      journal = {Reinforcement Learning Journal},
      year = {2026},
      volume = {7},
    }
    
  3. IEEE CCTA
    2026

    Virtual Force-Based Routing of Modular Agents on a Graph

    Adam Casselman , Manav Vora and Melkior Ornik

    10th IEEE Conference on Control Technology and Applications
    • multi agent
    • planning
    • Resource-aware

    arXiv

    BibTeX
    @inproceedings{casselman2026virtual,
      title = {Virtual Force-Based Routing of Modular Agents on a Graph},
      author = {Casselman, Adam and Vora, Manav and Ornik, Melkior},
      booktitle = {10th IEEE Conference on Control Technology and Applications},
      year = {2026},
    }
    

2025

  1. IEEE RA-L
    2025

    Capacity-Aware Planning and Scheduling in Budget-Constrained Multi-Agent MDPs: A Meta-RL Approach

    Manav Vora , Ilan Shomorony and Melkior Ornik

    IEEE Robotics and Automation Letters
    • multi agent
    • RL
    • planning
    • Resource-aware

    Paper arXiv Code DOI

    BibTeX
    @article{vora2024capacity,
      title = {Capacity-Aware Planning and Scheduling in Budget-Constrained Multi-Agent MDPs: A Meta-RL Approach},
      author = {Vora, Manav and Shomorony, Ilan and Ornik, Melkior},
      journal = {IEEE Robotics and Automation Letters},
      year = {2025},
      volume = {10},
      number = {11},
      pages = {11944--11951},
      doi = {10.1109/LRA.2025.3617726},
    }
    
  2. CoRL
    2025

    Belief-Conditioned One-Step Diffusion: Real-Time Trajectory Planning with Just-Enough Sensing

    Gokul Puthumanaillam , Aditya Penumarti , Manav Vora , Paulo Padrao , Jose Fuentes , Leonardo Bobadilla , Jane Shin and Melkior Ornik

    Conference on Robot Learning Oral presentation · top 5%
    • robotics
    • Generative Models
    • planning
    • Information & Sensing

    Paper arXiv Project Code

    BibTeX
    @inproceedings{puthumanaillam2025bcod,
      title = {Belief-Conditioned One-Step Diffusion: Real-Time Trajectory Planning with Just-Enough Sensing},
      author = {Puthumanaillam, Gokul and Penumarti, Aditya and Vora, Manav and Padrao, Paulo and Fuentes, Jose and Bobadilla, Leonardo and Shin, Jane and Ornik, Melkior},
      booktitle = {Conference on Robot Learning},
      year = {2025},
      volume = {305},
      pages = {68--92},
    }
    
  3. IROS
    2025

    Motion Planning and Control with Unknown Nonlinear Dynamics through Predicted Reachability

    Zhiquan Zhang , Gokul Puthumanaillam , Manav Vora and Melkior Ornik

    2025 IEEE/RSJ International Conference on Intelligent Robots and Systems
    • robotics
    • planning
    • Control & Safety

    Paper arXiv DOI

    BibTeX
    @inproceedings{zhang2025predicted,
      title = {Motion Planning and Control with Unknown Nonlinear Dynamics through Predicted Reachability},
      author = {Zhang, Zhiquan and Puthumanaillam, Gokul and Vora, Manav and Ornik, Melkior},
      booktitle = {2025 IEEE/RSJ International Conference on Intelligent Robots and Systems},
      year = {2025},
      pages = {342--349},
      doi = {10.1109/IROS60139.2025.11245807},
    }
    
  4. IEEE CARS
    2025

    Optimizing a Model-Agnostic Measure of Graph Counterdeceptiveness via Reattachment

    Anakin Dey , Sam Ruggerio , Manav Vora and Melkior Ornik

    2025 IEEE 5th Cyber Awareness and Research Symposium
    • planning
    • Control & Safety

    Paper arXiv Code DOI

    BibTeX
    @inproceedings{dey2025counterdeceptiveness,
      title = {Optimizing a Model-Agnostic Measure of Graph Counterdeceptiveness via Reattachment},
      author = {Dey, Anakin and Ruggerio, Sam and Vora, Manav and Ornik, Melkior},
      booktitle = {2025 IEEE 5th Cyber Awareness and Research Symposium},
      year = {2025},
      pages = {1--7},
      doi = {10.1109/CARS67163.2025.11337469},
    }
    

2024

  1. arXiv
    2024

    A Moral Imperative: The Need for Continual Superalignment of Large Language Models

    Gokul Puthumanaillam* , Manav Vora* , Pranay Thangeda and Melkior Ornik

    arXiv preprint arXiv:2403.14683
    • Generative Models

    Paper arXiv

    BibTeX
    @article{puthumanaillam2024moral,
      title = {A Moral Imperative: The Need for Continual Superalignment of Large Language Models},
      author = {Puthumanaillam, Gokul and Vora, Manav and Thangeda, Pranay and Ornik, Melkior},
      journal = {arXiv preprint arXiv:2403.14683},
      year = {2024},
    }
    
  2. IROS
    2024

    ComTraQ-MPC: Meta-Trained DQN-MPC Integration for Trajectory Tracking with Limited Active Localization Updates

    Gokul Puthumanaillam* , Manav Vora* and Melkior Ornik

    2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Oral presentation · top 10%
    • robotics
    • RL
    • planning
    • Information & Sensing
    • Control & Safety

    Paper arXiv Code Video DOI

    BibTeX
    @inproceedings{10801659,
      author = {Puthumanaillam, Gokul and Vora, Manav and Ornik, Melkior},
      booktitle = {2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
      title = {ComTraQ-MPC: Meta-Trained DQN-MPC Integration for Trajectory Tracking with Limited Active Localization Updates},
      year = {2024},
      volume = {},
      number = {},
      pages = {13592-13598},
      keywords = {Location awareness;Accuracy;Trajectory tracking;Trajectory planning;Decision making;Stochastic processes;Trajectory;State estimation;Intelligent robots;Predictive control},
      doi = {10.1109/IROS58592.2024.10801659},
    }
    
  3. AIAA SciTech
    2024

    Assured Collision Avoidance for Learned Controllers: A Case Study of ACAS Xu

    Gokul Puthumanaillam* , Manav Ketan Vora* , Taha Shafa , Yangge Li , Melkior Ornik and Sayan Mitra

    AIAA SCITECH 2024 Forum
    • robotics
    • Control & Safety

    Paper Code DOI

    BibTeX
    @inproceedings{puthumanaillam2024assured,
      title = {Assured Collision Avoidance for Learned Controllers: A Case Study of ACAS Xu},
      author = {Puthumanaillam, Gokul and Vora, Manav Ketan and Shafa, Taha and Li, Yangge and Ornik, Melkior and Mitra, Sayan},
      booktitle = {AIAA SCITECH 2024 Forum},
      pages = {1168},
      year = {2024},
      doi = {10.2514/6.2024-1168},
    }
    

2023

  1. IEEE Control Systems Letters
    2023

    Welfare Maximization Algorithm for Solving Budget-Constrained Multi-Component POMDPs

    Manav Vora , Pranay Thangeda , Michael N Grussing and Melkior Ornik

    IEEE Control Systems Letters Presented at CDC 2023
    • multi agent
    • planning
    • pomdps
    • Resource-aware

    Paper arXiv DOI

    BibTeX
    @article{vora2023welfare,
      title = {Welfare Maximization Algorithm for Solving Budget-Constrained Multi-Component POMDPs},
      author = {Vora, Manav and Thangeda, Pranay and Grussing, Michael N and Ornik, Melkior},
      journal = {IEEE Control Systems Letters},
      volume = {7},
      pages = {1736--1741},
      year = {2023},
      publisher = {IEEE},
      doi = {10.1109/LCSYS.2023.3280080},
    }