🌐 Entity

Markov decision process

Mathematical model for sequential decision making under uncertainty

📊 Rating

3 news mentions · 👍 0 likes · 👎 0 dislikes

📌 Topics

Artificial Intelligence (3)
Computational Theory (1)
Formal Methods (1)
Machine Learning (1)
Robotics (1)
Reinforcement Learning (1)
Formal Logic (1)

🏷️ Keywords

Markov Decision Processes (3) · arXiv (3) · POMDP (2) · Reachability Value (1) · Computational Complexity (1) · Robotics (1) · Algorithm Design (1) · Deep Reinforcement Learning (1) · Lexpop Framework (1) · Finite-State Controllers (1) · Neural Networks (1) · LTLfMT (1) · non-Markovian rewards (1) · temporal logic (1) · machine learning (1) · first-order logic (1)

📖 Key Information

A Markov decision process (MDP) is a mathematical model for sequential decision making when outcomes are uncertain. It is a type of stochastic decision process, and is often solved using the methods of stochastic dynamic programming. Originating from operations research in the 1950s, MDPs have since gained recognition in a variety of fields, including ecology, economics, healthcare, telecommunications and reinforcement learning.

📰 Related News (3)

🇺🇸 Computing the Reachability Value of Posterior-Deterministic POMDPs (2026-02-10)
arXiv:2602.07473v1 Announce Type: new Abstract: Partially observable Markov decision processes (POMDPs) are a fundamental model for sequential decisi...
🇺🇸 Finite-State Controllers for (Hidden-Model) POMDPs using Deep Reinforcement Learning (2026-02-10)
arXiv:2602.08734v1 Announce Type: new Abstract: Solving partially observable Markov decision processes (POMDPs) requires computing policies under imp...
🇺🇸 Do It for HER: First-Order Temporal Logic Reward Specification in Reinforcement Learning (Extended Version) (2026-02-09)
arXiv:2602.06227v1 Announce Type: new Abstract: In this work, we propose a novel framework for the logical specification of non-Markovian rewards in ...

🔗 Entity Intersection Graph

People and organizations frequently mentioned alongside Markov decision process:

🌐 Partially observable Markov decision process (2 shared articles)
👤 Do It (1 shared articles)
🌐 Reinforcement learning (1 shared articles)
🌐 Neural network (1 shared articles)
🌐 Computational complexity (1 shared articles)
🌐 Robotics (1 shared articles)

Точка Синхронізації