Shepherding Hordes of Markov Chains
| dc.contributor.author | Češka, Milan | cs |
| dc.coverage.volume | 11428 | cs |
| dc.date.issued | 2019-04-17 | cs |
| dc.description.abstract | This paper considers large families of Markov chains (MCs) that are defined over a set of parameters with finite discrete domains. Such families occur in software product lines, planning under partial observability, and sketching of probabilistic programs. Simple questions, like does at least one family member satisfy a property?, are NP-hard. We tackle two problems: distinguish family members that satisfy a given quantitative property from those that do not, and determine a family member that satisfies the property optimally, i.e., with the highest probability or reward. We show that combining two well-known techniques, MDP model checking and abstraction refinement, mitigates the computational complexity. Experiments on a broad set of benchmarks show that in many situations, our approach is able to handle families of millions of MCs, providing superior scalability compared to existing solutions. | en |
| dc.description.abstract | Tento článek uvažuje problém syntézy topologie v Markovovských řetězcích a navrhuje řešení pomocí abstrakce založené na Markovovských rozhodovacích procesech a iterativní zjemněvání této abstrakce. | cs |
| dc.format | text | cs |
| dc.format.extent | 172-190 | cs |
| dc.format.mimetype | application/pdf | cs |
| dc.identifier.citation | Proceedings of 25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems. 2019, vol. 11428, p. 172-190. | en |
| dc.identifier.doi | 10.1007/978-3-030-17465-1_10 | cs |
| dc.identifier.isbn | 978-3-030-17464-4 | cs |
| dc.identifier.orcid | 0000-0002-0300-9727 | cs |
| dc.identifier.other | 156852 | cs |
| dc.identifier.scopus | 7006749648 | cs |
| dc.identifier.uri | http://hdl.handle.net/11012/195257 | |
| dc.language.iso | en | cs |
| dc.publisher | Springer International Publishing | cs |
| dc.relation.ispartof | Proceedings of 25th International Conference on Tools and Algorithms for the Construction and Analysis of Systems | cs |
| dc.relation.uri | https://link.springer.com/chapter/10.1007/978-3-030-17465-1_10 | cs |
| dc.rights | Creative Commons Attribution 4.0 International | cs |
| dc.rights.access | openAccess | cs |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | cs |
| dc.subject | parametric Markov chains | en |
| dc.subject | synthesis from specification | en |
| dc.subject | Markov Decision Processes | en |
| dc.subject | abstraction refinement | en |
| dc.title | Shepherding Hordes of Markov Chains | en |
| dc.title.alternative | Syntéza topologie v Markovovských řetězcích | cs |
| dc.type.driver | conferenceObject | en |
| dc.type.status | Peer-reviewed | en |
| dc.type.version | publishedVersion | en |
| sync.item.dbid | VAV-156852 | en |
| sync.item.dbtype | VAV | en |
| sync.item.insts | 2024.03.25 03:46:04 | en |
| sync.item.modts | 2024.03.25 03:14:21 | en |
| thesis.grantor | Vysoké učení technické v Brně. Fakulta informačních technologií. Ústav inteligentních systémů | cs |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- ShepherdingHordes.pdf
- Size:
- 396.88 KB
- Format:
- Adobe Portable Document Format
- Description:
- ShepherdingHordes.pdf