Dynamically changing sequencing rules with reinforcement learning in a job shop system with stochastic influences

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Sequencing operations can be difficult, especially under uncertain conditions. Applying decentral sequencing rules has been a viable option; however, no rule exists that can outperform all other rules under varying system performance. For this reason, reinforcement learning (RL) is used as a hyper heuristic to select a sequencing rule based on the system status. Based on multiple training scenarios considering stochastic influences, such as varying inter arrival time or customers changing the product mix, the advantages of RL are presented. For evaluation, the trained agents are exploited in a generic manufacturing system. The best agent trained is able to dynamically adjust sequencing rules based on system performance, thereby matching and outperforming the presumed best static sequencing rules by ~ 3%. Using the trained policy in an unknown scenario, the RL heuristic is still able to change the sequencing rule according to the system status, thereby providing a robust performance.
Translated title of the contributionDynamische Auswahl von Reihenfolgeregeln mit bestärkendem Lernen in einer Werkstattfertigung mit stochastischen Einflüssen
Original languageEnglish
Title of host publicationProceedings of the 2020 Winter Simulation Conference, WSC 2020
EditorsK.-H. Bae, B. Feng, S. Kim, S. Lazarova-Molnar, Z. Zheng, T. Roeder, R. Thiesing
Number of pages11
PublisherIEEE - Institute of Electrical and Electronics Engineers Inc.
Publication date14.12.2020
Pages1608 - 1618
Article number9383903
ISBN (electronic)978-1-7281-9499-8
DOIs
Publication statusPublished - 14.12.2020
EventWinter Simulation Conference - WSC 2020: Simulation Drives Innovation - Orlando, United States
Duration: 14.12.202018.12.2020
http://meetings2.informs.org/wordpress/wsc2020/

Recently viewed

Projects

  1. XR2ESILIENCE

Publications

  1. Patching Together a Global Script
  2. Gaussian processes for dispatching rule selection in production scheduling
  3. Trait correlation network analysis identifies biomass allocation traits and stem specific length as hub traits in herbaceous perennial plants
  4. Design of controllers applied to autonomous unmanned aerial vehicles using software in the loop
  5. Segment Introduction
  6. On the Appropriate Methodologies for Data Science Projects
  7. Adjustable automation and manoeuvre control in automated driving
  8. Control system strategy of a modular omnidirectional AGV
  9. Automatic three-dimensional geometry and mesh generation of periodic representative volume elements for matrix-inclusion composites
  10. Artificial intelligence in songwriting and composing - perspectives and challenges in creative practices
  11. Are Acute Effects of Foam-Rolling Attributed to Dynamic Warm Up Effects? A Comparative Study
  12. How secondary-school students deal with issues of sustainable development in class*
  13. Modeling High Aswan Dam Reservoir Morphology Using Remote Sensing to Reduce Evaporation
  14. Achieving enhanced mechanical properties in Mg-Gd-Y-Zn-Mn alloy by altering dynamic recrystallization behavior via pre-ageing treatment
  15. Variational Pragmatics
  16. Ideas, Complexity, and Innovation
  17. Modernizing persistence–bioaccumulation–toxicity (PBT) assessment with high throughput animal-free methods
  18. Lost-customers approximation of semi-open queueing networks with backordering
  19. A Unified Contextual Bandit Framework for Long- and Short-Term Recommendations
  20. Experimental and numerical analysis of refill friction stir spot welding of thin AA7075-T6 sheets
  21. Ludic Interfaces
  22. How Big Does Big Data Need to Be?
  23. The analytical competency model to investigate the video-stimulated analysis of inclusive sciene education
  24. Giving is a question of time: response times and contributions to an environmental public good
  25. Green Big Data: A Green IT/Green IS Perspective on Big Data
  26. Reconsidering adaptation as translation