Dynamically changing sequencing rules with reinforcement learning in a job shop system with stochastic influences

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Sequencing operations can be difficult, especially under uncertain conditions. Applying decentral sequencing rules has been a viable option; however, no rule exists that can outperform all other rules under varying system performance. For this reason, reinforcement learning (RL) is used as a hyper heuristic to select a sequencing rule based on the system status. Based on multiple training scenarios considering stochastic influences, such as varying inter arrival time or customers changing the product mix, the advantages of RL are presented. For evaluation, the trained agents are exploited in a generic manufacturing system. The best agent trained is able to dynamically adjust sequencing rules based on system performance, thereby matching and outperforming the presumed best static sequencing rules by ~ 3%. Using the trained policy in an unknown scenario, the RL heuristic is still able to change the sequencing rule according to the system status, thereby providing a robust performance.
Translated title of the contributionDynamische Auswahl von Reihenfolgeregeln mit bestärkendem Lernen in einer Werkstattfertigung mit stochastischen Einflüssen
Original languageEnglish
Title of host publicationProceedings of the 2020 Winter Simulation Conference, WSC 2020
EditorsK.-H. Bae, B. Feng, S. Kim, S. Lazarova-Molnar, Z. Zheng, T. Roeder, R. Thiesing
Number of pages11
PublisherIEEE - Institute of Electrical and Electronics Engineers Inc.
Publication date14.12.2020
Pages1608 - 1618
Article number9383903
ISBN (electronic)978-1-7281-9499-8
DOIs
Publication statusPublished - 14.12.2020
EventWinter Simulation Conference - WSC 2020: Simulation Drives Innovation - Orlando, United States
Duration: 14.12.202018.12.2020
http://meetings2.informs.org/wordpress/wsc2020/

Recently viewed

Researchers

  1. Kerstin Fedder

Publications

  1. A New Framework for Production Planning and Control to Support the Positioning in Fields of Tension Created by Opposing Logistic Objectives
  2. Human–learning–machines: introduction to a special section on how cybernetics and constructivism inspired new forms of learning
  3. Appendix A: Design, implementation, and analysis of the iGOES project
  4. Joint Proceedings of Scholarly QALD 2023 and SemREC 2023 co-located with 22nd International Semantic Web Conference ISWC 2023
  5. Comparison between UKF and EKF in Sensorless Synchronous Reluctance Motor Drives
  6. Design of Reliable Remobilisation Finger Implants with Geometry Elements of a Triple Periodic Minimal Surface Structure via Additive Manufacturing of Silicon Nitride
  7. Operationalizing ecosystem services for the mitigation of soil threats
  8. Endemic predators, invasive prey and native diversity
  9. The complementary relationship of exploration and exploitation in professional service firms: An exploratory study of IT consulting firms
  10. Adaptor device for transmitting e.g. blood pressure data of human body from blood pressure measuring device of data communication system to e.g. personal computer, has controller for controlling transmission of data to communication module
  11. Relationship between pH-values and nutrient availability in forest soils - the consequences for the use of ecograms in forest ecology
  12. Automatic generation of periodic representative volume elements for matrix-inclusion composites and their efficiency in multiscaling
  13. Ecosystem services flows
  14. Impact of above- and below-ground invertebrates on temporal and spatial stability of grassland of different diversity
  15. New descriptions and typifications of syntaxa within the project 'Plant communities of Mecklenburg-Vorpommern and their vulnerability' - Part I
  16. Hydrological tracers for assessing transport and dissipation processes of pesticides in a model constructed wetland system
  17. Constitutions, Democratic Self-Determination and the Institutional Empowerment of Future Generations: Mitigating an Aporia