Abstract

This study focuses on the application of Deep Q-Networks (DQN) to train AI agents to play bullet hell games. We built a training environment and utilized ray casting to collect input data for the network. Two similar network model architectures were evaluated and compared to maximize the learning efficiency of our AI agent. The trained AI demonstrates commendable performance and the ability to learn and adapt strategies into gameplay. However, while the AI agent displayed potential in mastering gameplay dynamics, there remain several challenges to integrating the agent to complete commercial bullet hell games. These challenges may provide directions for future research.