Logo

ML in Health Science: AI Snake

Explore ML as a Game
?
x

This model is designed to target specific objectives during training.

?
x

This model does not focus on specific objectives and allows for more exploration.

?
x

This model encourages exploration by incorporating curiosity-driven learning.

x

Adjust the proportion between generated data and experience data used during training.

x

Adjust the speed at which the snake moves. Lower values mean higher speed.

?
x

Fine-tune the model using existing training data to improve its performance incrementally.

?
x

Train the model from scratch using a new set of data for a completely fresh start.

?
x

Number of times the model will cycle through the training data.

?
x

Number of training examples utilized in one iteration.

?
x

How much to change the model in response to the estimated error each time the model weights are updated.

?
x

Rate at which the learning rate decreases after each epoch.

?
x

Penalty term added to the loss function to encourage smaller weights and reduce overfitting.

?
x

Alpha parameter for the Leaky ReLU activation function, controlling the slope of the activation for negative inputs.

?
x

Fraction of input units to drop to prevent overfitting during training.

?
x

Number of epochs with no improvement after which training will be stopped.

?
x

Minimum change in the monitored quantity to qualify as an improvement.

?
x

Threshold to clip gradient norms to prevent exploding gradients during training.

?
x

Coefficient for the entropy term in the loss function to encourage exploration.

?
x

Level of noise added to the state inputs to improve robustness.

?
x

Reward value for the snake when it eats food.

?
x

Penalty value for the snake when it collides with itself.

?
x

Penalty value for the snake for each move it makes (encourages faster completion).

?
x

Penalty value for the snake if it fails to make progress towards the food.

?
x

Reward value for the snake based on its proximity to the food.

?
x

Size of the replay buffer that stores experiences for training.

?
x

Exponent for prioritizing experiences in the replay buffer.

?
x

Small value added to priorities to ensure all experiences have a non-zero probability of being selected.

?
x

Probability of selecting a random action instead of the best action during training.

?
x

Rate at which the exploration epsilon decreases after each episode.

?
x

Minimum value for the exploration epsilon to ensure some exploration is always present.

This tool is designed to help you understand the principles of building Machine Learning models through gameplay. The Snake is guided by a reinforcement learning process using feedforward neural network predictions, with training data generated from auto gameplay. Experiment with parameters and observe the performance. Ask the Transformer about the principles of model building and the influence of settings on performance.

If you would like to see how the ML works: right-click, select "Inspect," open the Console of your browser, and enjoy the heartbeat of the machine.

If you want to deploy your own ML app, visit ML in Health Science: Playground