Creative Machine Learning with ML5

by Andreas Refsgaard

ml5js

1) ML train a classification algorithm

Exercise: Train a classifier to distinguish between two different classes. Make the sketch output a descriptive text for each class.

Advanced example: Trainable Camera

2) ML5 MobileNet pretrained classification

Simple example: Mobilenet pretrained classification

Advanced example: Poems about things desktop

mobile

Video about the project

A few fun poems:

Exercise: Try to place different objects in front of the camera and observe as they get detected. What happens if you change the background or the angle of the webcam? Perhaps try the poem example, and see if you can generate some weird poems (however too many requests at the same time makes the API cranky...).

3) ML5 train a regression algorithm

Simple example: Control the size of the rectangle

Advanced example 1: Playback rate camera

Advanced example 2: Control Mister Bean with regression

Exercise: Train the regressor and see if you can control the sound playback or Mister Bean through your webcam

Having issues running the examples in the browser?

Google Chrome

Allow camera and microphone in Google Chrome

Allow camera on MacOSX in System Preferences

Webcam access on Windows 10: Select Start > Settings > Privacy > Camera. Set "Let apps use my camera" to "On". Make sure Chrome has access to use the camera.

Older computers with less powerful graphics cards might run out of memory if you record hundreds or thousands of examples from the webcams. If it happens, switch to another computer or be more modest when recording training data.

Links

ml5js.org reference

Index of all official ml5 examples

Official p5.js editor

Official p5.js reference