ER-11 collets are a nicety, but they shouldn’t be necessary to get the tool securely in place to cut. The big reason to get them is if one is using metric tooling, or tooling in a variety of diameters.
This was rather thoroughly explored in the thread: