Setting an EntityFactory into a collection class allows the collection to create new objects. This can be by you call collection.AddNew, which will return a new entity, or if the collection is bound to a grid which allows the user the to add new rows, for example.
If you are not doing either of these, then as you have found the collection will work perfectly well without the factory present.
Matt