The preference/project-property is applied for new entities added to your project. If you already have the project, and then you turn on/off the property, you should switch the "Generate as Nullable type" property by manually. You of course, can run the "Sets GenerateAsNullbleOfT" plugin to switch all in one go.