Why don't the entities remove themselves from their ActiveContext during Finalize? Is there any danger in implementing this myself?

because finalize is never called as they're referenced by the context, so the GC will never consider them as a collectable object.