Is there any way in LLBL to submit data that needs to be updated or inserted as a batch? We have found that batching of insert / update statements give about a 8 - 12x performance increase over individual statements.
Our application does a lot of data insertions. So we may have an entity collection say of 10,000 items. Rather than have 10,000 db transaction (assuming simple entities with no relations) spawned I'd rather have a way to do batch of say 500 at a time.
So what I want to do is have a 'data writing service' which extracts the sql that LLBL will generate and have it pass it off to the data writing service. The service will be resonsible for taking the sql that needs to run and given some business rules combine it with other like statements and then submit the sql as a batch.
Our application supports heavy loads of bulk type of transactions and a few one off updates (eg update a last name or address). For the one off type of things I'm fine with bypassing the data writing service - but for the big batch processes (which are not super time sensitive, but I still want them done as efficiently as possible) I'd like to offload that job from the business tier and leave it to a data service. Thoughts?
