Welcome to the new Gigaspaces XAP forum. To recover your account, please follow these instructions.

Ask Your Question
0

Mirror is too slow

We are using mirror with hibernate data provider. 30 000 records takes number of minutes to completely load into Oracle DB (doing just inserts). My suspicion that batching and size of commits for DB is not set properly. While the process is running we see very small commits of 10-50 records, and I would expect to see higher values, as we do set

bulk-size 500
interval-millis 3000
interval-opers 500

via mirror.properties.

Does bulk-size parameter control the size of one committed batch or there is another parameter (ex: in hibernate configs)?

Is HibernateDataSource part of Open Spaces. Where can we find source code for it? I would rather avoided implementing own BulkDataPersister...

Can you, please, point us to ways of increasing mirror throughput?

Thanks

{quote}This thread was imported from the previous forum. For your reference, the original is [available here|http://forum.openspaces.org/thread.jspa?threadID=2036]{quote}

asked 2007-12-03 20:31:02 -0500

mgrouch gravatar image

updated 2013-08-08 09:52:00 -0500

jaissefsfex gravatar image
edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

See:
hibernate.jdbc.batch_size <-- This can help very much
hibernate.defaultbatchfetch_size
hibernate.jdbc.batchversioneddata
hibernate.cache.usesecondlevel_cache false

docs/reference/en/html/session-configuration.html">http://www.hibernate.org/hibdocs/reference/en/html/session-configuration.html
docs/reference/en/html/batch.html">http://www.hibernate.org/hibdocs/reference/en/html/batch.html

Try also:
    bulk-size 50
    interval-millis 1000
interval-opers 50

Another option that might perform better is to implement the BulkDataPersisterto using the StatelessSession.

Support can send you the HibernateDataSource source code.

Shay

answered 2007-12-05 08:25:01 -0500

shay hassidim gravatar image
edit flag offensive delete link more

Your Answer

Please start posting anonymously - your entry will be published after you log in or create a new account.

Add Answer

Question Tools

1 follower

Stats

Asked: 2007-12-03 20:31:02 -0500

Seen: 23 times

Last updated: Dec 05 '07