June 2009 - jboss-dev-forums - Jboss List Archives

[Design of Messaging on JBoss (Messaging/JBoss)] - Re: Journal Cleanup and Journal Compactor

by timfox

When you compact the journal you can't choose which files you compact, you either compact the whole journal or none of it. If you just choose to compact just one file then you would delete that file but you're just deleting the delete records so when you reload the journal the messages come back! View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237107#4237107 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237107

16 years, 6 months

1
0
0 / 0

[Design of Messaging on JBoss (Messaging/JBoss)] - Re: Journal Cleanup and Journal Compactor (Repost)

by clebert.suconic＠jboss.com

What about the interchanged example. File1 full, file2.. compact... file 3 full... file 4 compact would you compact (file1, 2, 3 and 4)? compacting 2 and 4 would be a waste of processing. View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237104#4237104 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237104

16 years, 6 months

1
0
0 / 0

[Design of Messaging on JBoss (Messaging/JBoss)] - Re: Journal Cleanup and Journal Compactor

by clebert.suconic＠jboss.com

What about the interchanged example. File1 full, file2.. compact... file 3 full... file 4 compact would you compress (file1, 2, 3 and 4)? compressing 2 and 4 would be a waste of processing. View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237104#4237104 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237104

16 years, 6 months

1
0
0 / 0

[Design of Messaging on JBoss (Messaging/JBoss)] - Re: Journal Cleanup and Journal Compactor

by timfox

"clebert.suconic(a)jboss.com" wrote : anonymous wrote : It then opens the old files F0..F5 loads the wanted records into memory in blocks and copies them to the new files. | | | This is what I'm calling as moving here. However. when you move them to the new file.. the new file will also be on the top of the list... so the order could change. The new files won't be at the top of the list, they'll be in the same place the old files were. Like I say, no order will change. View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237102#4237102 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237102

16 years, 6 months

1
0
0 / 0

[Design of Messaging on JBoss (Messaging/JBoss)] - Re: Journal Cleanup and Journal Compactor

by clebert.suconic＠jboss.com

anonymous wrote : It then opens the old files F0..F5 loads the wanted records into memory in blocks and copies them to the new files. This is what I'm calling as moving here. However. when you move them to the new file.. the new file will also be on the top of the list... so the order could change. If you really want phisicalOrder == logicalOrder, I could open a "new-file" at an earlier position. However during the write time... you will have two files being written.. so the disk head will be jumping back and forth these two poistions. Besides.. the interchanged example would still suffer if you can't change phisical order. Unless you also compact the full files in between. (what would be a waste of processing). I would still do the Move-operation, as I could have the transactional control within the journal files. View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237101#4237101 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237101

16 years, 6 months

1
0
0 / 0

[Design of Management Features on JBoss] - Re: ManagedObject interface

by scott.stark＠jboss.org

Yes, that is fine. View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237099#4237099 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237099

16 years, 6 months

1
0
0 / 0

[Design of Messaging on JBoss (Messaging/JBoss)] - Re: Journal Cleanup and Journal Compactor

by clebert.suconic＠jboss.com

What about a case where? File1 - Needs compacting File2 - Full File3 - Needs compacting File4 - Full .... File(n-1) Needs Compacting File(n) - Full File(n+1) in use If we could change the phisical order of the record on the journal... we would just move record from 1, 3, ... n-1 to the top of the journal. Reclaim would take care of them after moved. I'm suggesting the logical order of the record could be different than the phisical order. View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237098#4237098 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237098

16 years, 6 months

1
0
0 / 0

[Design of Messaging on JBoss (Messaging/JBoss)] - Re: Journal Cleanup and Journal Compactor

by timfox

"clebert.suconic(a)jboss.com" wrote : | You might say we would have an issue with Ordering... but compacting the way you said would be the same thing.. since the file would get a new ID and be on the top of the list. But compacting could give you the same issue since the new file receiving the compacting would get a newID. | Compacting as I envision it would not change the order of any records, it simply removes dead records and pushes them all up to remove the dead space. No ordering changes occur. View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237090#4237090 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237090

16 years, 6 months

1
0
0 / 0

[Design of Management Features on JBoss] - Re: ManagedObject interface

by ips

Ok. Are you ok with adding the notes in the Javadoc as I suggested for now? If so, I can make the updates. View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237085#4237085 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237085

16 years, 6 months

1
0
0 / 0

[Design of Messaging on JBoss (Messaging/JBoss)] - Re: Journal Cleanup and Journal Compactor

by clebert.suconic＠jboss.com

No.. I don' t want to write a database :-) Instead of using external files to control the compacting, I suggest we do it using the current transaction support we already have on the journal. One way of doing it would be to create a MOVE operation that would delete it on its original file, and re-add it on the current used file. That operation could be done inside a journal-transactional, so we would have all the control of crashes for free on that operation. On my previous post I was thinking about changing the internal ID of the record when moving it, but I could do it without changing it. You might say we would have an issue with Ordering... but compacting the way you said would be the same thing.. since the file would get a new ID and be on the top of the list. But compacting could give you the same issue since the new file receiving the compacting would get a newID. Maybe sort by ID would fix the issue? View the original post : http://www.jboss.org/index.html?module=bb&op=viewtopic&p=4237083#4237083 Reply to the post : http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=4237083

16 years, 6 months

1
0
0 / 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

jboss-dev-forums June 2009