|
Re: Error running compactor for private messages in 2.7.1 [message #27978 is a reply to message #27976] |
Tue, 04 October 2005 01:14 |
Juanisan
Messages: 24 Registered: July 2002 Location: Conshohocken, PA
Karma: 0
|
Junior Member |
|
|
WOW! Are you gonna tell me now that all my messages are lost too? As I went from having a sizable directory of message files
total 12
-rw-r--r-- 1 nobody nogroup 430 Oct 3 20:18 msg_350000
-rw-r--r-- 1 nobody nogroup 185 Oct 3 18:35 msg_450000
-rw-rw-rw- 1 nobody nogroup 1394 Oct 3 19:30 private
-rw-r--r-- 1 nobody nogroup 0 Oct 3 18:17 private_tmp
to this?
someone just informed me that all message bodies are gone and I discovered this.
Our users have posted a total of 8872 messages inside 1237 topics.
Most users ever online was 6 on Mon, 03 October 2005 20:49
We have 233 registered user(s).
Never ask a geek why, just nod your head and slowly back away.
[Updated on: Tue, 04 October 2005 01:15] Report message to a moderator
|
|
|
|
|
Re: Error running compactor for private messages in 2.7.1 [message #27993 is a reply to message #27992] |
Tue, 04 October 2005 15:11 |
Ilia
Messages: 13241 Registered: January 2002
Karma: 0
|
Senior Member Administrator Core Developer |
|
|
The goal of the patch is to fix the problem so that it does not happen again if you run the compactor. Normally running the compactor is not necessary, this tool is only necessary in the event you are short on disk space and have in the past deleted large number of messages. In that case the compactor is able to reclaim some space, by removing the "empty" spots left in the msg files.
Ideally at this point you could go back to the backups of the forum, if you don't have those, then I'm afraid the message bodies are gone.
FUDforum Core Developer
|
|
|
Re: Error running compactor for private messages in 2.7.1 [message #28057 is a reply to message #27250] |
Sun, 09 October 2005 23:13 |
Juanisan
Messages: 24 Registered: July 2002 Location: Conshohocken, PA
Karma: 0
|
Junior Member |
|
|
You cant blame me. I dont trust the release notes. Is this fixed in 2.7.3RC2?
I found an old hard drive from 2 months ago. we lost 1099 messages, 130 topics, 23 registered users
I just want to make sure that this bug is fixed in 2.7.3RC2
TIA
Never ask a geek why, just nod your head and slowly back away.
|
|
|
|
|
|
Re: Error running compactor for private messages in 2.7.1 [message #28439 is a reply to message #27250] |
Mon, 24 October 2005 23:54 |
BugLaden
Messages: 216 Registered: February 2002 Location: Westminster, MD
Karma: 0
|
Senior Member |
|
|
I get this with Version 2.7.3.RC3.
I had to view the source of the page because it was locked down and unscrollable.
Quote: | <br>Disabling the forum for the duration of maintenance run<br><br>Please wait while forum is being compacted.<br>This may take a while depending on the size of your forum.<br>
Compacting normal messages...<br>
10% done<br>
ETA: 27 seconds<br>
20% done<br>
ETA: 28 seconds<br>
30% done<br>
ETA: 25.666666666667 seconds<br>
40% done<br>
ETA: 24 seconds<br>
50% done<br>
ETA: 21 seconds<br>
60% done<br>
ETA: 17.333333333333 seconds<br>
70% done<br>
ETA: 13.714285714286 seconds<br>
80% done<br>
ETA: 9.5 seconds<br>
90% done<br>
ETA: 5 seconds<br>
100% Done<br>
Compacting private messages...<br>
(/usr/fudforum/include/theme/default/db.inc:73<br />
/var/www/html/ccgw/forum/adm/compact.php:158<br />
) 1061: Duplicate key name 'fud_pmsg_foff_idx'<br />
Query: CREATE INDEX fud_pmsg_foff_idx ON fud_pmsg (foff)<br />
_POST: array (
'conf' => 'Yes',
'SQ' => '1b2e0c0d5556729874774abdc6c39baa',
)<br />
Server Version: 4.0.21-standard<br />
|
-=BugLaden
|
|
|
Re: Error running compactor for private messages in 2.7.1 [message #28440 is a reply to message #27250] |
Tue, 25 October 2005 00:05 |
BugLaden
Messages: 216 Registered: February 2002 Location: Westminster, MD
Karma: 0
|
Senior Member |
|
|
Ok, figured out that the table index it was complaining about was left over from a previous bombed compact attempt.
After removing the index, here is my log. This is with 2.7.3RC3
Quote: | <b>Warning</b>: fopen(/usr/fudforum/messages/private): failed to open stream: No such file or directory in <b>/usr/fudforum/include/theme/default/private.inc</b> on line <b>200</b><br />
<br />
<b>Warning</b>: fseek(): supplied argument is not a valid stream resource in <b>/usr/fudforum/include/theme/default/private.inc</b> on line <b>201</b><br />
<br />
<b>Warning</b>: fread(): supplied argument is not a valid stream resource in <b>/usr/fudforum/include/theme/default/private.inc</b> on line <b>202</b><br />
<br />
<b>Warning</b>: fclose(): supplied argument is not a valid stream resource in <b>/usr/fudforum/include/theme/default/private.inc</b> on line <b>203</b><br />
FATAL ERROR: system has ran out of disk space<br>
|
As a result, all my messages have no bodies
-=BugLaden
[Updated on: Tue, 25 October 2005 00:06] Report message to a moderator
|
|
|
Re: Error running compactor for private messages in 2.7.1 [message #28447 is a reply to message #27250] |
Tue, 25 October 2005 13:03 |
BugLaden
Messages: 216 Registered: February 2002 Location: Westminster, MD
Karma: 0
|
Senior Member |
|
|
Latest update. I looked in private.inc and found that it was trying to open the messages/private directory, which did not exist. I did create a new template set with 2.7.2, and I guess that directory was not created. Might want to look into that.
Anyway, after clearing the fud_pmsg_foff_idx index again and re-running the compact messages, here is the latest log:
Quote: | ETA: 27 seconds<br>
20% done<br>
ETA: 24 seconds<br>
30% done<br>
ETA: 23.333333333333 seconds<br>
40% done<br>
ETA: 22.5 seconds<br>
50% done<br>
ETA: 20 seconds<br>
60% done<br>
ETA: 16.666666666667 seconds<br>
70% done<br>
ETA: 13.285714285714 seconds<br>
80% done<br>
ETA: 9.25 seconds<br>
90% done<br>
ETA: 4.8888888888889 seconds<br>
100% Done<br>
Compacting private messages...<br>
FATAL ERROR: system has ran out of disk space<br>
|
Nothing left for me to track down
-=BugLaden
|
|
|
Re: Error running compactor for private messages in 2.7.1 [message #28452 is a reply to message #28438] |
Tue, 25 October 2005 14:28 |
Ilia
Messages: 13241 Registered: January 2002
Karma: 0
|
Senior Member Administrator Core Developer |
|
|
konkers wrote on Mon, 24 October 2005 17:14 | Accepting that all my messages are gone, what is the best way to clear out a forum of it's bodyless messages?
|
Delete records from the message table and run the consistency checker.
FUDforum Core Developer
|
|
|
|
|
|
Re: Error running compactor for private messages in 2.7.1 [message #28459 is a reply to message #27250] |
Tue, 25 October 2005 15:22 |
BugLaden
Messages: 216 Registered: February 2002 Location: Westminster, MD
Karma: 0
|
Senior Member |
|
|
private directory removed. Re-ran the compact utility:
Quote: | <b>Warning</b>: fopen(/usr/fudforum/messages/private): failed to open stream: No such file or directory in <b>/usr/fudforum/include/theme/default/private.inc</b> on line <b>200</b><br />
<br />
<b>Warning</b>: fseek(): supplied argument is not a valid stream resource in <b>/usr/fudforum/include/theme/default/private.inc</b> on line <b>201</b><br />
<br />
<b>Warning</b>: fread(): supplied argument is not a valid stream resource in <b>/usr/fudforum/include/theme/default/private.inc</b> on line <b>202</b><br />
<br />
<b>Warning</b>: fclose(): supplied argument is not a valid stream resource in <b>/usr/fudforum/include/theme/default/private.inc</b> on line <b>203</b><br />
FATAL ERROR: system has ran out of disk space<br>
|
What actually creates this file again then?
EDIT: I originally ran into this problem and mistaken thought it was looking for a directory, so created it manually. So the problem now is that private didn't exist.
-=BugLaden
[Updated on: Tue, 25 October 2005 15:28] Report message to a moderator
|
|
|
|
Re: Error running compactor for private messages in 2.7.1 [message #28463 is a reply to message #27250] |
Tue, 25 October 2005 15:51 |
BugLaden
Messages: 216 Registered: February 2002 Location: Westminster, MD
Karma: 0
|
Senior Member |
|
|
Ok, recreated the problem, deleted the index, and re-ran the compact utility.
Still getting this far:
Quote: | ETA: 5.4444444444444 seconds<br>
100% Done<br>
Compacting private messages...<br>
FATAL ERROR: system has ran out of disk space<br>
|
Checked permissions on the messages dir. apache is owner and has write permission.
One question. I was going through the table structure and am having a sudden horrible realization that the only copy of the text of my 130000 messages are stored in these message files, NOT in the database. So all this time I've been making backups of the database and not these message files, so have no way of restoring my messages.
Is this correct?
-=BugLaden
|
|
|
|
|
|
Re: Error running compactor for private messages in 2.7.1 [message #28472 is a reply to message #27250] |
Tue, 25 October 2005 17:32 |
BugLaden
Messages: 216 Registered: February 2002 Location: Westminster, MD
Karma: 0
|
Senior Member |
|
|
1. Deleted contents of messages folder
2. Found a year old copy of the messages folder and copied them into the messages folder:
[root@server1 fudforum]# ls -l messages
total 44908
-rw-r--r-- 1 root root 43634470 Oct 25 12:30 msg_1
-rw-r--r-- 1 root root 2297485 Oct 25 12:30 private
3. Run the v2.7.3.RC3 message compactor
Dies with a disk out of space error and the following messages folder:
[root@server1 fudforum]# ls -l messages
total 2276
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_10000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_100000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_1000000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_1010000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1020000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1030000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1040000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1050000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1060000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1070000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1080000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1090000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_110000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_1100000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1110000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1120000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1130000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1140000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1160000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1170000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1180000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1190000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_120000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_1200000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1210000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1220000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1230000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1240000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_1250000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1260000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1270000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1290000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_130000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1330000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1340000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1350000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_1360000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1370000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1380000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1390000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_140000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1400000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1410000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1430000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1440000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1460000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1490000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1500000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1510000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_1540000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1550000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_1560000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1580000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_160000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1610000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1620000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1650000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1660000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_170000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1710000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_1750000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_20000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_200000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_220000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_230000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_240000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_250000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_260000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_270000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_280000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_290000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_30000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_300000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_310000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_320000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_330000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_340000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_350000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_370000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_380000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_390000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_40000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_400000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_410000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_420000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_430000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_440000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_450000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_460000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_470000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_480000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_490000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_500000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_510000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_520000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_540000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_550000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_560000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_570000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_580000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_590000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_60000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_600000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_610000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_620000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_630000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_640000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_650000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_660000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_670000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_680000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_690000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_70000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_700000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_710000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_720000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_730000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_740000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_750000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_760000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_770000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_780000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_790000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_80000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_800000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_810000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_820000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_830000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_840000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_850000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_860000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_870000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_880000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_890000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_90000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_900000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_910000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_920000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_930000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_940000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_950000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:32 msg_960000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_970000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_980000
-rw-rw-rw- 1 apache apache 0 Oct 25 12:33 msg_990000
-rw-r--r-- 1 root root 2297485 Oct 25 12:30 private
-rw-r--r-- 1 apache apache 27729 Oct 25 12:33 private_tmp
I'd say this is not fixed.
-=BugLaden
|
|
|
|
|
|