Storing Forum Messages.... [message #9273] |
Wed, 19 March 2003 20:01 |
|
forrie
Messages: 47 Registered: August 2002 Location: Derry, NH
Karma: 0
|
Member |
|
|
I ran into a problem where my MySQL data got corrupted (removed!) and was left with a msg_1 file.
Upon looking at this file, it was clear that no identifying information (ie: some type of headers) was present and I was otherwise going to have to figure it out manually or ask people to repost their messages (the latter being more realistic).
This is a point of failure/weakness in the forum design. I have seen suggestions about putting the posts in the actual database, some disagree. Perhaps it can be enabled to do this, and the admin can "choose" to have articles on-disk instead... if the articles are stored in raw text format on the disk, then at the very least I would suggest some form of posting information that could identify the post/forum/user,etc.
In my case, if that data were present, I might possibly been able to use a recover script or something to re-import the data into the forums, walla.
Something to consider for disaster recovery, which would be very useful to have available.
I would be for putting the forum posts into the database - it could allow for a more powerful search, and a way to organize the data. Problem being: what to do with attachments? Put them IN the database as blobs or correlate a URL or PATH to where it's stored on disk (problems with both I can see).
_F
|
|
|
Re: Storing Forum Messages.... [message #9331 is a reply to message #9273] |
Mon, 24 March 2003 15:42 |
Ilia
Messages: 13241 Registered: January 2002
Karma: 0
|
Senior Member Administrator Core Developer |
|
|
Had the data been in MySQL you wouldn't have even raised this question since it would have been lost as well. The storage mechanism is chosen for a number of reasons and I see no reason to alter it's operation.
FUDforum Core Developer
|
|
|
Re: Storing Forum Messages.... [message #9335 is a reply to message #9331] |
Mon, 24 March 2003 16:14 |
Anonymous
|
|
|
|
I understand your viewpoint; I think the most important thing for me here would have been some identifying information in the on-disk forum postings that one might have used a script to recreate the posts from. So you could have data in the mysql database and out of it.
If I had replication going on with Mysql, I would have had the mysql data available on another database (possibly in another location on the net). This certainly is a handy feature that cannot presently be implemented with the forum.
Some type of disaster recovery process would eventually be handy :-)
|
|
|
|
Re: Storing Forum Messages.... [message #9342 is a reply to message #9335] |
Mon, 24 March 2003 17:25 |
Ilia
Messages: 13241 Registered: January 2002
Karma: 0
|
Senior Member Administrator Core Developer |
|
|
Disaster recovery is best accomplished via frequent (daily) backups using the forum datadump tool, which can be used via a crontab.
As far as data retrieval, I doubt replication would make it any faster since, network IO + MySQL overhead will exceed any benefits gained by you from replication in this case since data is fetched RAW and immidiately used as is. Replication will mostly help you when queries are CPU intensive and you can multiply performance by using multiple servers. Keep in mind that replication process also makes data insertion slow, since it needs to be duplicated across multiple servers.
For performance reasons the data is stored as is and internal offsets in MySQL are used to retrieve it, going via some manual mechanism would be infinately slower.
FUDforum Core Developer
|
|
|