FUDforum
Fast Uncompromising Discussions. FUDforum will get your users talking.

Home » FUDforum Development » Bug Reports » nntp import of large groups creates troubles
Show: Today's Messages :: Polls :: Message Navigator
Return to the default flat view Create a new topic Submit Reply
nntp import of large groups creates troubles [message #20202] Fri, 01 October 2004 22:29 Go to previous message
devnull is currently offline  devnull   United States
Messages: 16
Registered: September 2004
Karma:
Junior Member
After making a custom theme and installing FudForum on a new server, I configured the newsgroups I wanted to import.

Some groups are pretty big (over 5000 posts) what causes the nntp.php script to fail. I'm not sure if it's a timeout or if it just crashes.

The problem is that after I restart it, it imports old news again; I end up with hundreds of duplicate entries. For now, I quit the import until I find a solution. Accoring to a previous post here, crashed newsgroup imports will leave a .lock in errors/.nntp. For almost every bigger group, I have one in there.

Here my two ideas (it's 00:30am, so there might be more Smile ):
1) Could the nntp.php script easily be changed to stop after eg 1000 posts? When running from cron, the board would fill slowly over several updates.
2) Is the number in the newsfiles in errors/.nntp the topic ID? It would involve more work, but no sourcechanges would be needed. Run nntp.php for one group until it stops and fix the file in .nntp manually, then re-run.

I do hope #1 is possible tho Wink
[Message index]
 
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: nntp import doesn't always convert properly
Next Topic: Tiny bug
Goto Forum:
  

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Tue Nov 26 16:49:19 GMT 2024

Total time taken to generate the page: 0.04349 seconds