mbox to maildir conversion -- Mail Services

#1 06-13-2006, 10:41 PM

Hello.

There have recently been some problems regarding a newest cpanel update assuming the format/structure of mailboxes to be of the "maildir" format, rather than mbox. This causes authentication problems. We have decided to go ahead with the conversion to maildir as a solution as the newer format is more effecient.

We are currently working slowly to upgrade all of the servers to the maildir format, however, we will be doing this with 5-10 servers per day with announcements here of which ones are currently being done and when they are finished.

During the conversion process, you may experience intermittent issues with mail. We are aware of this and the problems will resolve themselves during the conversion. The conversion is done in alphabetical order by cpanel username. We will be doing this on all standard shared servers (gator*.hostgator.com) in order.

The servers gator2-10 have already been done.

#2 06-13-2006, 10:49 PM

Wednesday, June 14, 2006 00:00 Eastern
gator11-15

(completion times are approximate):

gator11: completed at 01:13
gator12: completed at 01:07
gator13: completed at 00:47
gator14: completed at 03:40
gator15: completed at 01:08

vtrain · #3 06-14-2006, 03:36 AM

will this be done on reseller servers afterwards?

Thanks for keeping us posted, on the other side I never hear anything back from the PHPSuExec ever since...

Vt

#4 06-14-2006, 08:21 PM

Yes, this will be done on the reseller servers afterwords.

Regarding phpsuexec, I do know that on new servers, we are now enabling it by default. We are still testing it out on a few servers to see what types of problems we will run into before converting any more to phpsuexec as far as I know.

Tonight, I'll be doing gator16-20 starting at around Thursday, 6-15-06: 00:00
I'll post updates upon their completion.

Completions:
gator16: 1:28
gator17: 4:10
gator18: 4:10
gator19: 1:22
gator20: 3:00

Serra · #5 06-14-2006, 09:22 PM

How can we tell if the server we are on is setup with mbox or not?

#6 06-14-2006, 11:35 PM

Well, check in your /home/user/mail/domain.com/username directory.
If the structure has the "cur" directory in it under it, it's using maildir.

Kelmas · #7 06-15-2006, 01:20 AM

And I noticed, that with old system you were able to set up folders like "TheFolder" and now after update all folders are "INBOX.TheFolder". Seems like it all went smooth on gator19, thanks for update.

#8 06-15-2006, 04:42 PM

On the larger mailboxes, it's necessary to skip them to get the rest of them converted. If you have more than 100K messages, expect it to be a while before your mail starts working again properly as we have to go over them again. Why you have more 100K messages in your inbox, no one can tell.

Later today, I will be doing the following servers starting at Friday, 6-16-06 00:00 EDT:
gator21: completed 1:25
gator22: completed 4:00 (may be later)
gator23: completed 1:25
gator24: completed 1:25
gator25: completed 1:25

I will edit this post with their completion times as it happens.

Serra · #9 06-15-2006, 08:38 PM

Quote:

Originally Posted by GatorDaniel

Well, check in your /home/user/mail/domain.com/username directory.
If the structure has the "cur" directory in it under it, it's using maildir.

No "cur", I'm good.

craggie · #10 06-17-2006, 04:59 AM

I'm not sure if this is to do with the recent conversion but all my IMAP folders have been moved to subfolders of inbox, including my 'sent items' and 'drafts'!

Can anybody explain this to me please?

Stuart

#11 06-20-2006, 12:27 AM

Yes, this is more than likely due to the conversion.

It's the standard / normal format for maildir with courrier(SP)
These servers are already done:
gator21
gator22
gator23
gator24
gator25

Tonight, staring at 1:30 (June 20), we will be doing

gator26: completed 2:26
gator27: completed 4:33 (may have finished before this time.)
gator28: completed 2:15
gator29: completed 1:55
gator30: completed 1:53

craggie · #12 06-20-2006, 08:55 AM

I use outlook express as my IMAP client, is it still possible to use 'drafts' and 'sent items' in the intended way, and if so, how?

#13 06-20-2006, 11:35 PM

Starting at 06-21-06 00:45
gator31: completed 1:30
gator32: completed 1:30
gator33: completed 1:33
gator34: completed 1:30
gator35: completed 1:33

bcs · #14 06-21-2006, 11:14 AM

Quote:

Originally Posted by craggie

I use outlook express as my IMAP client, is it still possible to use 'drafts' and 'sent items' in the intended way, and if so, how?

I had the same issue.
Response form HG-Support:

Quote:

This looks to be a limitation with outlook express. I was able to use thunderbird without any problems. The current subscribed folders are for the maillist account are, root@gatorxx INBOX INBOX.Sent Items INBOX.Trash INBOX.Sent

Outlook should allow INBOX.Sent as the folder name but it is preventing the . character. You will have to use the default folder outlook express creates and will not be able to sync the emails. Please let us know if you have any further questions.

I get the impression HG didn't test this before making the change.
Outlook Express is a popular client, I'm not impressed by the handling of this 'upgrade'. It's not a huge issue for me, but a general email annoucement would have been good. Telling me that it's OK with Thundebird is no good at all.

Maybe HGshould have asked for volunteers to test the new format to iron out any bugs before moving people lock-stock?

#15 06-21-2006, 06:40 PM

Quote:

Originally Posted by bcs

I had the same issue.
Response form HG-Support:

I get the impression HG didn't test this before making the change.
Outlook Express is a popular client, I'm not impressed by the handling of this 'upgrade'. It's not a huge issue for me, but a general email annoucement would have been good. Telling me that it's OK with Thundebird is no good at all.

Maybe HGshould have asked for volunteers to test the new format to iron out any bugs before moving people lock-stock?

Hello.

In Outlook Express, if you are using IMAP, right click on the mailserver in the left panel, then select properties, or go to the account properties. Select the IMAP tab, then change the "Root folder path" to "INBOX/"

#16 06-22-2006, 12:44 AM

6-22-06 :: 01:50
gator36: completed 2:18
gator37: completed 2:23
gator38: completed 2:10
gator39: completed 2:19
gator40: completed

craggie · #17 06-22-2006, 02:53 AM

That worked perfectly - thanks.

#18 06-27-2006, 09:58 PM

Good to hear, craggie

Tonight's servers, starting at 11:15PM EST 6-27-06 (Sorry I haven't had a steady pace, I got side tracked.)

gator41: completed: 11:55PM
gator42: completed: 11:32PM
gator43: completed: 11:57PM
gator44: completed: 11:59PM
gator45: completed: 11:35PM

Then afterwords:
gator46: completed: 11:55PM
gator47: completed: 11:59PM
gator48: completed: 00:33
gator49: completed: 00:33
gator50: will be complete sometime tonight, will update with more information when it's available

Start at 00:15 06-28-06
gator51: completed ~00:57
gator52: completed ~00:57
gator53: completed ~00:57
gator54: completed ~00:59
gator55: completed ~00:57

Then afterwords:
gator56: completed: ~01:31
gator57: completed: ~01:31
gator58: completed: ~02:10
gator59: completed: ~01:31
gator60: completed: ~01:31

#19 06-28-2006, 11:57 PM

6-29-06 01:00
gator60: completed
gator61: completed 1:15
gator62: completed 1:22
gator63: completed 1:15
gator64: completed

gator65: completed 1:15
gator66: completed 1:15
gator67: completed 1:18
gator68: completed 1:15
gator69: completed 1:16

MikeC · #20 07-22-2006, 12:52 PM

Quote:

Originally Posted by GatorDaniel

Yes, this will be done on the reseller servers afterwords.

Is this conversion still progressing forwards?

I'm a reseller on hummer and I'm wondering when we'll get converted so that I can rewrite/restart my mail box cleaner routines, which I suspended until the conversion got done.

#21 08-03-2006, 01:26 AM

Quote:

Originally Posted by MikeC

Is this conversion still progressing forwards?

I'm a reseller on hummer and I'm wondering when we'll get converted so that I can rewrite/restart my mail box cleaner routines, which I suspended until the conversion got done.

I would go ahead and leave them enabled for now. Reseller servers will be last.

Starting:
gator70-79

#22 08-03-2006, 01:41 AM

Quote:

Originally Posted by GatorDaniel

I would go ahead and leave them enabled for now. Reseller servers will be last.

Starting:
gator70-79

I apologize for my delay in this. This was my project and I have been rather busy.

We will be completing this asap.

Gator70-79 are now done.

Thanks,
Daniel

#23 10-10-2006, 10:42 PM

gator80-90 have been completed.

vtrain · #24 10-14-2006, 05:14 PM

is this change completely cpanel compatible or it can give problems when transfering a full cpanel backup to/from a HG machine with maildir configuration?

slapshotw · #25 10-14-2006, 11:36 PM

If you transfer from a server storing mail one way to one storing mail the other way, you will have problems-- mail will be bounced away from the mailbox. There is a script that HG can run (or for dedis, you can run yourself) that makes the conversion after you restore the backup. Make sure this script is run before switching nameservers.

-Matt