topic Re: Thunderbird msf index file processing in Discussions

Thunderbird msf index file processing

BrianSW — Tue, 04 Oct 2022 02:52:41 GMT

I've been having issues with TB 91.11.0 (64-bit) on Windows 10 Home edition running on an Asus Celeron laptop. Many times I'm having issues with messages in folders not showing their subject information (the field is blank). Often the date field returns to the beginning of the Linux epoch. Using the Properties, Repair Folder usually restores the folders indexing, but often sets the status of many (often most) messages to unread.

Recently all the messages in all the TB folders suddenly blanked out. The folders still showed the proper count of the messages, and the correct count for unread messages, but nothing was displayed in the reading or header pane. Repair Folder would sometimes restore the information, but when I left the folder, the information would again vanish.

Eventually, I had to remove all the *.msf files and let TB reindex everything. This meant going through every folder and wait for TB to do the reindex as a foreground process. Even after doing all my ~70 or so folders, I still noticed some of them again had messages with showing blank subjects and bad message dates in the header section that had to be fixed with the Repair Folder option.

I'd like to suggest some administrative improvements to TB.

A global msf reindex background function that would process all folders and replace the existing msf files with a new, correctly indexed, msf file (without the user having to revisit each folder).
A global Properties, Repair Folder option that would recheck all folders and repair damage found without marking everything as unread and which would run in the background.
Thunderbird should check all msf files upon startup and warn or repair any damage found.
TB needs an overhaul of the msf processes to prevent msf index corruption.
A TB utility that can check and repair the msf files outside of TB itself. displaying any issues found and requesting user approval of fixes, or automatic operation with user approval.

I've worked with many email clients, but TB is the first I've ever seen that has problems like this with message indexing. This is a major issue that needs to be addresses with a higher priority than pretty colors on buttons, or redesigned fancy menus. This is basic functionality that needs to be corrected as soon as possible.

Re: Thunderbird msf index file processing

BrianSW — Sun, 23 Oct 2022 21:38:01 GMT

A second time I've had the same problem with TB indexing failing and not being able to see the emails one or more folders. This is becoming an unusable product that focuses on trivial cosmetic improvements and ignores serious flaws in the basic processing. TB has to start focusing on the basic functionality and get this working reliably again.

Re: Thunderbird msf index file processing

Refik — Wed, 15 Mar 2023 12:30:31 GMT

Why hasn't this addressed/resolved yet???

Re: Thunderbird msf index file processing

MongoTuslan — Mon, 19 Jun 2023 20:15:37 GMT

I would like to thank BrianSW for this cogent description of this problem which I have been having as well. I would like to add that the main time I see errors is when I am using the portable TB version on a different computer. So far, the Properties -> Repair function has enabled me to recover almost all of the time. Now, I have to take extra steps when moving my portable TB to a different PC: First, use the Windows Properties Check tool on the media; next Compact Folders (I like that the Files Menu has a "Compact Folders" item that lets me select a main folder and all subfolders get compacted); next perform Properties -> Repair at least on subfolders that have been recently active. I do this when moving from PC 1 to PC 2, and then again when returning from PC 2 back to PC 1, and this has been reliable. I think you can see how having a "Repair Folders" item would be a big time saver.

Re: Thunderbird msf index file processing

MongoTuslan — Mon, 19 Jun 2023 20:16:46 GMT

How can we escalate this issue?

Re: Thunderbird msf index file processing

BrianSW — Tue, 20 Jun 2023 00:22:11 GMT

Recently, I was seeing these same errors occur again. This time there was a more serious issue. I had created a subfolder, "Jobs", and a rule for moving job opportunities to the folder. I had also created a subfolder for a particular opportunity that had sent several emails with email links to forms to be filled out. Suddenly, this second sub-sub-folder vanished. Running properties -> Repair Folder did not recover everything. This sub-sub-folder was gone and not recovered. I began a frantic search and several other folders, including the Inbox suddenly were missing their contents as well. I ran the Repair Folder on each and eventually I found the sub-sub-folder in another location, No a subfolder of the Jobs folder, but a subfolder of another folder. I was able to move it back to the correct location and proceeded to repair other folders as well, including the Inbox several times. This seems to have resolved the issue for the moment.

What remains unresolved is that Thunderbird is unreliable when it comes to accurately managing email. This is a critical failure in basic functionality that must be addressed if this product is to continue to be used. Thunderbird must stop playing games with pretty icons/buttons/colors and get the basics of actually being able to process the user's email reliably.

Re: Thunderbird msf index file processing

MongoTuslan — Tue, 20 Jun 2023 01:14:49 GMT

I have experienced similar errors. The workarounds I mentioned have helped, but this is time consuming. Another workaround I can imagine, but have not tried, is just keeping the database very small, which kind of defeats the purpose for me. My smaller subfolders that have no recent activity have not had these errors. I agree that this unreliable behavior must be fixed and I am searching for a way to escalate this issue.

Re: Thunderbird msf index file processing

MongoTuslan — Wed, 25 Oct 2023 20:52:57 GMT

File > Compact Folders no longer compacts all subfolders. Now, I have to go back to my previous practice of tediously selecting each and every subfolder and compacting it individually, and then selecting Properties and clicking on repair. I have scores of subfolders in my profile, so this is time consuming. I only have one folder in my profile, everything else is in a subfolder, so File < Compact Folders was a great time saver. I would really like to have this function restored, as well as a similar function to repair all subfolders in a folder.

Re: Thunderbird msf index file processing

AveryD — Fri, 18 Apr 2025 22:41:31 GMT

oops, sorry...

Re: Thunderbird msf index file processing

MongoTuslan — Fri, 18 Apr 2025 22:50:10 GMT

My update on Mozilla Thunderbird mail reader database corruption:

I use the portable version of Thunderbird, and I have experienced database corruption when trying to use it on a different computer. Here are my tips on reducing the likelihood of corruption and how to recover from corruption.
1. Do not run from removable media. I copy my Thunderbird folder to my user folder and run it from there.
2. Run Scandisk/Checkdisk on removable media before and after copying from the source PC, and again before to from the destination PC.
3. Run repair folder on each and every folder and subfolder (at least those that have had recent activity) before and after copying, and regularly as well.
4. Run compact folder on each and every folder and subfolder that has had recent activity, and before and after copying, and regularly as well.

I would like to request features in Thunderbird to make this less tedious and time consuming.
For example, accessing the repair folder button takes several clicks; it would be nice if there were a shortcut to this.
It would be nice if repair folder could be set to automatically run on all subfolders.
It would be nice if the compact folder function had a shortcut and also automatically ran on all subfolders. Even better would be a super repair function that would go through all folders and subfolders to repair and compact them all.

Bug report: Sometimes, repair folder does not indicate when it is "done".