Bug 158411 - MAILMERGE takes forever after creating Documents and crashes eventually after ~3h for large mailing
Summary: MAILMERGE takes forever after creating Documents and crashes eventually after...
Status: UNCONFIRMED
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Writer (show other bugs)
Version:
(earliest affected)
7.6.2.1 release
Hardware: x86-64 (AMD64) Linux (All)
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks: Mail-Merge
  Show dependency treegraph
 
Reported: 2023-11-28 08:59 UTC by Matthias Naß
Modified: 2023-11-29 12:26 UTC (History)
2 users (show)

See Also:
Crash report or crash signature:


Attachments
The odf File I work with - Data in this file are public, so not dataprotection issue (878.91 KB, application/vnd.oasis.opendocument.text)
2023-11-28 11:27 UTC, Matthias Naß
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Matthias Naß 2023-11-28 08:59:27 UTC
On Ubuntu 23.10:

trying to produce 1454 mailletters into one PDF with two images. Same behaviour with creating odt.

After "creating documents..." which runs smoothly the system works forever at around 90% CPU on a Lenovo X220 with 10GB RAM. The gnome Dialog: "Application not responding, with "force quit" or "wait" emerges again and again if you choose "wait". If you let things just work out, LibreOffice crashes/closes after  ~ 3h. I tried the same Document with only 100 sets out of the database, and it works fine and smoothly, only a short delay after it "creating documents" dialog. I don't have time to check on what amount of mails it starts the observed behaviour.

AOpenOffice on a Lenovo X200 with 4GB RAM (Kubuntu 23.10) works with this 1454 Addresses and the same Document without Problems.
Comment 1 Stéphane Guillou (stragu) 2023-11-28 11:10:52 UTC
Can you please:
- test with several files as an output (say, 30 files)
- check if the files progressively get bigger (the first one the smallest, the last one the biggest)
- paste here your full version information copied from Help > About LibreOffice

You didn't get a dialog to report the crash?

And if possible, please share an example file for us to test too

Thank you!
Comment 2 Matthias Naß 2023-11-28 11:27:27 UTC
Created attachment 191078 [details]
The odf File I work with - Data in this file are public, so not dataprotection issue
Comment 3 Matthias Naß 2023-11-28 11:31:36 UTC
Version: 7.6.2.1 (X86_64) / LibreOffice Community
Build ID: 60(Build:1)
CPU threads: 4; OS: Linux 6.5; UI render: default; VCL: gtk3
Locale: de-DE (en_US.UTF-8); UI: en-US
Ubuntu package version: 4:7.6.2-0ubuntu1
Calc: threaded

I didn't get a crash dialog, all open LO Windows just closing without warning, and the tasks in htop are gone.

I tested with multiple PDF files output with 100 files - all files are between 102 and 104 kb big. So no growth of files.
Comment 4 Matthias Naß 2023-11-28 11:43:40 UTC
And one thing - during this 3h there is a PDF file created, but it stays at 0kb size until LO crashes, and afterwards it is still 0kb, and if you try to open it, it will be opened by ubuntu as plain text file. I probably can attach this 0kb file here.
Comment 5 Matthias Naß 2023-11-28 11:47:58 UTC
And one thing - during this 3h there is a PDF file created, but it stays at 0kb size until LO crashes, and afterwards it is still 0kb, and if you try to open it, it will be opened by ubuntu as plain text file.
Comment 6 QA Administrators 2023-11-29 03:14:37 UTC Comment hidden (obsolete)
Comment 7 Stéphane Guillou (stragu) 2023-11-29 12:26:59 UTC
This shouldn't be a memory problem as it would only hold about 150 mb at once if the output is 1454×102 kb.

I tested with your example file and a data source sheet with 1400 rows, using two fields inserted in the first frame.

A) Merge as separate documents:
When LO reports of "Creating documents", it takes about 2 seconds for 10 documents, so finishes in about 9 minutes.
- Then it gets to the Save step: after waiting for about a minute, it only saved the first PDF.

B) Merge as a single PDF:
- the same amount of time was needed in the "creating documents" step,
- but the Save step is frozen for ages and only finished after 16 minutes for me. The 22-mb file has the 1400 pages, as expected.

So I am seeing a different issue to you.
Could be worth it testing again with the recently released 7.6.3.

Version: 7.6.3.2 (X86_64) / LibreOffice Community
Build ID: 29d686fea9f6705b262d369fede658f824154cc0
CPU threads: 8; OS: Linux 5.15; UI render: default; VCL: gtk3
Locale: en-AU (en_AU.UTF-8); UI: en-US
Calc: threaded