Forums

Subscribe via email Subscribe via email
Subscribe via rss
Guest
or Ask a Question
Add a reply View Replies (6) →
Robert
Robert
Offline
Issue

Mail lost between fetchmail and kopano

Resolved
0 votes
Hello,

I just realized, that no mails got delivered to kopano for some hours. I found the following additional things: no mails could be send (says saving mail failed in webapp), kopano presence was switched on (usually off).

After switching kopano presence off and restarting kopano server it worked again, though I have some mail, which did not get delivered. In my maillog I see fetchmail fetched some mails, but they never appeared in kopano.

How can I find out where those mails went?

Thank you for helping.

Best wishes,

Robert
In Kopano Basic
Friday, March 30 2018, 09:01 AM
Subscribe via email
Share this post:
Responses (6)

  • Accepted Answer

    Robert
    Robert
    Offline
    Friday, March 30 2018, 11:39 AM - #Permalink
    Resolved
    0 votes
    Dear Nick,

    Thank you very much for your quick help. I now know, that the emails arrived in kopano. I will try the kopano forum to find out where they end up, if they do not appear in the mail box.

    Best wishes,

    Robert
    The reply is currently minimized Show

  • Accepted Answer

    Nick Howitt
    Nick Howitt
    Offline
    Friday, March 30 2018, 11:34 AM - #Permalink
    Resolved
    0 votes
    I would tend to agree with your conclusion. Your log is pretty similar to mine and finished with postfix saying delivered via the mailpostfilter service. Can I suggest you try the Kopano forums?

    BTW I nearly pasted a whole mail message section of my mail log until I saw the amavis lines were so long.
    The reply is currently minimized Show

  • Accepted Answer

    Robert
    Robert
    Offline
    Friday, March 30 2018, 11:05 AM - #Permalink
    Resolved
    0 votes
    Dear Nick,

    Thank you for the quick reply and sorry for the spamming of the log. I was not sure, which line is important, but I do not have lmtp, probably because kopano does not use cyrus-imap:


    
Mar 30 08:04:18 server fetchmail[8639]: 1 message for robert.wieduwild at pop3.web.de (107475 octets).
    
Mar 30 08:04:18 server postfix/smtpd[23515]: connect from localhost[127.0.0.1]
    
Mar 30 08:04:19 server postfix/smtpd[23515]: 06E4318076F22: client=localhost[127.0.0.1]
    
Mar 30 08:04:19 server postfix/cleanup[23517]: 06E4318076F22: message-id=<807518599.2944802.1522389800148.JavaMail.app@lva1-app4402.prod.linkedin.com>
    
Mar 30 08:04:19 server fetchmail[8639]: reading message robert.wieduwild@pop3.web.de:1 of 1 (107475 octets) flushed
    
Mar 30 08:04:19 server postfix/qmgr[1963]: 06E4318076F22: from=<s-50yc2n1twqqnxl4xfcvfm2cpwdho5esg5p94twttrzvlfev05fii5um1@bounce.linkedin.com>, size=107777, nrcpt=1 (queue active)
    
Mar 30 08:04:19 server postfix/smtpd[23515]: disconnect from localhost[127.0.0.1]
    
Mar 30 08:04:19 server postfix/smtpd[23522]: connect from localhost[127.0.0.1]
    
Mar 30 08:04:19 server postfix/smtpd[23522]: 44E4518076F4A: client=localhost[127.0.0.1]
    
Mar 30 08:04:19 server postfix/cleanup[23517]: 44E4518076F4A: message-id=<807518599.2944802.1522389800148.JavaMail.app@lva1-app4402.prod.linkedin.com>
    
Mar 30 08:04:19 server postfix/qmgr[1963]: 44E4518076F4A: from=<s-50yc2n1twqqnxl4xfcvfm2cpwdho5esg5p94twttrzvlfev05fii5um1@bounce.linkedin.com>, size=107972, nrcpt=1 (queue active)
    
Mar 30 08:04:19 server postfix/smtpd[23522]: disconnect from localhost[127.0.0.1]
    
Mar 30 08:04:19 server postfix/pipe[23519]: 06E4318076F22: to=<robert.wieduwild@email.de@localhost>, orig_to=<robert.wieduwild@email.de@localhost.>, relay=mailprefilter, delay=0.36, delays=0.09/0.02/0/0.24, dsn=2.0.0, status=sent (delivered via mailprefilter service)
    
Mar 30 08:04:19 server postfix/qmgr[1963]: 06E4318076F22: removed
    
Mar 30 08:04:19 server amavis[14768]: (14768-01) ESMTP :10024 /var/lib/amavis/tmp/amavis-20180330T080419-14768-Fku2jlku: <s-50yc2n1twqqnxl4xfcvfm2cpwdho5esg5p94twttrzvlfev05fii5um1@bounce.linkedin.com> -> <"robert.wieduwild@email.de"@localhost.email.de> SIZE=107972 Received: from server.email.de ([127.0.0.1]) by localhost (server.email.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP for <"robert.wieduwild@email.de"@localhost.email.de>; Fri, 30 Mar 2018 08:04:19 +0200 (CEST)
    
Mar 30 08:04:19 server amavis[14768]: (14768-01) dkim: VALID Author+Sender signature by d=linkedin.com, From: <news@linkedin.com>, a=rsa-sha256, c=relaxed/relaxed, s=proddkim1024, i=@linkedin.com, ORIG [127.0.0.1]:42136, m.list(ml:https://www.linkedin.com/e/v2?e=dg1wq-jfcyygr4-jc&t=lun&midToken=AQHXSj74niZQLA&ek=email_feed_ecosystem_digest_01&li=32&m=unsub&ts=unsub&loid=AQFIs3Bm1Ru37wAAAWJ1gNO3ep7BfzPZqUNnDRqewBu10VZ_bxuizNoAe8C2SiXFuo74jz7WBnK0fUuB9QAZUJtHGPtZJ1mLyptj31yfK09z&eid=dg1wq-jfcyygr4-jc)
    
Mar 30 08:04:19 server amavis[14768]: (14768-01) dkim: VALID third-party signature by d=mailc.linkedin.com, From: <news@linkedin.com>, a=rsa-sha256, c=relaxed/relaxed, s=proddkim1024, i=@mailc.linkedin.com, ORIG [127.0.0.1]:42136, m.list(ml:https://www.linkedin.com/e/v2?e=dg1wq-jfcyygr4-jc&t=lun&midToken=AQHXSj74niZQLA&ek=email_feed_ecosystem_digest_01&li=32&m=unsub&ts=unsub&loid=AQFIs3Bm1Ru37wAAAWJ1gNO3ep7BfzPZqUNnDRqewBu10VZ_bxuizNoAe8C2SiXFuo74jz7WBnK0fUuB9QAZUJtHGPtZJ1mLyptj31yfK09z&eid=dg1wq-jfcyygr4-jc)
    
Mar 30 08:04:19 server amavis[14768]: (14768-01) Checking: XBpyNrMFOdTa [127.0.0.1] <s-50yc2n1twqqnxl4xfcvfm2cpwdho5esg5p94twttrzvlfev05fii5um1@bounce.linkedin.com> -> <"robert.wieduwild@email.de"@localhost.email.de>
    
Mar 30 08:04:19 server amavis[14768]: (14768-01) p003 1 Content-Type: multipart/alternative
    
Mar 30 08:04:19 server amavis[14768]: (14768-01) p001 1/1 Content-Type: text/plain, size: 9317 B, name:
    
Mar 30 08:04:19 server amavis[14768]: (14768-01) p002 1/2 Content-Type: text/html, size: 86252 B, name:
    
Mar 30 08:04:19 server amavis[14768]: (14768-01) dkim: candidate originators: From:<news@linkedin.com>, mail_from:<s-50yc2n1twqqnxl4xfcvfm2cpwdho5esg5p94twttrzvlfev05fii5um1@bounce.linkedin.com>
    
Mar 30 08:04:19 server amavis[14768]: (14768-01) dkim: not signing, empty signing domain, From: <news@linkedin.com>
    
Mar 30 08:04:19 server postfix/smtpd[23526]: connect from localhost[127.0.0.1]
    
Mar 30 08:04:19 server postfix/smtpd[23526]: ED30818076F6E: client=localhost[127.0.0.1]
    
Mar 30 08:04:19 server postfix/cleanup[23517]: ED30818076F6E: message-id=<807518599.2944802.1522389800148.JavaMail.app@lva1-app4402.prod.linkedin.com>
    
Mar 30 08:04:20 server postfix/qmgr[1963]: ED30818076F6E: from=<s-50yc2n1twqqnxl4xfcvfm2cpwdho5esg5p94twttrzvlfev05fii5um1@bounce.linkedin.com>, size=108658, nrcpt=1 (queue active)
    
Mar 30 08:04:20 server amavis[14768]: (14768-01) XBpyNrMFOdTa FWD from <s-50yc2n1twqqnxl4xfcvfm2cpwdho5esg5p94twttrzvlfev05fii5um1@bounce.linkedin.com> -> <"robert.wieduwild@email.de"@localhost.email.de>, BODY=7BIT 250 2.0.0 from MTA(smtp:[127.0.0.1]:10026): 250 2.0.0 Ok: queued as ED30818076F6E
    
Mar 30 08:04:20 server amavis[14768]: (14768-01) Passed CLEAN {RelayedInternal}, LOCAL [127.0.0.1]:42136 [108.174.3.162] <s-50yc2n1twqqnxl4xfcvfm2cpwdho5esg5p94twttrzvlfev05fii5um1@bounce.linkedin.com> -> <"robert.wieduwild@email.de"@localhost.email.de>, Queue-ID: 44E4518076F4A, Message-ID: <807518599.2944802.1522389800148.JavaMail.app@lva1-app4402.prod.linkedin.com>, mail_id: XBpyNrMFOdTa, Hits: -, size: 107971, queued_as: ED30818076F6E, dkim_sd=proddkim1024:linkedin.com,proddkim1024:mailc.linkedin.com, 660 ms
    
Mar 30 08:04:20 server postfix/smtp[23523]: 44E4518076F4A: to=<robert.wieduwild@email.de@localhost.email.de>, orig_to=<robert.wieduwild@email.de@localhost>, relay=127.0.0.1[127.0.0.1]:10024, delay=0.76, delays=0.06/0.03/0.01/0.66, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10026): 250 2.0.0 Ok: queued as ED30818076F6E)
    
Mar 30 08:04:20 server postfix/qmgr[1963]: 44E4518076F4A: removed
    
Mar 30 08:04:20 server amavis[14768]: (14768-01) size: 107971, TIMING [total 668 ms] - SMTP greeting: 8 (1%)1, SMTP EHLO: 1.8 (0%)1, SMTP pre-MAIL: 1.8 (0%)2, mkdir tempdir: 2.5 (0%)2, create email.txt: 0.6 (0%)2, SMTP pre-DATA-flush: 6 (1%)3, SMTP DATA: 71 (11%)14, check_init: 1.2 (0%)14, digest_hdr: 16 (2%)16, digest_body_dkim: 109 (16%)33, collect_info: 14 (2%)35, mkdir parts: 2.7 (0%)35, mime_decode: 63 (9%)45, get-file-type2: 74 (11%)56, parts_decode: 0.4 (0%)56, check_header: 1.2 (0%)56, AV-scan-1: 181 (27%)83, decide_mail_destiny: 1.1 (0%)83, notif-quar: 0.8 (0%)83, fwd-connect: 35 (5%)89, fwd-mail-pip: 5 (1%)89, fwd-rcpt-pip: 0.4 (0%)89, fwd-data-chkpnt: 0.1 (0%)89, write-header: 2.4 (0%)90, fwd-data-contents: 2.9 (0%)90, fwd-end-chkpnt: 44 (7%)97, prepare-dsn: 1.5 (0%)97, report: 2.9 (0%)98, main_log_entry: 10 (2%)99, update_snmp: 4.1 (1%)100, SMTP pre-response: 0.5 (0%)100, SMTP response: 0.3 (0%)100, unlink-3-files: 0.8 (0%)100, rundown: 1.0 (0%)100
    
Mar 30 08:04:20 server amavis[14768]: (14768-01) extra modules loaded: Net/DNS/RR/CNAME.pm, Net/DNS/RR/OPT.pm
    
Mar 30 08:04:20 server postfix/pipe[23528]: ED30818076F6E: to=<robert.wieduwild@email.de>, orig_to=<robert.wieduwild@email.de@localhost.email.de>, relay=mailpostfilter, delay=0.64, delays=0.05/0.02/0/0.57, dsn=2.0.0, status=sent (delivered via mailpostfilter service)
    
Mar 30 08:04:20 server postfix/qmgr[1963]: ED30818076F6E: removed


    It looks to me, like the mail got delivered to kopano (delivered via mailpostfilter service), but got lost in kopano itself.

    Best wishes,

    Robert
    The reply is currently minimized Show

  • Accepted Answer

    Nick Howitt
    Nick Howitt
    Offline
    Friday, March 30 2018, 09:33 AM - #Permalink
    Resolved
    0 votes
    I checked up and the routing does appear to be Fetchmail > Postfix > Kopano, which means the e-mails should be stick in kopano which I don't know at all. In your mail log you should be able to checl by following the log through from an incoming mail. In my case I see towards the end of an e-mail transaction:
    Mar 30 10:22:07 server amavis[10545]: (10545-01) ...nk-2-files: 0.2 (0%)100, rundown: 0.5 (0%)100
    
Mar 30 10:22:07 server lmtp[8405]: Delivered: <2ae418cb3d75b8d389ece40e383a89c3@www.clearos.com>; to mailbox: user.nick
    
Mar 30 10:22:07 server lmtp[8405]: USAGE nick user: 0.002094 sys: 0.002094
    
Mar 30 10:22:07 server postfix/pipe[8402]: 4F40D4028365: to=<nick@howitts.co.uk>, relay=mailpostfilter, delay=0.33, delays=0.05/0.01/0/0.26, dsn=2.0.0, status=sent (delivered via mailpostfilter service)
    
Mar 30 10:22:07 server postfix/qmgr[15360]: 4F40D4028365: removed
    You have amavis finishing its spam checking and handing over to lmtp which delivers it to "mailbox: user.nick". This is my cyrus-imap mailbox.

    Can you see how far your's got in the mail processing?
    The reply is currently minimized Show

  • Accepted Answer

    Robert
    Robert
    Offline
    Friday, March 30 2018, 09:20 AM - #Permalink
    Resolved
    0 votes
    Dear Nick,

    Thanks for your quick reply. That was the first thing I checked, but the postfix queue is empty.

    Best wishes,

    Robert
    The reply is currently minimized Show

  • Accepted Answer

    Nick Howitt
    Nick Howitt
    Offline
    Friday, March 30 2018, 09:15 AM - #Permalink
    Resolved
    0 votes
    If the mail routing is Fetchmail > Postfix > Kopano, then, with luck, it is held in the postfix queue. Have a look at these references, among others: http://www.tech-g.com/2012/07/15/inspecting-postfixs-email-queue/
    https://www.wirehive.com/thoughts/5-top-tips-reviewing-postfix-mail-queue/

    Or google something like "postfix queue"
    The reply is currently minimized Show
Your Reply