[prev in list] [next in list] [prev in thread] [next in thread] 

List:       info-cyrus
Subject:    Re: Loading CalDav calendars
From:       Nic Bernstein via Info-cyrus <info-cyrus () lists ! andrew ! cmu ! edu>
Date:       2016-10-27 22:10:01
Message-ID: d3e0d12d-aed8-e0a3-9b89-f12cfc9d6c07 () onlight ! com
[Download RAW message or body]

[Attachment #2 (multipart/alternative)]


Good people,
Forgive me for wasting list bandwidth, but we've found a solution in 
DaviCal's own sync-remote-caldav.php script.  We've simply applied this 
ACL -- sam user.%.#calendars.% <admin> all -- and then use that user's 
credentials to authenticate.

    scripts/sync-remote-caldav.php -u \
http://<cyrus-server>:8008/dav/calendars/user/<user>/Default -U <admin> -p <password> \
-c /<user>/Default/ -o

Thought it best to reply to myself, again, so anyone else looking for 
this solution will find this.

Cheers,
     -nic

On 10/27/2016 04:32 PM, Nic Bernstein via Info-cyrus wrote:
> Oh, and for completeness, here's the ACLs on the calendars, lest you 
> think we didn't think of that:
> 
> > lam user.nic.#calendars.%
> user.nic.#calendars.Default:
> anyone 9
> nic lrswipkxtecdan
> user.nic.#calendars.Inbox:
> nic lrswipkxtecdan
> anyone 789
> user.nic.#calendars.Outbox:
> nic lrswipkxtecdan
> 
> Also, it's quite clear after looking in the mail store for a 
> #calendars folder that simply dropping ics files in there will do no 
> good whatsoever.
> -nic
> 
> On 10/27/2016 04:25 PM, Nic Bernstein via Info-cyrus wrote:
> > Friends,
> > We're finally starting to play seriously with the CalDav 
> > implementation in Cyrus 2.5.10.  We've flirted with it in the past, 
> > having been building our own packages from the 2.4.x+caldav-beta 
> > lines for years, but now we're trying to actually move from our old 
> > CYrus IMAP/DaviCal combination to just Cyrus IMAP.
> > 
> > The CalDav support seems to work fine with our clients -- 
> > Thunderbird/Lightning, Android, etc. -- but while we can use Cadaver 
> > to pull perfectly good ics extracts from our old DaviCal server via 
> > 'get' and 'mget' operations, we are unable to upload those to Cyrus 
> > with Cadaver.  Here's what we see:
> > 
> > [CLIENT]
> > dav:/dav/calendars/user/nic/Default/> \
> > putu4q405ehiej47e0b7eiuk1fiac@google.com.ics \
> > Uploadingu4q405ehiej47e0b7eiuk1fiac@google.com.ics  to \
> >                 `/dav/calendars/user/nic/Default/u4q405ehiej47e0b7eiuk1fiac%40google.com.ics':
> >                 
> > Progress: [=============================>] 100.0% of 936 bytes failed:
> > 403 Forbidden
> > 
> > [SERVER]
> > Oct 27 16:13:43 newjiji cyrus/http[10166]: login: rrcs-YADDA.central.biz.rr.com \
> > [A.B.C.D] nic Basic User logged in \
> >                 SESSIONID=<cyrus-10166-1477602805-1-3052002669091542334>
> > Oct 27 16:13:43 newjiji cyrus/http[10166]: rrcs-YADDA.central.biz.rr.com \
> > [A.B.C.D] as "nic" with "cadaver/0.23.3 neon/0.30.1"; "PUT \
> > /dav/calendars/user/nic/Default/u4q405ehiej47e0b7eiuk1fiac%40google.com.ics \
> > HTTP/1.1" => "403 Forbidden" 
> > We really don't want to lose the event histories we have in the 
> > calendars, some of which are >1k entries long, but cannot find a good 
> > way to get the data into Cyrus.  Could we do so by simply dumping the 
> > ics files into the mailbox directory, running a reconstruct and 
> > restarting?
> > 
> > I've tried using Lightning's import function, but it barfs after a 
> > few hundred entries, leaving the collection in an unusable state.  
> > The only sure-fire way to recover from that is to blow away and 
> > recreate the collection.  Obviusly a suboptimal solution.
> > 
> > We had even worse luck with Evolution, which wouldn't import at all.
> > 
> > Any ideas?
> > -nic
> > -- 
> > Nic Bernsteinnic@onlight.com
> > Onlight, Inc.www.onlight.com
> > 6525 W Bluemound Road, Suite 24           v. 414.272.4477
> > Milwaukee, Wisconsin  53213-4073
> > 
> > 
> > ----
> > Cyrus Home Page:http://www.cyrusimap.org/
> > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> > To Unsubscribe:
> > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
> 
> -- 
> Nic Bernsteinnic@onlight.com
> Onlight, Inc.www.onlight.com
> 6525 W Bluemound Road, Suite 24           v. 414.272.4477
> Milwaukee, Wisconsin  53213-4073
> 
> 
> ----
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

-- 
Nic Bernstein                             nic@onlight.com
Onlight, Inc.                             www.onlight.com
6525 W Bluemound Road, Suite 24           v. 414.272.4477
Milwaukee, Wisconsin  53213-4073


[Attachment #5 (text/html)]

<html>
  <head>
    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    Good people,<br>
    Forgive me for wasting list bandwidth, but we've found a solution in
    DaviCal's own sync-remote-caldav.php script.  We've simply applied
    this ACL -- sam user.%.#calendars.% &lt;admin&gt; all -- and then
    use that user's credentials to authenticate.<br>
    <blockquote>
      <pre>scripts/sync-remote-caldav.php -u <a class="moz-txt-link-freetext" \
href="http://">http://</a>&lt;cyrus-server&gt;:8008/dav/calendars/user/&lt;user&gt;/Default \
-U &lt;admin&gt; -p &lt;password&gt; -c /&lt;user&gt;/Default/ -o </pre>
    </blockquote>
    Thought it best to reply to myself, again, so anyone else looking
    for this solution will find this.<br>
    <br>
    Cheers,<br>
        -nic<br>
    <br>
    <div class="moz-cite-prefix">On 10/27/2016 04:32 PM, Nic Bernstein
      via Info-cyrus wrote:<br>
    </div>
    <blockquote
      cite="mid:21681378-10ef-016a-d4c0-88392e576c6d@onlight.com"
      type="cite">
      <meta content="text/html; charset=windows-1252"
        http-equiv="Content-Type">
      Oh, and for completeness, here's the ACLs on the calendars, lest
      you think we didn't think of that:<br>
      <blockquote>
        <pre>&gt; lam user.nic.#calendars.%                                           \
 user.nic.#calendars.Default:
  anyone 9
  nic lrswipkxtecdan
user.nic.#calendars.Inbox:
  nic lrswipkxtecdan
  anyone 789
user.nic.#calendars.Outbox:
  nic lrswipkxtecdan
</pre>
      </blockquote>
      Also, it's quite clear after looking in the mail store for a
      #calendars folder that simply dropping ics files in there will do
      no good whatsoever.<br>
          -nic<br>
      <br>
      <div class="moz-cite-prefix">On 10/27/2016 04:25 PM, Nic Bernstein
        via Info-cyrus wrote:<br>
      </div>
      <blockquote
        cite="mid:cf1f240a-bd4d-b2a8-70f3-735c225480de@onlight.com"
        type="cite">
        <meta http-equiv="content-type" content="text/html;
          charset=windows-1252">
        Friends,<br>
        We're finally starting to play seriously with the CalDav
        implementation in Cyrus 2.5.10.  We've flirted with it in the
        past, having been building our own packages from the
        2.4.x+caldav-beta lines for years, but now we're trying to
        actually move from our old CYrus IMAP/DaviCal combination to
        just Cyrus IMAP.<br>
        <br>
        The CalDav support seems to work fine with our clients --
        Thunderbird/Lightning, Android, etc. -- but while we can use
        Cadaver to pull perfectly good ics extracts from our old DaviCal
        server via 'get' and 'mget' operations, we are unable to upload
        those to Cyrus with Cadaver.  Here's what we see:<br>
        <blockquote>
          <pre>[CLIENT]
dav:/dav/calendars/user/nic/Default/&gt; put <a moz-do-not-send="true" \
class="moz-txt-link-abbreviated" \
href="mailto:u4q405ehiej47e0b7eiuk1fiac@google.com.ics">u4q405ehiej47e0b7eiuk1fiac@google.com.ics</a>
 Uploading <a moz-do-not-send="true" class="moz-txt-link-abbreviated" \
href="mailto:u4q405ehiej47e0b7eiuk1fiac@google.com.ics">u4q405ehiej47e0b7eiuk1fiac@google.com.ics</a> \
                to `/dav/calendars/user/nic/Default/u4q405ehiej47e0b7eiuk1fiac%40google.com.ics':
                
Progress: [=============================&gt;] 100.0% of 936 bytes failed:
403 Forbidden

[SERVER]
Oct 27 16:13:43 newjiji cyrus/http[10166]: login: rrcs-YADDA.central.biz.rr.com \
[A.B.C.D] nic Basic User logged in \
                SESSIONID=&lt;cyrus-10166-1477602805-1-3052002669091542334&gt;
Oct 27 16:13:43 newjiji cyrus/http[10166]: rrcs-YADDA.central.biz.rr.com [A.B.C.D] as \
"nic" with "cadaver/0.23.3 neon/0.30.1"; "PUT \
/dav/calendars/user/nic/Default/u4q405ehiej47e0b7eiuk1fiac%40google.com.ics HTTP/1.1" \
=&gt; "403 Forbidden" </pre>
        </blockquote>
        We really don't want to lose the event histories we have in the
        calendars, some of which are &gt;1k entries long, but cannot
        find a good way to get the data into Cyrus.  Could we do so by
        simply dumping the ics files into the mailbox directory, running
        a reconstruct and restarting?<br>
        <br>
        I've tried using Lightning's import function, but it barfs after
        a few hundred entries, leaving the collection in an unusable
        state.  The only sure-fire way to recover from that is to blow
        away and recreate the collection.  Obviusly a suboptimal
        solution.<br>
        <br>
        We had even worse luck with Evolution, which wouldn't import at
        all.<br>
        <br>
        Any ideas?<br>
            -nic<br>
        <pre class="moz-signature" cols="72">-- 
Nic Bernstein                             <a moz-do-not-send="true" \
class="moz-txt-link-abbreviated" href="mailto:nic@onlight.com">nic@onlight.com</a> \
Onlight, Inc.                             <a moz-do-not-send="true" \
class="moz-txt-link-abbreviated" href="http://www.onlight.com">www.onlight.com</a> \
6525 W Bluemound Road, Suite 24           v. 414.272.4477 Milwaukee, Wisconsin  \
53213-4073 </pre>
        <br>
        <fieldset class="mimeAttachmentHeader"></fieldset>
        <br>
        <pre wrap="">----
Cyrus Home Page: <a moz-do-not-send="true" class="moz-txt-link-freetext" \
href="http://www.cyrusimap.org/">http://www.cyrusimap.org/</a> List Archives/Info: <a \
moz-do-not-send="true" class="moz-txt-link-freetext" \
href="http://lists.andrew.cmu.edu/pipermail/info-cyrus/">http://lists.andrew.cmu.edu/pipermail/info-cyrus/</a>
 To Unsubscribe:
<a moz-do-not-send="true" class="moz-txt-link-freetext" \
href="https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus">https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus</a></pre>
  </blockquote>
      <br>
      <pre class="moz-signature" cols="72">-- 
Nic Bernstein                             <a moz-do-not-send="true" \
class="moz-txt-link-abbreviated" href="mailto:nic@onlight.com">nic@onlight.com</a> \
Onlight, Inc.                             <a moz-do-not-send="true" \
class="moz-txt-link-abbreviated" href="http://www.onlight.com">www.onlight.com</a> \
6525 W Bluemound Road, Suite 24           v. 414.272.4477 Milwaukee, Wisconsin  \
53213-4073 </pre>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">----
Cyrus Home Page: <a class="moz-txt-link-freetext" \
href="http://www.cyrusimap.org/">http://www.cyrusimap.org/</a> List Archives/Info: <a \
class="moz-txt-link-freetext" \
href="http://lists.andrew.cmu.edu/pipermail/info-cyrus/">http://lists.andrew.cmu.edu/pipermail/info-cyrus/</a>
 To Unsubscribe:
<a class="moz-txt-link-freetext" \
href="https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus">https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus</a></pre>
  </blockquote>
    <br>
    <pre class="moz-signature" cols="72">-- 
Nic Bernstein                             <a class="moz-txt-link-abbreviated" \
href="mailto:nic@onlight.com">nic@onlight.com</a> Onlight, Inc.                       \
<a class="moz-txt-link-abbreviated" href="http://www.onlight.com">www.onlight.com</a> \
6525 W Bluemound Road, Suite 24           v. 414.272.4477 Milwaukee, Wisconsin  \
53213-4073 </pre>
  </body>
</html>


["nic.vcf" (text/x-vcard)]

----
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic