IRC log for #koha, 2006-01-12

← Previous day | Today | Next day → | Search | Index

All times shown according to UTC.

Time Nick Message
11:55 kados did rach have her baby?
11:56 still four days till she's due right?
11:56 paul hello joshua. Good question. no news about this.
11:56 kados hi paul :-)
11:56 paul (38)
11:56 kados happy birthday :-)
11:57 paul and don't think error logs are clear...
11:57 kados what kinds of problems?
11:57 paul (clear : easy to understand)
11:57 (wrong translation i think here)
11:57 kados (I understood :-)
11:58 paul problems like having no error messages, a rebuild_zebra working really fast, but a small small zebra DB that makes me think i've sometihng wrong
11:58 kados paul: have you started zebra with the -vall option?
11:58 paul (mail on koha-zebra when nongnu.org choose to distribute it ;-) )
11:58 kados it shows more logs that way
11:59 paul yes, but no usefull info for me. I need some help to understand them i'm afraid
11:59 kados http://www.indexdata.dk/yaz/do[…]er.invocation.tkl
12:00 I think those work in Zebra as well as Yaz
12:00 paul what is PDU ?
12:01 kados it's the actual transaction between two Z3950 sources (server/client)
12:02 as close to human readable version of the Z3950 protocol as you can get
12:02 osmoze bonne anniversaire en retard alors Paul :)
12:02 kados so you start with a initRequest { }
12:02 then a initResponse { }
12:02 then searchRequest { }
12:03 then searchResponse { }
12:03 etc.
12:03 paul: a PDU dump is equiv to a tcpdump for TCP
12:05 hehe
12:05 PDU acronym for Protocol Data Unit ... but that's not a useful acronym IMO
12:06 paul: do you have an example PDU dump I can look at?
12:06 paul what does it look like ?
12:06 I have some zebrasrv logs.
12:06 kados well ... first you probably must specify a file for Zebra to dump PDU using  the -a flag
12:07 PDU dumps are very long :-)
12:07 here's the init section from one on my server:
12:07 initRequest {
12:07    protocolVersion BITSTRING(len=1)
12:07    options BITSTRING(len=2)
12:07    preferredMessageSize 1048576
12:07    maximumRecordSize 1048576
12:07    implementationId '81'
12:07    implementationName 'ZAP/YAZ'
12:07    implementationVersion '1.4.5/2.0.34'
12:07 }
12:07 initResponse {
12:07    protocolVersion BITSTRING(len=1)
12:07    options BITSTRING(len=2)
12:07    preferredMessageSize 1048576
12:07    maximumRecordSize 1048576
12:08    result TRUE
12:08    implementationId '/81'
12:08    implementationName '/GFS/YAZ'
12:08 paul OK, OK
12:08 kados    implementationVersion '/1.65/2.1.10'
12:08 }
12:08 initRequest comes from client Z3950 (ie perl-zoom in your case, yaz in the above case)
12:08 initResponse comes from the server (Zebra in your case, SimpleServer in the above case)
12:16 |hdl| happy birthday paul.
12:19 paul kados : copy of the mail i send 1mn ago on koha-zebra :
12:19 Paul POULAIN a écrit :
12:19 /me stupid, pls ignore the previous mail (with the loooooonnnnnnnggggggggg log)
12:19 If I do :
12:19 while ((my $biblionumber) = $sth->fetchrow) {
12:19    my $record = XMLgetbiblio($dbh,$biblionumber);
12:19    my $Zpackage = $Zconn->package();
12:19    $Zpackage->option(databaseName => 'Koha');
12:19    $Zpackage->option(action => "recordInsert");
12:19    $Zpackage->option(record => $record);
12:19    $Zpackage->send("update");
12:19    $Zpackage->destroy;
12:19    $i++;
12:19    print '.';
12:19    print "$i\r" unless ($i % 100);
12:19 }
12:19 (remove the eval { } on ->send() )
12:19 I get a :
12:19 ZOOM error 10002 "Encoding failed" from diag-set 'ZOOM'
12:19 (and a die)
12:19 Thus, I still have problems with the record model :-(
12:23 kados encoding failed eh?
12:26 paul: http://lists.indexdata.dk/pipe[…]ruary/000441.html
12:27 quoting: "The "encoding failed at target" error might smell like an yaz version
12:27 before 2.0.6 - that is the library /usr/lib/libyaz should come from a
12:27 debian package version 2.0.6 or 2.0.7. Check version number, and try
12:27 again with a newer one,
12:28 paul yaz-client -V
12:28 YAZ version: 2.1.10
12:28 kados well, probably not that then
12:33 well looks like "Encoding failed" is a ZOOM diagnostic set which is used for client-side error
12:34 http://lists.indexdata.dk/pipe[…]om/2003-March.txt
12:34 do a search on 'encoding failed' in that page
12:34 morning owen
12:34 owen Hi kados
12:35 paul (on phone)
13:03 back
13:04 kados : i don't understand where it is useful (i mean 2003-March.txt)
13:05 kados search on 'encoding failed' on that page
13:06 it describes what kind of error that is (IE, it's a ZOOM client-side error)
13:06 not too useful I agree
13:06 paul Yes, i've seen, but i don't understand
13:56 kados paul: do you have more errors in the log?
13:56 paul nope
13:56 just this ZOOM error 10002 "Encoding failed" from diag-set 'ZOOM
13:56 and PDU files show nothing.
13:56 kados here are the bib-1 diagnostics codes:
13:56 http://www.loc.gov/z3950/agenc[…]fns/bib1diag.html
13:56 but I don't see a 10002 in there
13:57 paul I already looked at this page (or a similar one, with the same 10002 missing value)
13:57 kados right ... perhaps it's an index data code
13:58 paul I really become mad with zebra.cfg & other files.
13:58 my main problem is that i can't be sure WHICH is the culprit : my code, my zebra config, zoom, zebra...
13:58 kados yep ... that is very frustrating
13:59 paul highly !
13:59 i won't be here for 2 days, back on friday.
13:59 kados I would suspect that Perl-ZOOM is the culprit
13:59 paul: could you commit your (non-working) code
13:59 paul: I may have some time to work on it
13:59 paul I'll commit my modified rebuild_zebra & zebra.cfg
13:59 (you won ;-) )
14:00 kados hehe
14:00 still no message on koha-devel ... savannah seems slower than sf :-)
14:02 paul for CVS no !
14:03 OK, commited
14:03 new sub in Biblio.pm, + unimarc zebra config files + misc/migration_tools/rebuild_zebra.pl
14:03 kados paul: why are we pulling XML out of mysql?
14:04 paul ?
14:04 kados paul: shouldn't it just be in Zebra?
14:04 sub XMLgetbiblio {
14:04 my $sth = $dbh->prepare('select marcxml from biblioitems where
14:04 biblionumber=?');
14:04 paul I don't know. Still investigating for instance.
14:04 kados in my opinion, we should only have one copy of the data
14:04 not one in mysql and one in zebra
14:05 (because zebra must have one for the index building anyway)
14:05 paul the problem with this is backing/restoring datas : 2 sources !
14:05 kados and it's hard to know if they are both in sync
14:05 I vote to store all bib data in zebra
14:05 paul (+ we could also have storeData:0, to have datas not in zebra )
14:05 kados hmmm
14:06 paul I think we should keep datas in both place until we are closer to 3.0 than today.
14:06 kados ok ... sounds reasonable
14:06 are you sure that mysql has utf-8 data?
14:06 paul (+ in fact, for instance, we have 3 instances of biblio : biblioitems.marc, biblioitems.xml and zebra)
14:06 kados (in your example on koha-devel message I just recieved)
14:07 yikes :-)
14:07 paul I think yes. Not 100% sure
14:07 kados because 'encoding problem' may indicate no :-)
14:08 paul dumping the xml record shows :
14:08 Collection Pédagogique de Télécommunicatio
14:08 that seems utf-8
14:09 (Collection P##dagogique => the ## is a é in utf-8)
14:10 kados paul: http://dev.mysql.com/doc/refma[…]set-defaults.html
14:11 it seems encoding in mysql is complex
14:12 paul yes, i've spend almost 2 complete day on it !
14:12 but I think now i've got it
14:12 kados here is another useful site:
14:12 http://dev.mysql.com/tech-reso[…]/4.1/unicode.html
14:12 what version of mysql are you using?
14:12 paul 4.1
14:14 kados also, I wonder if perl is to blame :-)
14:14 I don't know what DBI's support of utf-8 is like
14:15 paul my bet is that DBI has nothing to do with utf8
14:15 kados http://www.cpanforum.com/threads/654
14:16 paul did you read my mail jan, 04, on koha-devel ?
14:16 the chapter "the hard thing" was the main trick
14:17 kados right
14:21 paul: can you generate a utf-8 static MARC file and attempt to import it to see if you ge the same error?
14:25 paul I tried, with a record with ASCII only char, same problem
14:29 time to leave (6:30 PM)
14:29 see you on friday
14:29 (my 1st mail has arrived on koha-zebra ! another one has been posted. You can ignore this one
14:30 )
14:30 2nd one arrived too ;-)
14:39 kados by paul ... have a good week
06:03 si heh
06:39 _hdl_ Congratulations rach he is VERY cute.
06:39 si he certainly is
06:39 but I'd be biased :-)
07:01 _hdl_ you can be proud and happy ;)
07:04 si yes indeed

← Previous day | Today | Next day → | Search | Index

koha1