IRC log for #koha, 2005-06-25

← Previous day | Today | Next day → | Search | Index

All times shown according to UTC.

Time Nick Message
12:03 hdl thd :  is z3950-daemon-options all right ?
12:07 thd hdl: looks fine to me but I have no working copy for comparison
12:20 hdl thd :here is mine
12:20 RunAsUser=hdl
12:20 KohaZ3950Dir=/home/hdl/Koha/koha-dev/koha/z3950
12:20 KohaModuleDir=/home/hdl/Koha/koha-dev/koha/C4
12:20 LogDir=/var/log/koha
12:20 KohaConf=/etc/koha/koha-head.conf
12:22 thd : are you trying some z3950 tests with slef ?
12:25 thd hdl: no slef appeared, said good morning, then said broken, and then seemed absent
12:29 hdl: I have a task switching problem and need to restart x-windows
12:37 hdl: Is there a known set of diagnostic tests for the Koha z3950 that I might be checking?
12:53 hdl: My z3950deamon options are the default options and look good to me
12:53 RunAsUser=www
12:53 KohaZ3950Dir=/usr/local/koha/​intranet/scripts/z3950daemon
12:53 KohaModuleDir=/usr/local/koha/intranet/modules
12:53 LogDir=/usr/local/koha/log
12:53 KohaConf=/etc/koha.conf
12:55 hdl: unless you have a clue otherwise, I suspect the daemon process itself has a problem
12:56 hdl try processz3950queue
12:57 thd hdl: try what with processz3950queue?
12:57 hdl thd : sorry : was away.
12:57 Try to launch processz3950queue in a console.
12:57
12:57 Beware .
12:58 You must export KOHA_CONF and PERL5LIB.
12:58 And then you launch processz3950queue
12:59 But you must have a good z3950 perl install.
12:59 You could also search in this direction.
13:01 Pls Forgive me.
13:01 I go to lunch
13:03 thd hdl: I have been told that eating is important :)
13:16 sylvain I've a perl problem, I've 10 files to bulkmarcimport so I've written a text file with the 10 calls to bulkmarck import and then I ./myBat but I get a problem. When I type the call to bulkmarcimport by hand, it works correctly but when I use my "bat", the char_decode function only return what is given in entry without transcoding (unnimarc)
13:28 shit ! in fact my line was ..... -c UNIMARC and the EOL was added to my argument :(
13:31 I should haven't edited my file under windows before using it on linux
13:31 stupid boy !!!!
13:54 thd hdl: for your return console produced something for unfinished z3950 searches but no joy yet.
13:55 hdl: I will return later
15:18 slef hello
15:27 rach hello
15:34 slef mmm dinner
16:55 thd_ slef: are you back from dinner?
17:48 slef thd: yes
18:27 thd slef: Did you mean to say ealier that koha z39.50 services are currently broken?
20:03 slef I mean that your z39.50 daemon looks broken.
20:05 thd slef: how can I fix it?
01:58 hdl hi
02:07 osmoze hello
02:15 sylvain hi all
02:16 is it normal that if I bulkmarcimport files one after one, even if all the files are the same size (10 000 records) it goes more and more slowly
02:16 ?
02:39 hdl If you import things into the same database, it is logical : The DB gets bigger and bigger ;)
02:39 => more and more mem used ;)
02:44 sylvain in french sorry : Oui mais je pensais que mysql ne perdait pas tant que ça dés que la base augmentait ... Là c'est presque du simple au double pour 70 000 notics
03:35 hdl Can you give some figures of computing time ?
03:41 sylvain yes, just 2 seconds
03:41 indradg kados, around?
03:43 sylvain 7 mo --> 35 minutes8 mo --> 55 minutes8 mo --> 1h 10 minutes9 mo --> 1h 20 minutes7 mo --> 1h 20 minutes8 mo --> 1h 25 minutes
03:43 these are the figures hdl size --> time
03:53 hdl Sylvain : thx. Increase seems to be logical since any addition must search database for doubles. But maybe you could ask on koha-fr for some performance on bulkmarcimport to compare with. Think about asking for configuration and amount of biblio imported.
04:49 sylvain cette marc_word_table est vraiment chiante dès qu'il y a des gros volumes de données à gérer/charger
04:52 hdl C'est un peu pour cela que l'on étudie le passage à autre chose... Zebra.
04:52 ;)
04:54 sylvain oui je sais :) mais j'avais tjs travaillé avec des relativement petites bases mais aujourd'hui, je souffre :)
05:20 hdl sylvain : Paul avait fait un POC de table inverse pour avoir une efficacité accrue au niveau des recherches. Tu peux essayer de tester... Si le coeur et le temps te le permettent.
05:24 POC :  Proof Of Concept...
05:25 En tout cas, lui, il avait eu un gain en perf assez impressionnant.... Après l'indexation des éléments qui prenait un certain temps toutefois... Et je ne parle pas de l'occupation mémoire de la base ;)
05:35 sylvain oui hdl j'avais vu sa poc, c'était en effet assez impressionant
05:35 mais pas trop le temps en ce moment de m'y pencher :(
05:38 hdl C'était juste une suggestion;). dtf, puisqu'on se tourne vers Zebra, c'est maintenant plus histoire de dire que paul avait déjà bien pensé et même presque résolu le problème qu'autre chose.  
07:15 slef kados: when will 2.3.0 be?
07:18 paul_away: can you buzz me when you get back, please? I have auto_install questions.
08:00 thd hdl: I can run processz3950queue in console mode and get the previous incomplete lookup
08:08 hdl thd : yes...  do you get answers ?
08:12 thd 17403/10 : Processing isbn=0596003137 at UNIVERSITY OF CALIFORNIA MELVYL melvyl.cdlib.org:210 CDL90 USMARC (1 forks)
08:12 17403/10 : 2 >>
08:12 17403/10 : creating and 17403/10 : working on results entry 11
08:12 17403/10 : connected to UNIVERSITY OF CALIFORNIA MELVYL
08:12 17403/10 : UNIVERSITY OF CALIFORNIA MELVYL : 1 records found, retrieving them (max 80)
08:12 17403/10 : melvyl.cdlib.org:210 search done.
08:14 kdl: yet no record in the breeding farm
08:39 hdl thd : seems to me that you are trying to get a biblio that you already have in you base.
08:40 Have you verified ?
08:45 thd hdl: verified?
08:46 hdl: what and where is my 'base'?
08:52 hdl: the isbn comes from my last attempt to find a record over z39.50 where the daemon was most likely not running
08:53 hdl: does the su user for the daemon need a login?
08:56 slef thd: it needs a user, existing in /etc/passwd or whereever your users come from. What do you mean 'login'?
08:57 thd slef: no password for that user for security
08:57 slef: user www
08:58 slef does it have a shell?
08:59 thd slef: yes, www did not formerly for security, but I obviusly had to ad one to try to run the daemon.
08:59 slef that's not the problem
08:59 then
09:00 :-/
09:00 thd slef: any clue, something to test?
09:03 slef no, normal tricks, read the log files, try running them with sh -x and so on
09:04 thd slef: if you read the previous communication to hdl I can get processz3950queue to do something with the previous incomplete record search.
09:05 slef: nothing relevant appears in the logs
09:05 slef does anything appear?
09:06 as in the daemon log, not apache logs
09:06 thd slef: yes, but nothing related to z39.50 record searches, daemons, or otherwise
09:07 slef how can there be nothing about daemons in the z3950 daemon log?
09:08 thd slef: It seems that the daemon may never have run
09:09 slef: I have tried to start the daemon launcher as root assuming the daemon will assume the www user id
09:11 slef yes, that should work
09:11 you can also su to www and try running the daemon directly
09:11 thd slef: what process name should I see running ulimately if it does work?
09:11 slef have you set the environment variables KOHA_CONF and PERL5LIB?
09:12 perl :-/
09:12 thd slef: perl?
09:12 slef yes, it appears in ps as perl, I think
09:12 I've not got a working z3950 daemon at the moment to test (don't ask)
09:13 thd slef: ok, I had not understood the question that was answered there
09:14 slef: yours is broken too :- /
09:14 slef yes, hasn't worked in 2.2
09:15 I guess I should just let jared have the installer and I'll go nuts on the biblio entry side
09:15 I want to finish the basic cleanups first, though
09:18 hdl thd : sorry I was on a hot potatoe and it didn't ring me when you wrote.
09:38 thd slef: sorry lost connection for some minutes
09:40 slef: and you have not solved your broken daemon or have not bothered?
09:40 slef: Is there a difference, possibly unintended, in upgraded as opposed to newly created installs that may cause a problem?
09:40 slef not solved... not tried for a little while
09:41 no, a new test install didn't work either
09:41 hdl thd: I said You may already have the notice in your database. have you verified if you had it already ?
09:41 look in your catalogue.
09:42 thd hdl: for the biblio?
09:42 hdl yes.
09:42 thd hdl: It is not found searching the breeding farm
09:42 hdl When you already have the biblio you try to get with z3950. It simply doesn't import it.
09:43 Not in the breeding form, in your catalogue.
09:43 Try to search for a book you are SURE you donot have.
09:44 Evangelium Vitae if you are not a religious library.
09:45 Or Learning PERL If you donot have computer science books.
09:45 But beware. Run procesz3950 before to see the log process ;).
09:45 thd hdl: I get the same negative results for books I am sure I do not have as for those I was hoping to have.
09:46 hdl: nothing ever appears in the z3950 log, ever
09:47 hdl 17403/10 : Processing isbn=0596003137 at UNIVERSITY OF CALIFORNIA MELVYL melvyl.cdlib.org:210 CDL90 USMARC (1 forks)
09:47 [15:12:48] <thd> 17403/10 : 2 >>
09:47 [15:12:48] <thd> 17403/10 : creating and 17403/10 : working on results entry 11
09:47 [15:12:48] <thd> 17403/10 : connected to UNIVERSITY OF CALIFORNIA MELVYL
09:47 [15:12:48] <thd> 17403/10 : UNIVERSITY OF CALIFORNIA MELVYL : 1 records found, retrieving them (max 80)
09:47 [15:12:49] <thd> 17403/10 : melvyl.cdlib.org:210 search done.
09:47 seems to me there is an answer ;)
09:47 thd hdl: I know that should be in the log but it never was
09:47 hdl 1 record found.
09:48 where hav you taken those lines then ?
09:48 thd hdl: the daemon seems to have never been running
09:48 hdl: those lines were from the console
09:49 hdl Leave aside the daemon for now. You say it is z3950 client from Koha that is broken. Let's test it deeply.
09:49 thd hdl: I piped them to a file so I could report them after confirming again that the log was empty
09:49 hdl: ok
09:50 hdl: how?
09:50 hdl so Can you launch processz3950 in a console after having set KOHA_CONF AND PERL5LIB.
09:51 processz3950queue sorry...
09:51 thd hdl: yes, hence the lines reported
09:52 hdl: Is there a way of passing values to processz3950queue without using koha
09:52 hdl so lets try a new search on a book you never had but are sure to get from the library you ask to.
09:52 thd: Don't think so.
09:53 In fact, it is just a loop that gets data from Koha and send it to the z3950 server through perl.
09:54 You can also test with perl...
09:54 thd hdl: But, I must supply the ISBN within Koha
09:56 hdl: since I cannot pass the ISBN directly to processz3950queue from the command line?
09:59 hdl You can also pass a title or an author name ;)
10:01 thd hdl: I was uncertain that the interface supported other than Isbn record searches currently, I was going to fix the issue if it was restricted to isbn only
10:02 hdl It is not restrected to isbn. I can assure you.
10:03 thd hdl: Good, I wondered what the special mark for ISBN was for.
10:05 hdl: I should enter the isbn, author, or title in the add marc dialogue and the press the search button or then run processz3950queue from the command line?
10:06 hdl First: run ONE processz3950queue on a command line.
10:06 thd hdl: we know the ideal answer is the button, but for your test.
10:06 hdl: using what user name?
10:07 hdl Enter then one author and press the search button.
10:07 When using processz3950queue, it copes with user names form you daemon options.
10:07 thd hdl: I run processz3950queue in advance of the search?
10:08 hdl Yes.
10:09 It will wait, receive your search strings, fork, send search query, wait for reply... And you should have some answer.
10:13 thd hdl: well, as I had seen previously it first works with the previous incomplete search.
10:13 hdl: that is what happened just now, with the same ISBN I had been using to test.
10:15 hdl: I will now run processz3950queue again.  Now that the previous run has worked with the old ISBN.
10:16 hdl thd : you can let processz3950 run in background ;))))
10:17 But you really ought to test with an unknown bokk, sot that you could get an answer.
10:17 I had that problem once, couldn't get around. And I realized weeks later it already worked fine ;)
10:17 thd hdl: I never get the command prompt back when when running processz3950queue as a foreground process.  I had always used ^C to abort the process when the prompt did not return.
10:18 hdl you can have multiple console with Konsole ;)
10:19 thd hdl: Is konsole a KDE thing? : )
10:21 hdl yes, but anyway, you can have more than one console... tty1,2,3,4,5,6...
10:22 But always with Linux.
10:25 thd ???
10:29 thd hdl: just a moment, I had run processz3950queue with sudo and had to kill the process running in background seemed to cause a strange presentation of the password prompt for the sudo command.
10:34 hdl: well, at least this is different.  "still ?? requests to go" followed by "still 1 request to go" followed by "The requested URL /cgi-bin/koha/z3950/0 was not found on this server".
10:35 slef hdl: screen does that for most people.
10:39 hdl strange : It works fine for me.
10:39 thd hdl: what works fine for you>
10:40 hdl It shows me the results.
10:41 I don't use the deamon. But procesz3950queue shows me good results.
10:42 thd hdl: why would anyone ever get "The requested URL /cgi-bin/koha/z3950/0 was not found on this server" as the final page appearing on the popup search window?
10:44 hdl: that is more satisfying than a perpetual "still ?? requests to go" ; )
10:48 hdl: in console I get 3 records found now.  I had only reported the popup before.
10:49 hdl thd : I searched for java at Lyon :
10:49 here are my results :
10:49 19004/45 : Processing title=JAVA at LYON3 193.52.199.5:21210 ADVANCE MARC21 (1 forks)
10:49 19005/45 : Processing title=JAVA at KOHATEST localhost:9999 kohatest UNIMARC (2 forks)
10:50 19004/45 : 2 >>
10:50 19004/45 : creating and 19004/45 : working on results entry 71
10:50 19004/45 : connected to LYON3
10:50 @attr 1=4 "JAVA"19004/45 : LYON3 : 66 records found, retrieving them (max 80)
10:50 19005/45 : no connection at KOHATEST
10:50 19005/45 : localhost:9999 search done.
10:50 19004/45 : LYON3 : 193.52.199.5:21210 records retrieved 66 SPEED: 3
10:50 19004/45 : 193.52.199.5:21210 search done.
10:50
10:50 and the popup shows :
10:50 Résultats de la recherche Z39.50
10:50 Notices trouvées
10:50 Titre Auteur ISBN venant de  
10:50 Indonésie Élisabeth Richard, Antoinette Vicart 2700308018 Z3950-LYON3 Importer cette notice
10:51 Le grand guide de Java 2070588300 Z3950-LYON3 Importer cette notice
10:51 Programmation Java Jean-François Macary, Cédric Nicolas 2212089163 Z3950-LYON3 Importer cette notice
10:51 Formation à Java Stephen R. Davis 284082177X Z3950-LYON3 Importer cette notice
10:51 HTLM & Java L. Viegnes & S. Boix 2742907335 Z3950-LYON3 Importer cette notice
10:51 L'art de l'Asie du Sud-Est Philip Rawson 2878110889 Z3950-LYON3 Importer cette notice
10:51 Java Gilles Clavel, Nicolas Mirouze, Emmanuel Pichon... 2729606564 Z3950-LYON3 Importer cette notice
10:51 Lieux d'Islam dirigé par Mohammad Ali-Moezzi 2862605808 Z3950-LYON3 Importer cette notice
10:51 Les langages de développement sur Web Imad Saleh 2866015428 Z3950-LYON3 Importer cette notice
10:51 Java client-serveur 2212089384 Z3950-LYON3 Importer cette notice
10:51 CORBA, ActiveX et Java Beans Jean-Marie Chauvet 2212089503 Z3950-LYON3 Importer cette notice
10:51 Java Michel Bonjour, Gilles Falquet, Jacques Guyot et André Le Grand 2841801349 Z3950-LYON3 Importer cette notice
10:51 Constructing intelligent agents with JAVA 0471191353 Z3950-LYON3 Importer cette notice
10:51 JDBC et Java George Reese 2841770427 Z3950-LYON3 Importer cette notice
10:51 Le programmeur Java 1.2 Laura Lemay et Rogers Cadenhead 2744005193 Z3950-LYON3 Importer cette notice
10:51 Penser objet avec UML et Java Michel Lai,... 2225834288 Z3950-LYON3 Importer cette notice
10:51 Java 1.1 Michel Martin 2736127587 Z3950-LYON3 Importer cette notice
10:51 Le dictionnaire officiel Java 2 Patrick Chan 2212090897 Z3950-LYON3 Importer cette notice
10:51 Java 2 Rogers Cadenhead 2744006971 Z3950-LYON3 Importer cette notice
10:51 UML, la notation unifiée de modélisation objet Michel Lai 2100050230 Z3950-LYON3 Importer cette notice
10:51 UML en action Pascal Roques, Franck Vallée 2212091273 Z3950-LYON3 Importer cette notice
10:51 Understanding SQL and Java together 1558605622 Z3950-LYON3 Importer cette notice
10:51 Rural industrialization in Indonesia by KÅosuke Mizuno 4258520314 Z3950-LYON3 Importer cette notice
10:51 Programmation Java côté serveur Andrew Patzer 2212091095 Z3950-LYON3 Importer cette notice
10:51 Sécurité en Java Scott Oaks 284177063X Z3950-LYON3 Importer cette notice
10:51 Penser objet avec UML et Java Michel Lai 2100053787 Z3950-LYON3 Importer cette notice
10:51 Java, la synthèse Gilles Clavel... 2100053795 Z3950-LYON3 Importer cette notice
10:51 XML et Java Jean-Christophe Bernadac, François Knab, Franck Lepoivre... 2212091486 Z3950-LYON3 Importer cette notice
10:53 and so on and so forth.
10:54 Maybe the problem comes form a UNIMARC flavor ???
10:54 kados ???
10:54 around ?
10:55 thd hdl: kados is busy making business at the Chicago ALA convention.
10:56 hdl: I have never seen the liblime demo do anything at all (no popup) when attempting a z39.50 search.
10:58 hdl: Actually, I have not set a working z39.50 search on any koha demo server for years now.
11:00 slef: why does processz3950queue have a 20 June date?  Did you change anything in that file?  I have not checked the diffs yet?
11:03 unmadindu kados: ping
11:04 hdl kados : pong... kados is busy making business at the Chicago ALA convention.
11:05 unmadindu hdl: this is indradg chatting from a friend's comp
11:05 hdl thd :I don't have this date on my processz3950queue.
11:05 hi indradg ;)
11:05 unmadindu hdl: Koha Live CD for ALSA conference is ready, but need 350 MB to upload
11:07 s/ALSA/ALA
11:08 hdl: kados wanted to hand out the Live CDs
11:08 hdl maybe you could put it on the koha-fr ftp server when it is uprgaded if kados wants to get it from there.
11:09 always the sams problems too busy busy ;)
11:10 unmadindu hdl: ok thanks
11:10 thd hdl: I got the latest version, more resent than 2.2.3 because the -s switch for the su command does not exist in BSD where I installed koha.  slef removed the -s switch 20 June.  That was a redundant to prevent using cshell, then the options would not be read correctly I presume.
11:12 hdl: Removing the su -s switch should not have caused any problem.
11:12 hdl I don't think so.
11:21 thd : have you investigated z3950/search.pl code ?
11:21 Line 103 : if numberpending = 0 then return 0.... and not a page.
11:22 You should take a closer look to checkz3950 subroutine.
11:22 As I will to.
11:28 thd hdl: I assumed if it worked for you the code would not be the problem.  Only my configuration and use would be at issue.
11:30 hdl: Although, it is a little worrying that slef has not had a working z3950 since 2.2.  Yet, he did not fully investigate the issue for himself.
11:40 hdl thd... : try this : in z3950/search.pl code ?
11:40 [18:21:52] <hdl> Line 103 : if numberpending = 0 then return 0....
11:41 change ? 0 by ? ""'
11:42 and retry.
11:57 unmadindu : do you want an ftp access ?
11:57 thd hdl: in line 103 I changed '? 0' to '? ""'.  Note the code quotation and all changes are enclosed in a single quote but no single quote was used in changes.
11:59 hdl can you copy/paste the line you got?

← Previous day | Today | Next day → | Search | Index

koha1