IRC log for #koha, 2007-07-06

← Previous day | Today | Next day → | Search | Index

All times shown according to UTC.

Time Nick Message
13:21 jaron toins, can I ask you a question about opencataloger?
13:22 toins yep jaron
13:22 jaron are you using z39.50 extended services to get the records into the zebra database?
13:22 for koha that is.
13:23 toins jaron: i use ZOOM
13:23 don't know what is z3950 extended services...
13:23 jaron same thing as zoom
13:23 toins ah...
13:24 jaron so you do something like 'update insert record.xml'
13:25 toins jaron: here is the search script : http://svn.gna.org/viewcvs/ope[…]v=352&view=markup
13:29 jaron toins: Thank you. I'll have a look at the code.
13:30 toins your welcome
13:30 jaron Right now I'm interested in how you get records into the database.
13:30 would that be in saveToKoha.pl?
13:31 toins jaron: yes
13:31 jaron thank you, toins.
14:29 hmmm... So I've installed koha-3. The marc structure is broken so I can't get records into the system. I can get records into zebra with yaz-client. Is there any way to get them to show up in the catalog now?
14:49 Is there any way to get records that are directly stored and indexed in zebra to show up in the catalog?  
15:49 kados he jaron_lunch
15:49 jaron_lunch: are you sure it's the MARC structure that's broken?
15:49 I ran the MARC check and it seemed to be fine
15:55 jaron kados: you're right the MARC Checking shows my configuration is OK.
15:55 kados I think toins committed some changes to the MARC editor recently
15:55 maybe we should look to roll those back until they're ready?
15:57 jaron at least for testing it would help to be able to have some records in the system :)
15:57 toins kados: nope i haven't commited any things on the marc edior atm
15:57 but soon ;-)
15:57 kados ahh
15:57 cool
15:57 toins: does the current one in 3.0 work for you?
15:57 toins: I'd be curious because we can't seem to get it working
16:01 toins kados: the current marc editor works well yes
16:01 kados that's really strange
16:01 maybe it works for UNIMARC and not MARC21?
16:02 toins don't know for marc21... But it works in 2 libraries in unimarc
16:25 hdl kados : what do you mean by not working ?
16:25 you cannot edit ? you cannot save ?
16:28 kados hdl: can't even view the MARC fields
16:28 hdl: arwen.metavore.com - kohaadmin / PASSWORD
16:30 ryan don't think that's the right url
16:30 hdl Is there any bibliographic record?
16:30 That is OPAC.
16:30 kados ahh, sorry
16:30 paul liblime guys are fans of the lord of the ring...
16:30 kados aragorn.metavore.com
16:30 I got confused with which character it was :-)
16:31 paul when does those 2 machines get married ?
16:31 kados (all our servers are named after LOTR characters)
16:31 hehe
16:32 hdl any bib data to search for ?
16:32 kados no bib data yet
16:32 just try to add a MARC record
16:35 hdl no marc structure in aragorn
16:36 http://aragorn.metavore.com/cg[…]pl?frameworkcode=
16:36 maybe a problem with framework import ???
16:36 kados ahh
16:36 but that's not the only prob
16:36 even when the frameworks import it's still a blank MARC page
16:36 just a sec
16:37 I'll re-do the installation
16:37 ok
16:37 I dropped and re-created the db
16:37 hdl: you wanna run the installer?
16:38 see if you get any errors?
16:38 then, try to add a MARC record?
16:38 otherwise I can run the installer and you can try to add a MARC afterwards
16:40 hdl: let me know if you perfer to run the installer or want me to
16:40 hdl I did.
16:40 kados cool
16:40 hdl It works now.
16:41 kados wow!
16:41 maybe you ran the installer differently than me?
16:42 which frameworks did you select? just mandatory ones?
16:43 jaron: maybe try droping your datbase and running the installer again
16:43 hdl (ANY)
16:43 :P
16:44 When I find things available, I check....
16:44 kados ok
16:44 paul_away: hdl did you see my mail about kohastructure.sql?
16:44 hdl ( I wanted to see all the stuff you did.)
16:45 kados ( right )
16:45 it's strange because I did nothing different last time and the MARC page was blank
16:45 did you run updatedatabase?
16:45 jaron kados: What do I need to do now?
16:46 kados jaron: I'm still trying to work it out, but the aragorn.metavore.com MARC editor seems to be working now
16:46 jaron cool.
16:46 kados hdl has the magic touch apparantly :-)
16:46 hdl lol
16:46 kados : yes
16:48 kados hdl: whats' your opinion about kohastructure.sql?
16:50 hdl I agree kohastructure.sql should be authoritative.
16:50 And should be maintained by someone.
16:51 (or fixed for ONCE before getting further)
16:51 kados cool
16:51 so how can we arrive at what the 3.0 kohastructure.sql should be?
16:51 should we have a meeting about it?
16:51 and go through each table?
16:51 hdl paul is away tommorrow for 2 weeks.
16:51 kados right
16:52 hdl I will be away for 2 in 1week time.
16:52 so now cannot be the time.
16:52 But 1st place to discuss could be the wiki.
16:53 kados I would very much like to get a developers' release of 3.0 out this month
16:53 hdl to explain table by table the field definition
16:53 kados yes
16:53 hdl and relation.
16:53 kados good idea
16:53 do you think you'd have time to work on that this month?
16:53 do we need it before the developers' release?
17:00 hdl: ?
17:00 hdl Yes, If I work nights that month :P
17:00 kados hehe
17:01 IKWYM
17:01 so I guess the answer is no
17:01 hdl No I don't think taht we need such a definition before developer's release.
17:01 kados which kohastructure.sql should we use for the release?
17:01 hdl But would be VERY helpful.
17:02 which one did you use for aragorn ?
17:02 kados we might need a Database Design Manager
17:02 I ahve three on aragorn :-)
17:02 hdl not full time but part time, yes
17:03 kados I think the current one is based on Paul's sqldump
17:03 it doesn't have defaultvalue in marc_subfield_structure though
17:03 and I don't know what else it doens't have
17:06 hdl maybe we could rely on a 22 base updated to rel30 base ? Couldn't we ?
17:06 kados i don't trust updatedatabase :-)
17:06 hmmm
17:08 hdl Moreover updatedatabase fills in some values.
17:09 kados yea
17:09 hdl which is not necessary.
17:09 kados agreed
17:09 hdl But can give us a structure.
17:09 kados maybe we could use one of the french libraries who are running 3.0 in production?
17:09 as the structure?
17:09 (for the developers' release)
17:10 LANG=C mysqldump -cnQ koha >kohastructure.sql
17:10 according to MJ is a good way
17:10 to get it
17:10 hdl that is to say what paul commited.
17:10 more or less.
17:10 kados the one paul committed failed for me
17:10 i did a bug on it
17:10 hdl I will take this part tomorrow.
17:11 kados ok
17:11 hdl: http://cvs.savannah.nongnu.org[…]oot=koha&view=log
17:12 hdl: will explain the error I got and why I reverted to the previous version of kohastructure.sql in CVS
19:06 slef hi all
19:06 kados hey slef
19:07 slef++ for ideas on the kohastructure.sql
19:07 :-)
19:07 slef kados: spaces in filenames are pain
19:07 kados: can we rename files to get rid of them, please?
19:07 kados which ones?
19:08 slef kados: or shall I silently remove them from the tarball?
19:08 kados which files are we talking about?
19:08 slef cd koha ; find . -name '* *'
19:08 kados yowza
19:08 it's all those images
19:08 slef yes, mostly images
19:09 and one release note
19:09 kados and release notes
19:09 I'd say we can rename those files
19:09 slef should any directories that are in CVS not be in the tarball?
19:09 kados hmmm
19:10 koha/misc doesn't need to be
19:10 koha/t either
19:10 and, it appears
19:10 koha/rss
19:10 slef koha/t are tests, aren't they?
19:10 kados yea
19:10 koha/updater
19:10 slef good to have in the tarball for "make test"
19:11 kados yup
19:11 no idea what koha/localfile is
19:11 I think everything else should be OK
19:11 slef ; cat localfile/modified_authorities/DO_NOT_REMOVE
19:11 do not remove this file, used to avoid cvs deleting this directory
19:12 kados huh
19:12 weird
19:12 I've no clue what that is
19:12 slef put out an APB on koha-devel?
19:12 oh wait
19:12 kados or why it's cluttering my namespace :-)
19:12 slef file DO_NOT_REMOVE was initially added on branch rel_2_2.
19:13 adding a field useful only for CVS, to avoid deletion of empty directories. this directory is filled when modifying an authority. the merge_authority script get files here & deals with them
19:13 kados huh
19:13 slef ^^ paul's comments
19:13 kados weird
19:13 lets delete it
19:13 /usr/tmp is a better place I think
19:13 slef I'll exclude it from the tarball
19:13 or even /var/tmp
19:13 kados or even the db
19:13 yea
19:14 slef /usr/tmp shouldn't exist IIRC
19:14 kados ahh, /var/tmp is what I meant then
19:15 slef looks like default data is under misc/
19:15 or have I misread that?
19:15 kados misc/sql-datas/
19:15 IIRC
19:16 but that's a bad namespace I think
19:16 or do you mean default data as in everything?
19:16 we need to organize that better
19:16 any ideas?
19:16 types of data are:
19:16 frameworks
19:17 slef definitely a bad namespace... I'm confused by what to package
19:17 kados sample bibliographic data
19:17 sample authoritis data
19:17 stopwords
19:17 system preferences
19:17 user flags
19:17 sample patron data
19:18 sample authorized values
19:18 sample itemtypes
19:18 sample borrower categories
19:18 sample libraries (branch defs)
19:18 sample circulation matrices
19:18 namespace ideas?
19:19 slef what are the misc/*.pl files?
19:19 kados misc scripts that have accumulated over the years
19:19 slef scripts not cgi-bins?
19:19 kados command-line utilities ... basically misc is where you put all the unorganized shit
19:20 right, not cgi-bins
19:21 slef ok, I'm putting modules into the main perl module namespace
19:21 cgi-bins under koha/cgi-bin/...
19:22 misc scripts under koha/scripts/...
19:22 what other file types need a home?
19:22 presumably tmpls and sqls?
19:22 kados hmmm
19:22 sqls?
19:22 slef the .sql files
19:23 where does the web installer expect to find them?
19:23 kados ahh
19:23 atm they are in koha/misc/sql-datas
19:23 but we should move them
19:23 cuz that's ugly
19:23 IMO
19:25 slef so if I patch the web installer to find them wherever I put them, that's fine?
19:25 kados yep, fine with me
19:25 but I'd like to see what namespace you intend to use if that's alright
19:25 lets make it right in the CVS
19:26 IYKWIM
19:26 like maybe a
19:26 koha/data
19:26 ?
19:26 slef works for me
19:26 kados koha/data/sql
19:26 koha/data/sample_bibliographic
19:26 slef or should they be in koha/installer?
19:26 kados yea, maybe that
19:26 I dunno
19:26 slef Does anything other than the installer use them?
19:27 kados no, not those specifically
19:27 just the installer
19:27 the koha/misc/sql-datas ones are only used by the installer
19:27 so installer/data/en installer/data/fr ?
19:28 slef sounds good
19:28 do I want to install everything from koha-tmpl?
19:29 koha-tmpl/errors contains CGI scripts... that's nice.
19:35 kados weird
19:36 slef seems I already handled that with rules I'd already written
19:36 kados everything else looks OK
19:36 why is errors in there I wonder
19:37 slef someone taking advantage of Options ExecCGI on their server, at a guess
19:37 kados should we relocate it as well?
19:37 slef doesn't matter to me
19:38 I call *.pl a CGI as long as it's not in misc
19:38 kados cool
19:41 slef dinner time here... bbi60
20:19 back early
20:33 hdl kados : localfiles stores authorities modification
20:33 misc stores overdue scripts.
20:33 and updater should be in tarball for sure.
20:34 kados hdl: updater shouldn't be in cgi though
20:34 misc is pretty dissorganized for my tasts
20:34 tastes even
20:35 slef so updater in the tarball?
20:35 kados yep, but not in the cgi
20:35 slef what about rss?
20:36 kados same I think
20:37 hdl And it is interesting.
20:37 I agree reorganizing things could be a good thing.
20:38 But should be explained on koha-devel... at least.
20:38 kados hdl: yep
20:38 hdl: good to get a plan first, then post to koha-devel for comments
20:39 hdl remember we have two libraries running koha rel30 cvs
20:39 kados right
20:40 slef do they cvs up automatically? ;-)
20:40 hdl IPT no, we do it.
20:41 neither do San WP.
20:41 If a big warning is on koha-devel.
20:41 It will be OK.
20:42 slef why is there a koha/.htaccess ?
20:43 those could go in koha-production-httpd.conf
20:43 and anyway: /cgi-bin/koha/koha-tmpl/errors/400.pl ??? cgi-bin/koha/koha-tmpl!  My eyes, they burn, they burn! ;-)
20:43 more seriously - I don't like koha-tmpl being put under cgi-bin
20:44 hdl: are you getting gales and rainstorms too?
20:44 kados ok, so .htaccess is probably in there for those of us that run off of CVS
20:44 I'm guessing
20:45 in that case, cgi-bin is symlinked directly to the koha dir
20:46 slef so far, so good
20:46 hdl .htacess is only redefining error pages.
20:46 to cgi-bin.
20:47 slef ok, I'll not install it anywhere
20:47 kados hdl++
20:47 hdl 23PM in France time to go to bed
20:47 kados hdl: g'night, thanks for your help this evening
20:48 slef Package does not provide a long description -  Please fill it in manually.
20:56 it copies files to half-sane locations
20:56 but it doesn't yet generate config files
20:56 perldoc Makefile.PL
20:56 if you want to see the notes
20:57 damn... ytpo
21:03 kados slef++
21:03 w00t
21:04 hehe
21:13 slef any luck?
21:13 kados I get a ton of [Thu Jul  5 14:18:49 2007] Makefile.PL: Warning: prerequisite PDF::API2 2 not found.
21:14 when i do perl Makefil.PL
21:14 slef Do you have it installed?
21:14 anyway, it will work anyway... it just checks for koha's prerequisites
21:15 that's so one day we can make cpan install stuff automatically
21:15 and also to help the deb and rpm packaging
21:15 which should be able to generate their dependencies from it
21:16 kados gotta buy this ticket for Chris to come to the US ;-)
21:18 slef sadist
21:18 chris lol
21:18 slef ;-)
08:19 [K] *** join #koha@FreeNode: kwak n=edward@125-26-237-184.adsl.totbb.net
08:20 *** part FreeNode!#koha: kwak n=edward@125-26-237-184.adsl.totbb.net
08:59 chris hi hdl
09:09 toins hello chris
09:09 how are things in NZ ?
09:35 chris hi toins, things are cold and rainy
09:35 how are things in france?
09:36 toins fine... we have a pretty hot summer here..
09:38 chris we have been having tornadoes in nz over the last few days
09:39 http://www.nzherald.co.nz/sect[…]objectid=10450116
09:40 toins wow
09:44 chris yep, weird weather
10:16 devin greetings
10:18 chris hi devin
10:20 devin How are you chris?  I've been working on installing Koha and have a question about the 'items' table.  Could you help out?
10:22 chris i can try :)
10:24 devin OK.  I just imported all our MARC records, but they don't have any 'item type' or branch associated.  So I want to mass change them through MySQL.  I'm wondering if it's correct to just adjust the items table directly.
10:25 chris hmmm
10:25 if you want to be able to search on those values
10:25 then they will need to be in the marc_word table also
10:26 itemtype is on the biblioitems table, and branch (holdingrbanch and homebranch) are on the items table
10:27 but you will want to put entries into marc_subfield_table and marc_word also
10:27 it might be easier to check why it wasnt made (probably framework, or marc2koha links set up problem) and reimport them
10:28 devin Ok, it wasn't made because they didn't have those values
10:28 chris ahh
10:28 well it might be easier to use MARCedit
10:28 and add the values to the marc records then import them
10:29 devin So I should export them all to MARC, edit them, then re-import them?
10:29 Do you know any MARC editor not for windows?
10:30 chris yep export them from whatever system you are coming from, edit them to have the info you want, then import them into Koha
10:30 hmm i think you can use marcedit under mono
10:31 http://oregonstate.edu/~reeset[…]it/html/index.php
10:31 but i havent tried .. i have an old windows laptop i use just for marcedit :)
10:31 if you had to do it in mysql
10:31 devin OK, thanks.  I guess I'll do that.  I was hoping it would be easier though.
10:32 chris it wouldnt be that easy, unless the marc files are pretty small .. ie there is nothing in the marc records that isnt in the koha tables (biblio,biblioitems and items)
10:33 if that was the case, then you could change biblioitems and items
10:33 and run koha2marc.pl
10:33 but if you had stuff in the marc records that wasnt in one of those tables, it would get wiped
10:34 devin I think there is other information, and you're making sense.
10:34 I have another question.  Is there a search that will return all items?
10:35 chris hmm i think if you do a keyword search on %%%% you get everything, let me just check
10:36 devin I can't get that to work
10:39 chris ahh yep, they have stopped that
10:40 nope since that hole has been plugged i dont think there is anymore ... i have one other idea
10:41 ah ha
10:41 go to cataloging
10:41 devin yes
10:41 chris adn try %%%% there in the title
10:43 or just one %
10:43 ah no %% or more work
10:44 devin Well it returned a few books with %% or %%%%, but not all of them for sure.
10:44 chris darn
10:44 guess we cant anymore
10:45 jamesa hi, i have a suggestion - publication date 1900 - 2100 ?
10:45 assuming you do not have old books !
10:46 and that info is in the marc
10:46 chris yep that would work as long as that info is there
10:46 devin And strangly it says they are in the resovior, when I thought I had none there.  When using bulkmarcimport.pl, are the books supposed to go to the resovior?
10:47 None of my books have that field
10:47 jamesa oh well
10:47 chris hm nope devin reservior is from uploading marc, or from z3950 searchs
10:47 are you running 2.2.9?
10:48 devin 2.2.8  Strange then, how there could be books there
10:49 Ah, I think I know.  I tried to upload them, but it failed mysteriously.  Maybe it still uploaded a few.
10:49 jamesa phpmyadmin tells me how many rows I have in the items table if that helps
10:50 chris ok 2 secs devin
10:51 how are you at editing perl? :) if we comment out 2 lines in C4/SearchMarc.pm
10:51 we should be all good
10:52 around line 212 is  @$value[$i] =~ s/^%//g;
10:52 if we make that #  @$value[$i] =~ s/^%//g;
10:52 then line 221 (ish) is  $word =~ s/%//g unless length($word)>4;
10:52 if we make that #  $word =~ s/%//g unless length($word)>4;
10:53 then searching on % in the keyword should get us everything
10:53 devin Let me try
10:54 chris (me was looking at the 2.2.9 file so the line numbers might be a little out)
10:58 devin no luck
10:58 I mean it is the same as before
10:58 chris dang
10:59 ahh one more line
10:59 246
10:59  $word =~ s/%//g unless length($word)>4;
10:59 again
10:59 #  $word =~ s/%//g unless length($word)>4;
11:01 devin Thanks that does the trick.  %% now returns all books.  % still returns nothing
11:01 chris actually i think if we uncomment that
11:01 then %%%%%% should work
11:02 cos that code says remove the first % making it %%%%% .. then if its not greater than 4 remove the other %'s
11:02 so as long as we have 6 or more it should get all things (% is the wildcard in mysql)
11:03 devin Yes, how unnessesary.  I don't want to have to ever explain that to my users.  But I just want it working now for cataloging, to make sure I don't miss anything
11:03 So are you a Koha developer?
11:04 chris well searching on everything is a nightmare for big libraries
11:04 you dont want 10 ppl doing that on your opacs at once
11:04 when you anything over 100k titles
11:04 devin Well, since you only return the first 10 or 50 records, it shouldn't be so bad
11:05 chris still has to find them all
11:05 specially if its a title search
11:05 devin That's the bug then.  Searching on everything is too useful to forgo
11:05 chris so it can order them by title
11:05 no way you can order them unless you see them all
11:06 devin how about with a mysql index?
11:06 chris searching on everything is fine for the librarians
11:06 it uses indexes
11:06 but its still has to sort everything
11:07 devin But the index is already sorted
11:07 chris yes, but you return all the rows, not just the index
11:08 and it has to join them with the other tables to find things like callnumber, and branch
11:09 devin Yes, but since there is already a sorted index for title, it simply loads those first 20 rows, then joins them.  It shouldn't take more resources then other sources.  There is no reason to look at the other rows
11:10 chris that might be true if you only ever look at 245a
11:10 for title
11:11 but koha allows you to define what you want title to search, so it can search subtitles and unititles as well
11:11 unless you simply did select * from biblio order by title .. it cant make good use of the index for sorting
11:11 devin Anyway, probably however Koha does it, it's slow.  So I can understand blocking it.  But like you just explained, using %%%%%%% will search everything anyway
11:12 chris super fast in 3.0 and zoom, slower in 2.2.x
11:13 more flexibility = slower, its the tradeoff
11:14 but with the zebra backend we get a ton more flexibility and lots faster search too
11:14 devin So when using zebra does it use MySQL at all?
11:14 chris yep just not for bibliographical data
11:14 still uses it for transactions
11:14 and patron data
11:15 devin OK, well I look forward to it.
11:15 BRB
11:16 chris or yep as jamesa said you can do a select * from biblio in phpmyadim :) or from the mysql commmandline
11:22 but now i have to go to sleep
11:22 jamesa cul
11:23 _devin goodnight

← Previous day | Today | Next day → | Search | Index

koha1