← Previous day | Today | Next day → | Search | Index
All times shown according to UTC.
Time | Nick | Message |
---|---|---|
12:31 | slef | thd: I think it would help to do a wide public test along similar lines to that which I just did, to see how the various settings interact. |
12:32 | thd: I can't remember how firefox behaves if it's given a non-unicode font to display unicode. It probably displays what it can, so as long as the fonts contain the characters being input, it's OK. | |
12:32 | thd: and the other-OS and closed browsers are not known to me in this much detail. | |
16:33 | thd | kados: are you there? |
17:58 | alex | hi can anyone help with MARC imports? |
18:01 | I'm trying to import into the resivior and I get the message "10 not imported because they seems not to be MARC format (or ISBN/ISSN missing) | |
18:02 | This is a file downloaded from SCIS | |
18:11 | russ | hi alex |
18:13 | alex you there? | |
18:13 | are you using the sample data set, or do you have a subscription? | |
18:13 | http://www.curriculum.edu.au/S[…]s/samplefiles.htm | |
18:21 | thank you | |
18:21 | doh wrong window :-) | |
18:27 | Import results : | |
18:27 | * 5 imported records | |
18:27 | * 0 not imported because already in catalog | |
18:27 | * 0 not imported because already in the reservoir | |
18:27 | * 0 not imported because they seem not to be in MARC format (or ISBN/ISSN missing) ! | |
18:27 | * 5 records parsed | |
18:27 | * Back | |
18:27 | using | |
18:28 | http://www.curriculum.edu.au/S[…]/ddc22_usmarc.dat | |
18:38 | alex | I;m back now |
18:38 | We have a subscription | |
18:38 | russ | hiya alex, i had a go using the usmarc sample file (told koha it was marc21) and it worked sweet as |
18:39 | alex | I'll try the sample |
18:39 | russ | i didn't try the scis file, just the usmarc one |
18:39 | alex | Hi Russ :) |
18:39 | I'll give it a go | |
18:40 | russ | cool - good luck |
18:43 | alex | Yep, the sample file imports OK, but not the one we got via the subscription. |
18:43 | Are there any tools to check the format? | |
18:43 | or logs I should be looking at? | |
18:44 | Or can I send someone the MARC file that's not working? | |
18:46 | russ | is the file you are getting from SCIS usmarc or scis format? |
18:46 | they seem to offer both | |
18:48 | alex | I'll check that |
18:48 | The filename is usmarc.dat which tends to suggest usmarc. | |
18:49 | chris | hi alex |
18:49 | how big is the file? | |
18:50 | alex | 10 records, 6k |
18:50 | hi chris | |
18:51 | chris | hmm |
18:51 | do you have a windows machine handy? | |
18:51 | http://oregonstate.edu/~reeset/marcedit/html/ | |
18:51 | theres a really neat tool, unfortunately not for linux | |
18:51 | that you can use to check if its valid marc | |
18:52 | alex | yes, I've got 2 windows laptops handy! |
18:52 | I'll check it out. | |
18:52 | chris | you can also open the the .dat file in a text editor |
18:52 | it should be one long line | |
18:53 | which stuff like 000 0 d^^1 ^_aIserles, Tali.^^10^ | |
18:55 | alex | opened it in wordpad and it appeared to be 10 lines? |
18:55 | chris | right .. 6k does sound kinda big |
18:55 | for 10 records | |
18:55 | maybes its given you the textual rep ... want to email the file to me ? | |
18:56 | alex | thought you'd never ask |
18:56 | having the three laptops and one is running out of battery | |
18:56 | so I'm just mucking around transfering files on the network | |
18:57 | chris | righto :) |
18:57 | alex | and giving people appropriate network access rights etc. |
18:57 | so It'll be a few mins. | |
18:57 | thanks chris :) | |
18:57 | chris | no problem |
19:14 | hmm interesting | |
19:15 | ive sent back the file ... for you to tru | |
19:15 | try even | |
19:17 | alex | ok, cool, my greylisting may get in the way |
19:17 | chris | yeah we run greylisting too |
19:29 | alex | I've updated the greylisting rule for katipo, you could prod your mailserver or resend the file |
19:30 | russ | alex: are you coming to the lianza conference? |
19:32 | alex | no, probably not |
19:33 | chris | on its way |
19:35 | russ | and by organise i mean facilitate the first meeting for the koha users and see if there is enough interest/drive amongst themselves to see if they will do anything about it |
19:36 | i was looking at perhaps doing something round the lianza conference - do you think anyone involved in your project will be coming/ interested in attending a meeting? | |
19:38 | alex | perhaps this is too early in the piece |
19:38 | I would attend if I had a large enough customer base | |
19:38 | but just one small school at this point | |
19:39 | Maxine from the national library who is here with us won't be going to that conf | |
19:39 | and the school staff are unlilely to be interested | |
19:40 | russ | ok cool, if we do do something, do you mind if i send you some info anyway? |
19:41 | alex | yeah no problem |
19:43 | russ | sweet |
19:45 | alex | OK, chris's file imported 8 of 10, 2 were listed still as not importable (no ISBN?) |
19:48 | chris | yeah i think thats the problem |
19:48 | i think there are only actually 9 | |
19:49 | at least thats what the file says | |
19:49 | We acknowledge and thank you for your order of 9 | |
19:50 | one of which doesnt have an isbn .. thats my theory anyway .. and the comments its trying to read as one | |
19:51 | if you go to /cgi-bin/koha/acqui.simple/addbooks.pl | |
19:51 | in the title input | |
19:52 | type in what | |
19:52 | then search | |
19:52 | you should get a result from the reservior | |
19:53 | which if you click add biblio .. you can then look at (it doesnt actually add it until you click add bibliographic record and go to items .. on the next page) | |
19:53 | so you can look at the record there without putting it in your actual catalog | |
19:54 | alex | yes, ok, when we searched for 10 records on scis, they only had data on 9 |
19:54 | chris | right |
19:55 | alex | but I'm not sure if some kind of blank template was sent through for the 10th |
19:55 | chris | could be |
19:55 | alex | we have been through add biblio with one book |
19:55 | how do we add a copy, it's still not appearing in searches | |
19:56 | chris | you did the add biblographic thing and go to items ? |
19:56 | and added an item? | |
19:56 | another question i have for you, does scis have a z3950 server? | |
19:57 | alex | z3950, no I don't think so, but maybe |
19:57 | OK i'm in a purple screen headed iblionumber: With Framework and 5 pages of all the biblio data | |
19:58 | chris | right |
19:58 | alex | Do I need to click "Add biblio" button at the top? |
19:59 | chris | you are using the default templates right? |
19:59 | alex | ok, yes that's it |
19:59 | chris | 2 secs ill just switch to those templates, and check |
19:59 | alex | yep afaik |
19:59 | chris | on the 5th tab |
19:59 | there is 942c itemtype | |
19:59 | alex | now I'm at a new item screen which has price and barcode |
19:59 | chris | ahh gone past that .. cool |
20:00 | 942c you should always fill in | |
20:00 | alex | we set our item type on page 5 |
20:00 | chris | sweet all good then |
20:00 | so you can fill in price if you want, but you will need to put something in barcode | |
20:00 | alex | we have marc numbers turned off |
20:01 | chris | ahh so you just see itemtype? |
20:01 | cool | |
20:01 | alex | so I'm not seeing 942c but I assume it is item type on page 5 |
20:01 | yep | |
20:01 | chris | yep thats it |
20:02 | alex | cool I think we're getting closer |
20:02 | I'll have a look at what you did to the usmarc.dat file | |
20:02 | do you think I'll have luck with bulkimport.pl? | |
20:03 | chris | yep bulkmarcimport throws it straight into the catalogue .. not the reservior |
20:03 | so it expects the record to already have things like barcode, itemtype etc in them | |
20:04 | its a migration tool | |
20:04 | whereas loading them into the reservior sets it up so you can catalogue new books you receive | |
20:05 | you can fill the reservior with tons and tons of records | |
20:05 | alex | We need to import all the books into the catalog |
20:05 | but there was no previous automation so we don't have barcode or price info etc. | |
20:05 | chris | right |
20:05 | so 2 options | |
20:05 | use marcedit | |
20:06 | to edit the marc records, and add price, itemtype and barcode to them | |
20:06 | alex | we send scis isbn and get back the biblio listings for what they have |
20:07 | marcedit gives an error right now, perhaps I should run it as administrator | |
20:08 | chris | then bulkmarcimport them |
20:09 | alex | yep, makes sense |
20:09 | chris | or .. load them into the reservior and go thru them adding them and adding itemtype barcode etc |
20:09 | i suspect marcedit will be a bit faster | |
20:10 | alex | cool, thanks for your help |
20:10 | will probably need more help .... but we've got heaps to work on atm | |
20:10 | chris | no problem |
20:17 | alex | hmm, still can't search for it? |
20:17 | just turned marc codes on | |
20:20 | chris | hmm |
20:21 | if you jump into mysql, and do a select * from biblio; ... is there stuff in that table? | |
20:22 | oh oh oh | |
20:22 | i know | |
20:22 | go to | |
20:23 | /cgi-bin/koha/admin/stopwords.pl | |
20:23 | do you have a stopword defined? | |
20:24 | if not, add the | |
20:24 | it needs at least one stopword for teh searches to work | |
20:24 | alex | possibly not |
20:25 | yes we have one, "THE" | |
20:25 | chris | darn |
20:25 | not that then | |
20:26 | alex | I'm looking in the item table and there is no holding branch and location I think? |
20:26 | nulls | |
20:26 | chris | yep that should be ok |
20:26 | alex | there was drop downs but I didn't set them |
20:26 | ok | |
20:26 | chris | the table that is actually searched |
20:26 | is marc_word | |
20:26 | is there data in there? | |
20:28 | alex | yes there is |
20:28 | chris | cool so it is adding things .. thats good |
20:29 | i wonder why the search isnt finding it | |
20:29 | have u tried just searching on one word of the title say? | |
20:29 | alex | yep |
20:29 | chris | if you look in the error log |
20:29 | it should be outputting the sql its using | |
20:31 | something like | |
20:31 | select distinct m1.bibid from biblio,biblioitems,marc_biblio,marc_word as m1 where biblio.biblionumber=marc_biblio.biblionumber and biblio.biblionumber=biblioitems.biblionumber and m1.bibid=marc_biblio.bibid and (m1.word like 'what' and m1.tagsubfield in ('245a')) order by biblio.title ASC | |
20:31 | alex | where does koha log? |
20:31 | standard install | |
20:32 | chris | /usr/local/koha/log/ |
20:33 | alex | ok, those are just webserver logs? |
20:33 | chris | yep |
20:33 | the other thing you can do .. to see that is in the catalog | |
20:34 | select biblionumber from biblio; | |
20:34 | then /cgi-bin/koha/detail.pl?bib=5625 | |
20:34 | where 5625 = the biblionumber | |
20:34 | eg http://opac.kapiti.katipo.co.n[…]etail.pl?bib=5625 | |
20:35 | theres the one i loaded from that usmarc.dat file | |
20:35 | alex | ok |
20:39 | sorry chris my laptop froze up | |
20:40 | chris | np |
20:40 | alex | [A[A[B |
20:41 | /cgi-bin/koha/MARCdetail.pl?bib=1 shows the record | |
20:41 | with an item | |
20:42 | was that what you suggested? | |
20:42 | chris | yep thats fine |
20:42 | detail.pl?bib=1 would work too | |
20:42 | alex | ok |
20:43 | chris | hmm so its there .. i wonder why the search isnt finding it |
20:43 | alex | do you want me to make the interface externally accessable? |
20:44 | I just need to add dns records | |
20:44 | maybe only one record in the db | |
20:44 | is causing an anomaly | |
20:44 | chris | i probably wont get a chance to look properly today (better get back to work work :-)) but if you want i can look this evening, drop me an email with details |
20:45 | alex | ok cool |
23:35 | hdl | thd : utf8_a_gogo website is up now. |
23:36 | I have taken UTF8CGI.pm | |
23:38 | thd | hdl: I have the site up but http://www.urlfan.com/code/perl-utf8/UTF8CGI.pm has a 404 error |
23:41 | hdl: I linked from the wrong site I am downloading now | |
23:57 | hdl: so the trick is Encode::find_encoding() | |
23:57 | hdl: kados had doubted such a function was possible | |
23:58 | but neither of us had looked carefully in the correct place | |
00:15 | hdl: POD for Encode::Supported http://search.cpan.org/~dankog[…]ode/Supported.pod | |
00:15 | hdl: there is a little issue | |
00:17 | hdl: If Koha were being queried from a completely unknown machine with no reasonable restriction about the encoding used much memory would be taken to load all the possible encodings which might need testing | |
00:19 | hdl: if you are only concerned with testing for Latin-1 or standard Unicode encodings such as UTF-8, then you have those by default | |
00:22 | hdl: however, I suggest that you are only fairly safe in Europe if you use Encode::Byte as well as the default | |
00:23 | hdl: use Encode::Byte should allow testing for all of ISO 8859-whatever | |
00:26 | hdl: is your concern for remote users or unknown encodings which may be by systems inside the library? | |
00:38 | hdl: correction to some statements above ... | |
00:41 | hdl: use Encoding::Guess is key for the difficult possibilities for UTFCGI.pm but even though multiple 8859 encodings could be added for guessing they cannot reliably be distinguished from each other | |
00:43 | hdl: the various single byte ISO 8859 encodings can only be distinguished from multibyte encodings reliably | |
00:44 | hdl: the multibyte encodings can be distinguished from themselves | |
02:31 | osmoze | hello |
02:54 | btoumi | hi all |
02:55 | toins | salut bruno ! |
02:55 | salut all ! | |
03:02 | btoumi | salut toins |
04:07 | chris: are u around? | |
07:01 | slef | LindvigLcwu.EDU is auto-replying to kohalists.katipo messages - can someone please mark nomail until their return on 2006-09-18? |
07:18 | kados | hdl: are you here? |
07:18 | hdl: i was hoping to discuss UTF-8 briefly | |
07:18 | btoumi | somebody konw this message :=>script not found or unable to stat |
07:18 | kados | yea |
07:18 | btoumi | hi kados |
07:18 | kados | it means the script is either not there |
07:19 | or else the permissions are set wrong and you can't read it | |
07:19 | or it could mean you can't execute it | |
07:20 | btoumi | that i understand but i see for the permissions =>nothing wrong and the file is in the right place |
07:20 | kados | strange |
07:20 | btoumi | yes i think so |
07:23 | peraphs i have find somethink ; is about maninvoice and mancredit | |
07:23 | ty kados | |
07:30 | toins | kados: hdl schould be back soon |
07:49 | kados | morning owen |
07:49 | owen | Howdy |
07:50 | kados | owen: believe it or not, I did _nothing_ on the zoomopac while you were sleeping :-) |
07:50 | hehe | |
07:59 | hdl | hi |
08:00 | kados : back | |
08:04 | btoumi | kados: i have resolved the problem |
08:09 | kados | btoumi: what as it? |
08:09 | hdl: hi | |
08:09 | dewey | hi, kados |
08:10 | kados | hdl: did you see my response on character encoding? |
08:10 | btoumi | kados : i work with manvoice and mancredit.tmpl but the error was in manvoice.pl mancredit.pl |
08:11 | hdl | yes. |
08:11 | btoumi | kados: in url |
08:11 | kados | btoumi: ahh ... |
08:12 | btoumi | i have commit the changes |
08:12 | kados | btoumi: thanks |
08:13 | slef | kados: I added a bit to encodingscratchpad |
08:13 | about browser behaviour | |
08:13 | kados | slef: yea, I noticed |
08:13 | slef | I may have also found a fontconfig oddity this morning. |
08:13 | kados | slef: but I'm not sure it's accurate cross-platform |
08:13 | slef: for instance, on OSX, utf-8 combining chars simply don't work by default with any version of firefox and the Arial font | |
08:14 | slef | kados: hence my comment about needing to do a wide test |
08:14 | kados | yep |
08:14 | slef | does firefox on OSX use gtk, carbon or cocoa? |
08:14 | kados | not sure |
08:15 | slef | http://www.wotfun.com/pipermai[…]ugust/003517.html is the fontconfig question, by the way |
08:15 | kados | cool, thx |
08:15 | slef | I thought it was camino on OSX? |
08:15 | (fontconfig returns ISO8859-1 fonts for some UTF-8 locales, which is evil, bad and wrong) | |
08:18 | (eo_XX.UTF-8 gets the right font, so I'm using that as default now... which will confuse some of the users if I've got the overrides wrong.) | |
08:42 | qiqo | ei |
08:42 | slef | ei? |
08:42 | dewey | i think ei is 3.0 available at the CVS? |
08:42 | qiqo | hehe |
08:42 | how are you all doing? | |
08:43 | slef | malbone |
08:43 | qiqo | do we have news on the 2.2.6 release? |
08:43 | slef | paul's away this week AIUI |
08:44 | qiqo | hmm ok |
08:45 | i just hope that it will be released as soon as we generate the barcodes of our library | |
08:46 | are the z3950 bugs fixed in 2.2.6? | |
08:47 | kados | qiqo: i've got about 20 production clients running the 2.2.6 z39.50 client and it's working just fine |
08:47 | qiqo | wow |
08:47 | that's cool | |
08:47 | i really cant make it work in 2.2.5 | |
08:48 | kados | should be pretty simple to update |
08:48 | qiqo | i had to use a proprietary cataloguing standalon software |
08:48 | slef | qiqo: are you getting the 'no results found' problem or something else? |
08:49 | qiqo | yup no results.. |
08:49 | ive visited the logs,, nothings shown there | |
08:50 | slef | qiqo: it's not even searching? |
08:50 | qiqo | ive given up.. since 2.2.4 i couldnt make it work.. |
08:50 | i dont know,, but it resides on memory | |
08:50 | i tried connecting using the console using yaz and it connects | |
08:50 | slef | only z39.50 problem to defeat me this year has been a firewall :-/ |
08:50 | qiqo | we have no firewall :) |
08:51 | actually i already used 2 isps.. | |
08:51 | they say that we dont have firewall | |
08:51 | i already checked the router.. | |
08:52 | so i think i should really wait for 2.2.6 | |
08:54 | slef | are other people on holiday Monday? |
08:55 | qiqo | but we have the proprietary software for cataloguing, my primary concern is with the barcode generator.. |
08:56 | slef | I think it is for many people |
08:58 | qiqo | cool.. hehe glad to hear that |
09:36 | thd | hdl: are you there? |
09:36 | hdl | yes |
09:37 | thd | hdl: is your concern for CGI encodings about remote users or unknown encodings which may be by systems inside the library? |
09:38 | hdl | qiqo : your barcode problem is a problem of checksum line 164 in BarcodeGenerator.pl |
09:39 | qiqo | huh? |
09:39 | hdl | checksum is manipulating data. |
09:39 | qiqo | ahh yeah |
09:39 | that's what happening | |
09:39 | hdl | And if you want to print itembarcode, you have to "shunt" this function. |
09:40 | qiqo | it prints 0000000017 instead of 00001 |
09:41 | hdl | thd: it is general concern when a user inputs data into the system. |
09:41 | One should at least check that it is utf-8. | |
09:41 | if not reencode. | |
09:42 | qiqo : try also to "play" with extn... line 168... | |
09:43 | or type if you donot want ean13 | |
09:45 | qiqo | ok but isnt that fixed with the 2.2.6 release? |
09:46 | i really am no that techinical when it comes to scripting | |
09:46 | im not familiarized with perl scripts.. | |
09:46 | :) | |
09:46 | thd | hdl: did you see my comment to you from last night or early this morning for you about usage of use Encoding::Guess and to add needed encodings to test and the inability to distinguish between different ISO 8859 encodings? |
09:50 | hdl | qiqo : so try and setup a 2.2.6 test box. Since RC2 is out ;) |
09:50 | thd: OK. So are we blocked ? | |
09:51 | qiqo | ok.. ill check that out tommorrow |
09:51 | its already 11pm here :) | |
09:51 | so 2.2.6 will run smoothly on a debian stable? | |
09:51 | i mean rc2 | |
09:52 | thd | hdl: There are systems which can use linguistic information to guess encodings and languages given a sufficiently large document. A bibliographic query is unlikely to be sufficient linguistic information. |
09:52 | hdl: no this is not a block except for different ISO 8859 possibilites | |
09:53 | hdl | qiqo: We think/hope so. |
09:54 | Do you think UTF8CGI is usefull ? Or should we hack something for us ? | |
09:54 | qiqo | and may i ask for a suggestion if what desktop systemare you suggesting |
09:55 | hdl | qiqo: I am running Mandriva. But debian rocks ;) |
09:55 | thd | hdl: you can still distinguish a chosen assumed single byte encoding from many different multibyte encodings and you can distinguish the multibyte encodings from each other. |
09:55 | qiqo | cool.. mandriva is good. |
09:55 | but i think ill stick with debian | |
09:56 | so will it be kde or gnome? | |
09:57 | thd | hdl: you have to presume some particular ISO 8859 is most likely and guess based on that |
09:58 | hdl | qiqo: The one you prefer. |
09:58 | qiqo | ehhe ok ill stick with kde |
09:58 | hdl | as sson as it runs Firefox. |
09:58 | qiqo | actually im running my server with freespire |
10:03 | thd | hdl: see http://search.cpan.org/~dankog[…]/Guess.pm#CAVEATS |
10:08 | hdl: so you will be able to discover whether the user has submitted Latin-1 and convert but distinguishing Latin-1 from Latin-2 is unlikely to work unless you have special linguistic insight for modifying or extending Encode::Guess | |
10:13 | slef | hdl: what is UTF8CGI? |
10:13 | UTF8CGI? | |
10:13 | dewey: wiki? | |
10:13 | dewey | wiki is, like, at http://wiki.koha.org |
10:14 | slef | dewey: have a poisoned botsnack |
10:14 | dewey | thanks slef :) |
10:14 | slef | qiqo: gnustep! |
10:14 | hdl | (See :http://dysphoria.net/2006/02/05/utf-8-a-go-go/ |
10:14 | ) | |
10:14 | slef | hdl: seeing |
10:15 | qiqo | haha gnustep hehe |
10:15 | cool | |
10:16 | but we have users that prefer the "M$ windows" touch | |
10:16 | slef | By now (2005) the robust approach is to send out forms pages encoded in utf-8, expecting the forms input to be submitted back using that encoding. This has been in practical use for a couple of years now (e.g at Google) and can be expected to work with any current HTML4-compatible browser. |
10:16 | http://ppewww.ph.gla.ac.uk/~fl[…]et/form-i18n.html | |
10:16 | owen | dewey: Property is theft! |
10:16 | dewey | OK, owen. |
10:16 | thd | hdl: maybe after Encode::Guess guesses, if it guesses ISO 8859-1 we for example, we could test the data string for the presence of special characters which might be either ISO 8859-5 Turkish or ISO 8859-1 Icelandic and decide which is more likely. |
10:17 | slef | qiqo: trouble is gnome and kde are windows-wannabes, but obviously not windows, which seems to disturb users more IME |
10:18 | qiqo: if you give them something which looks nothing like their interface, they remember it's different. And the step interface behaves mostly sanely. | |
10:18 | qiqo | hehe ok |
10:20 | thd | hdl: but maybe we would miss other possibilities such as ISO 8859-6 Latin/Arabic |
10:21 | hdl | But maybe that would be another point later on. |
10:24 | thd | hdl: I assume slef is correct about about most recent browsers and operating systems. I hope guessing is only needed for recalcitrant legacy clients which are an ever dwindling minority |
10:26 | slef: does your cell phone browser or wrist watch computer browser send UTF-8 correctly? | |
10:26 | slef | Nah, assume I'm correct about needing to test this more widely before doing much else. |
10:27 | I don't have a cell phone browser or wrist watch computer. | |
10:28 | dewey: UTF8CGI is http://dysphoria.net/2006/02/05/utf-8-a-go-go/ | |
10:28 | dewey | OK, slef. |
10:30 | thd | slef: I have seen European cell phone browsers that send UTF-8 but I think that they are the minority in Europe and that option is a setting which is controlled by the user in advance and not the default |
10:31 | qiqo | can koha be also on wap? |
10:31 | hehe | |
10:32 | slef | thd: again, something to test. |
10:33 | thd | qiqo: I want these tiny systems to be able to use real web pages and not just WAP. |
10:33 | qiqo | ahh ok so xhtml? |
10:34 | thd | qiqo: there are some that can but they are much too expensive to drop or get at little wet |
10:35 | slef: let me know when I can get an all purpose wrist watch computer for US $500 | |
10:38 | slef | if the US$ keeps falling against the Euro, that may be soon ;-) |
10:39 | oh wait, that's backwards :) | |
10:39 | *@*!@ currency exchanges |
← Previous day | Today | Next day → | Search | Index