← Previous day | Today | Next day → | Search | Index
All times shown according to UTC.
Time | Nick | Message |
---|---|---|
11:21 | mj | hello. I am the person who asked the "zebrasrv -c" question on the mailinglist, and received the tip to try "zebrasrv -f" instead from Henri-Damien |
11:22 | thanks very much, that seems to work much better, however... | |
11:22 | now I'm getting: 11:23:43-13/11 [fatal] /usr/share/koha/etc/zebradb/zebra-biblios.cfg:29 missing colon after 'passw.passwd' | |
11:23 | any ideas here what else i missed? | |
11:23 | I promise: when I have all this up-and-running, I'll create a wiki page with detailed instructions :-) | |
12:20 | hdl | ùj hi |
12:20 | mj | |
12:21 | consider commenting the passw.passwd line in zebra-biblios.cfg | |
12:21 | This is owed to a change in config syntax | |
12:38 | fbcit | g'morning hdl |
12:38 | hdl | hi fbcit |
12:40 | fbcit | I was testing changes I made to the installer and noticed mysql complaining about dup keys in the sysprefs.sql |
12:40 | specfically | |
12:41 | line 49 | |
12:42 | 'marcflavour' | |
12:42 | However, doing a select on systempreferences.variable = 'marcflavour' returns only one record... | |
12:46 | hdl: I thought this might have something to do with the marc flavor changes | |
12:47 | hdl | if mysql complains about duplicate key value, then it doesnot add. |
12:47 | Oh... Yes. | |
12:48 | fbcit | is it possible that the row is inserted by an earlier script and duped in the sysprefs script? |
12:50 | grep'ing only shows that one occurrence though... | |
12:53 | looks like it would insert in spite of the complaint since prior to the sql import we SET FOREIGN_KEY_CHECKS=0 | |
13:00 | looking at the structure of systempreferences, it does not make any sense. sysprefs.sql should import without error... | |
13:05 | hdl | fbcit-away: |
13:05 | I changed install.pl to insert marflavour when one was chosen. | |
13:05 | This makes the problem occur. | |
13:06 | In fact, systempreferences.sql could be updated in order not to insert marcflavour systempreference. | |
13:10 | But Problem would be if no choice of marcflavour is proposed (For french it is the case). Then marcflavour should be imported from systempreferences.sql | |
13:10 | fbcit-away: hope you shall get this message soon. | |
13:31 | kados | hiya owen |
13:32 | owen | Hi |
13:32 | kados | hdl, fbcit-away I think I have a solution to the difficulty of picking how to have a different record.abs between unimarc and usmarc |
13:32 | hdl, fbcit-away the solution is to switch from ABS to DOM :-) | |
13:33 | http://wiki.koha.org/doku.php?[…]om_style_indexing | |
13:34 | hdl | kados : marcflavour is not only for indexing, it is also related to framework building. |
13:35 | kados | hdl: right, but for zebra it's just indexing |
13:36 | hdl | but for install, it is the problem I spotted ;) ... friendly |
13:36 | kados | do we use record.abs for anything except zebra indexing? |
13:39 | I think there are aspects of the Koha frameworks that could fit into the zebra xslt DOM file | |
13:40 | mj | hdl: thanks for the tip. |
13:42 | hdl | kados : Sure. |
13:43 | But at the moment, we need a release don't we ? | |
13:43 | kados | yep |
13:43 | but it's a programatic change | |
13:43 | hdl | changing all the stuff for DOM is not a vital priority. |
13:43 | I agree with this change. | |
13:44 | kados | well the question is, how do we handle unimarc vs usmarc |
13:44 | in the installer | |
13:44 | (not the web installer) | |
13:44 | hdl | tumer already did it. |
13:44 | kados | if we switched to DOM we could have both, and make the choice in the web installer |
13:44 | if we use ABS we have to modify Makefile to accomodate for the choice | |
13:44 | so which is easier? | |
13:45 | hdl | How would you have both in DOM ? |
13:45 | See you soon | |
13:45 | kados | hdl: because in the DOM you could have the choice stored in a syspref |
13:47 | hmmm, guess not | |
13:47 | it would have to be in zebra.cfg | |
13:52 | but we could have multiple extract pipelines | |
13:52 | The <extract> pipeline takes documents from any common DOM XML format to the Zebra specific indexing DOM XML format. It may consist of zero ore more <xslt stylesheet="path/file.xsl"/> XSLT transformations, and the outcome is handled to the Zebra core to drive the process of building the inverted indexes. | |
13:53 | which could be set up ahead of time presumably | |
14:43 | hdl | kados : would the BIG xslt containing ALL the frameworks be processed once for all (when setup is complete or marcflavour chosen) ? or should xslt processed at each connexion (This would take time.) |
14:43 | ? | |
15:00 | kados ? | |
15:00 | Does any of your customer want to limit results to some subset ? | |
15:01 | (restricted search) | |
15:01 | (For instance for childhood protection or for restricted areas) | |
15:03 | owen | paul_ around? |
15:04 | hdl | not today |
15:04 | owen | hdl, maybe you can help me understand bug 1513? |
15:07 | hdl | owen : have you tried to add a biblio with only title and doctype mandatory ? |
15:07 | owen | No |
15:08 | hdl | If you click on field 245 for instance, then mandatory subfields fades away and optional ones are displayed. |
15:09 | Which is NOT the expected behaviour : should be all subfields displayed and not only optional ones. | |
15:09 | owen | I can't reproduce this problem with the default framework I have. Do you have any suggestions? |
15:10 | hdl | Can I get on your system ? |
15:26 | fbcit | hdl: in the case of marcflavour, the second insert takes precedence, right? (that one in sysprefs.sql) |
15:29 | really we can do one of two thing, imo... | |
15:30 | hdl | shouldnot be that way. Second insert should be and is discarded |
15:31 | fbcit | hdl: sorry, but I have to run... I'll get back later.tnx |
15:31 | hdl | ok |
15:36 | fbcit | hdl: sorry about that... |
15:38 | hdl: but the error is carried out to the user... should it be suppressed? | |
15:39 | or can the first insert be made conditional on the language choice? | |
15:39 | kados | hdl: regarding your question, yes, we have a customer that wants that |
15:39 | hdl | Maybe we should insert IGNORE rather than only inserting |
15:40 | fbcit | that would be true if the second always takes precedence (which it seems to me to... :-) |
15:41 | the first is just there in case there is not a second... right? | |
15:47 | hdl: I notice that in the fr/mandatory there is unimarc_standard_systemprefs.sql which also inserts marcflavour | |
15:47 | hdl | yes |
15:47 | But french install donot have more than one marcflavour. | |
15:47 | So choice of marcflavour is skipped. | |
15:48 | It is english marcflavour choice which raises this error. | |
15:48 | fbcit | but the marcflavour preference is populated by unimarc_standard_systemprefs.sql so why do we need to do the insert in install.pl |
15:51 | hdl | fbcit: If unimarc_standard_systempreferences.sql in english adds a marcflavour UNIMARC, then inserting marcflavour line in install.pl is nonsense. |
15:51 | *in english* | |
15:52 | But if we have only one systempreferences.sql for english ppl, then marcflavour would be wrong sometimes (when someone chooses UNIMARC) | |
15:52 | This is why I added this line in install.pl | |
15:53 | fbcit | ahh... I see... |
15:55 | I wonder if we can move that insert into the marc21 framework & unimarc framework sql rather than doing it in install.pl? | |
15:55 | those scripts will be selected based on the user's choice... | |
15:56 | at the top of each we could insert the appropriate preference... | |
16:27 | hdl | fbcit: yes. It may be the most appropriate way. But it would need documentation and much caution from devs. |
16:27 | Since exporting frameworks from bases is quite easy and automatic. | |
16:28 | kados | ok, this may sound strange |
16:28 | hdl | Adding one line from a different table. |
16:28 | kados | but what if we solved this by having different databases for unimarc vs marc21 |
16:28 | hdl | kados ???? |
16:28 | kados | ie, biblios-marc21 vs biblios-unimarc |
16:28 | then the syspref could be used | |
16:29 | the Makefile woudln't need to know about the choice up front | |
16:29 | it would just install both databases | |
16:29 | and let the user choose which one to use | |
16:29 | does that make sense? | |
16:29 | hdl | imho, it would be crazy and nonesense. |
16:30 | you would create a database just for 'fun'. | |
16:30 | kados | well, not really, it wouldn't ever be initiatlized |
16:30 | it would just be a directory | |
16:30 | that happened to not have anything in it | |
16:32 | the problem right now with installation is that: | |
16:32 | hdl | kados: i really donot see why we should even create a ghost database. |
16:32 | kados | 1. we want to separate library choices from system choices |
16:32 | 2. the system person won't know what marcflavour to use | |
16:32 | 3. the librarian has no way to set up zebra's databases | |
16:32 | so if we create two dirs, then the librarian can choose with a syspref which one to use | |
16:33 | maybe | |
16:34 | hdl: what's your idea to solve this problem? | |
16:35 | fbcit | hdl, kados: I moved the pref insert as I mentioned and it works fine... |
16:35 | minimizes changes... | |
16:35 | kados | fbcit: moved it where? |
16:36 | fbcit | to the start of the marc21 and unimarc sql scripts... |
16:36 | kados | ok |
16:36 | here's the real issue | |
16:36 | when you run Makefile.PL | |
16:37 | it sets up zebra for you | |
16:37 | it puts record.abs in the zebradb/biblios/etc/ dir | |
16:37 | and the record.abs it puts in there is a marc21 one | |
16:37 | that doesn't work for hdl | |
16:37 | he needs a record.abs that is unimarc-specific | |
16:37 | hdl | kados : Does it setup a zebra-biblios.conf ? |
16:37 | kados | hdl: yep |
16:38 | hdl: it sets up everything | |
16:38 | fbcit | so why not have the webinstaller do it all? |
16:38 | hdl | Ok. |
16:38 | kados | because the web installer doesn't have write access to those dirs |
16:38 | hdl | I donot have time enough to investiguate in zebra installation script. |
16:38 | kados | at least it doesn't as currently designed |
16:38 | hdl | But |
16:39 | kados | hdl: rebuild_zebra.pl is unnecessary for installation with Makefile.PL |
16:39 | although perhaps it could be useful for re-indexing | |
16:39 | fbcit | I need to study the zebra config stuff more closely. |
16:39 | hdl | I think that we donot use zebra configuration files possibility at their top level. |
16:39 | I mean : | |
16:40 | I think that there could be two *.abs files in tab dir. | |
16:40 | kados | s/tab/etc/ |
16:40 | hdl | And zebra-biblio.conf could settle which one to use. |
16:41 | kados | hdl: ok, but who has write access to zebra-biblio.conf? |
16:41 | hdl | record.abs in in tab |
16:41 | kados | tab is now called etc |
16:41 | koha/etc/zebradb/ | |
16:42 | fbcit | Makefile.PL could tell zebra where zebra-biblio.conf is? |
16:42 | kados | hdl: I think the issue here is that you and paul hav a different process for installing zebra than the rest of us |
16:43 | hdl: take a look at koha/etc | |
16:43 | hdl: you will find koha-conf.xml and koha-httpd.conf that Makefile.PL use | |
16:44 | hdl: slef has worked hard to conform to the FSH for all naming conventions | |
16:44 | inside zebradb we have an etc with all of zebra's config files | |
16:44 | and in zebradb/biblios/etc we have the database-specific config files | |
16:44 | hdl | paul and I works with UNIMARC it has nothing to do with our way to install. |
16:44 | kados | Filehttp://www.pathname.com/fhs/ |
16:44 | http://www.pathname.com/fhs/ | |
16:45 | hdl | If you have to set up a UNIMARC library, you will require a UNIMARC record.abs |
16:45 | kados | hdl: the install process for you and paul is documented on the wiki, right? |
16:45 | hdl: exactly | |
16:45 | hdl | your install process is documented ? |
16:45 | kados | hdl: so what I'm trying to say is, we need a way to make it possible to install a unimarc record.abs in the main project installer |
16:46 | hdl: the install process is 'make' 'make install' | |
16:46 | hdl: that's it | |
16:46 | the Makefile.PL does everything | |
16:46 | there is zero zebra config necessary | |
16:46 | perl Makefile.PL; make; make install | |
16:46 | hdl | Yes. But info tech Guy has no way to choose between UNIMARC and usmarc. |
16:47 | kados | exactly |
16:47 | so that's what we're trying to resolve | |
16:48 | hdl | And zebra requires a different configuration file if it is UNIMARC or usmarc. |
16:48 | kados | hdl: more than record.abs? |
16:48 | hdl | sortstrings.chr |
16:48 | words.chr | |
16:48 | ... | |
16:48 | kados | yep, so the .abs and the .chr files |
16:48 | anything else? | |
16:48 | (I think that's it) | |
16:49 | so we can: | |
16:49 | hdl | if one created 2 zebra-biblios.conf files |
16:49 | kados | 1. default to marc21 and have the web installer warn the user upon unimarc choice to tell the sysadmin to run a script that installs unimarc files |
16:50 | hdl | zebra-biblios-usmarc.conf |
16:50 | and zebra-biblios-unimarc.conf | |
16:50 | Nope. | |
16:51 | fbcit | kados: are we expecting the sysadmin to run make && make install? |
16:51 | kados | fbcit: yes |
16:51 | hdl | (Nope was for me... Mys solution required a change in koha.xml) |
16:51 | fbcit | and the user to run webinstaller? |
16:51 | kados | fbcit: yes |
16:51 | hdl | fbcit: this is what we are heading to. |
16:51 | kados | we want to maintain a separation between system-level and library-level tasks |
16:51 | fbcit | so the zebra stuff must be done in Makefile.PL...$ |
16:52 | kados | yep, because it requires write access to the filesystem |
16:52 | fbcit | webinstaller just needs to verify that the marcflavor the user wants is what has been installed and warn otherwise... |
16:53 | kados | yea |
16:53 | maybe that's the approach to take | |
16:53 | we can use a new variable for the makefile | |
16:53 | fbcit | too bad kohastructure is not in place during Makefile.PL... |
16:53 | kados | __MARCFLAVOUR__ |
16:53 | defaults to marc21 | |
16:53 | fbcit | we could insert the marcflavor pref there.... |
16:54 | kados | when the web installer is run, it checks the user's choice vs the system choice |
16:54 | and if they dont' match, it warns the user to have their sysadmin fix it | |
16:54 | fbcit | and refuses to run.... |
16:54 | ? | |
16:54 | kados | maybe |
16:54 | well, probably not | |
16:54 | fbcit | as long as the descrepancy exists? |
16:54 | kados | because other still will work fine |
16:54 | fbcit | sp... |
16:55 | kados | just not searching |
16:55 | fbcit | k |
16:55 | kados | maybe have a big warning on the staff side though |
16:55 | fbcit | so marc only comes into play when searching? |
16:55 | kados | that tells the user that someting's not configured correctly |
16:55 | fbcit | data entry will not be affected? |
16:55 | kados | fbcit: zebra only comes into play when searching |
16:55 | hdl | fbcit: yes it will |
16:55 | kados | fbcit: right, data entry will be unaffected |
16:55 | if the user chooses unimarc, the data will be saved as unimarc | |
16:55 | hdl | kados : addbiblio.pl adds 100$a |
16:55 | kados | regardless of the system-level choices |
16:56 | hdl | Oh yes. |
16:56 | you're right. | |
16:56 | kados | and if the user chooses nozebra it doesnt' matter anyway |
16:56 | fbcit | so user's pref will rule when data entry is concerned, but not when searching.. |
16:56 | hdl | But marc frameworks won't be good. |
16:56 | kados | fbcit: right |
16:56 | hdl: yes, they will be fine, all of that is handled in the database | |
16:56 | hdl: the only file-system stuff is zebra's .abs file and the .chr files | |
16:57 | fbcit: does the make install process output a result txt file that says what was done? | |
16:58 | hdl | see you. |
16:58 | fbcit | by hdl |
16:58 | s/by/bye/ | |
16:58 | kados | cya hdl |
16:58 | fbcit | kados: no |
16:58 | kados | so I can't do a 'make uninstall'? |
16:58 | fbcit | it could be made to... |
16:59 | I don't know, hold on. | |
17:00 | it does no look like it. | |
17:01 | kados: 'make uninstall' says: Uninstall is unsafe and deprecated, the uninstallation was not performed. | |
17:02 | and koha runs like normal... | |
17:04 | kados | hmmm |
17:05 | I guess it's based on ExtUtils::MakeMaker | |
17:06 | fbcit | it is, but I am not familiar with that module myself.. |
17:08 | kados | check your syspref |
17:08 | there's one for session driver | |
17:08 | I bet it's set to mysql | |
17:08 | we probably need to add an option for postgres | |
17:08 | or you could just change it to file | |
17:09 | fbcit: /cgi-bin/koha/admin/systempreferences.pl?tab=Admin | |
17:09 | fbcit: SessionStorage | |
17:09 | fbcit | sessonstorage |
17:09 | mysql|tmp | |
17:09 | kados | yea, just change that to: |
17:09 | mysql|tmp|postgres | |
17:09 | I think | |
17:10 | or ... you could test if it's that by setting it to tmp for now | |
17:10 | ahh | |
17:10 | we need a block to handle postgres | |
17:10 | C4/Auth.pm | |
17:10 | around line 411 | |
17:11 | fbcit++ | |
17:11 | fbcit | I added a library over pg last night and nothing blew chunks |
17:12 | changing to tmp fixed it, so I'll add the code this afternoon. | |
17:12 | kados | awesome |
17:12 | yea, on my list | |
17:12 | fbcit | :-) |
17:21 | owen | kados, is the redirect from /search going to be done for the 3.0 OPAC ? |
17:23 | kados | owen: no |
17:27 | fbcit: ping me when you're back | |
17:27 | fbcit: I'm testing out your patches | |
17:27 | fbcit: but I may be missing some | |
17:27 | (I think I'm missing the 'select your database type' one | |
17:28 | it's just finding my mysql db | |
17:28 | and yea, I'm stuck on step 2 | |
18:21 | fbcit: back yet? | |
18:21 | fbcit: I'm seeing one bug here with these patches | |
18:21 | fbcit: I don't get the option to select a marc flavour (it asks me to select, but no options are listed) | |
18:22 | also, step 3, doesn't list any options to select from | |
18:23 | hiya | |
18:23 | fbcit: see above | |
18:23 | fbcit: chris just forwarded me all your patches | |
18:23 | fbcit: and I applied everything | |
18:24 | fbcit: and there are some bugs | |
18:24 | basically I'm not prompted to select a MARC flavour, and I'm not prompted to select my 'options' | |
18:24 | fbcit | kados: you have to make the db selection in koha-conf.xml... <db_scheme>Pg</db_scheme> |
18:24 | also set <port>5433</port> for Pg | |
18:25 | kados | hmmm |
18:25 | I'm not testing Pg | |
18:25 | I'm testing mysql | |
18:25 | when I run the web installer | |
18:25 | I get: | |
18:25 | fbcit | k |
18:25 | kados | Select your MARC flavour |
18:25 | as a step | |
18:25 | but nothing to actually select | |
18:25 | and while I like the idea of being able to specify the port, it should work without that specification | |
18:26 | for backwards compatibility | |
18:26 | [Tue Nov 13 12:21:09 2007] [error] [client 96.230.90.54] [Tue Nov 13 12:21:09 2007] install.pl: no open /home/jmf/koha/production/intranet/cgi-bin/installer/data/mysql/en/marcflavour/ at /home/jmf/koha/production/intranet/cgi-bin/installer/install.pl line 418., referer: http://staff-jmf.dev.kohalibra[…]p=3&op=choosemarc | |
18:26 | ] install.pl: no open /home/jmf/koha/production/intranet/cgi-bin/installer/data/mysql/en at /home/jmf/koha/production/intranet/cgi-bin/installer/install.pl line 477., referer: http://staff-jmf.dev.kohalibra[…]p=3&op=choosemarc | |
18:26 | fbcit | Makefile will set the port to the default mysql if none is specified. |
18:27 | hold on.... | |
18:27 | kados | ok, but what I mean is, we shouldn't have to specify the port in the config file |
18:27 | if that makes sense | |
18:27 | that's a new parameter, not everyone will know that it needs to be in there | |
18:28 | fbcit | it should work w/o a port spec'd as installer checks for $info{port} ? "port=$info{port}":"" but that is not the problem here I think |
18:29 | kados | fbcit: http://staff-jmf.dev.kohalibrary.com |
18:29 | you can run the installer | |
18:29 | fbcit | check for the existence of koha/installer/data/mysql/en/marcflavour... |
18:32 | kados | fbcit: it's not there |
18:32 | fbcit: maybe I'm missing a patch? | |
18:32 | fbcit | then a patch failed |
18:32 | and that is why no marc choices.... | |
18:32 | kados | the en stuff is still in the data dir |
18:32 | yea | |
18:32 | ok, i'll see what I'm missing here | |
18:33 | sorry for bothering you about it :-) | |
18:33 | [K] | *** join #kohaFreeNode: darcilicious n=plinkit159.121.122.150 |
18:33 | fbcit | 0002-Moved-language-dirs-one-level-down-under-dbms-dir-m.patch |
18:33 | second patch down... ;-) | |
18:34 | [K] | *** part FreeNode!#koha: darcilicious n=plinkit159.121.122.150 |
18:34 | kados | fbcit: I didn't get that one |
18:34 | hmmm | |
18:34 | hang on | |
18:34 | I see now | |
18:34 | ok, give me a sec here | |
18:35 | fbcit | I can resend it... |
18:35 | kados | yea, I don't see that one |
18:35 | send it to rmkoha.org | |
18:38 | fbcit | kados: one moment... |
18:39 | back | |
18:40 | kados: so if no port is spec'd (ie. <port></port>) with mysql it will not matter | |
18:42 | kados | sweet |
18:42 | yea, it's all working | |
18:42 | sample_labels.sql failed | |
18:42 | but other than that we're all good | |
18:42 | fbcit | sample_labels.sql tries to dup a key I think... |
18:43 | kados | ahh |
18:43 | fbcit | havn't taken time to look |
18:43 | kados | I thought galen pushed up a patch for that |
18:43 | but I'll take a look | |
18:43 | fbcit | git had me running scared... |
18:43 | :-) | |
18:44 | kados | ok, I'm gonna push this stuff up |
18:44 | fbcit++ | |
18:44 | so we still need to address this prob with marc21 vs unimarc | |
18:44 | any thoughts since lunch? :-) | |
18:45 | fbcit | I need to spend time studying how zebra is setup and how ExtUtils::MakeMaker works |
18:46 | kados | I can explain zebra |
18:46 | studying it probably will take you a couple weeks :-) | |
18:47 | ok, here goes | |
18:47 | zebra has config files and system files | |
18:48 | it's very very flexible | |
18:48 | so some stuff can be set globally and some stuff set per-database | |
18:48 | in Koha we have two databases currently | |
18:48 | one for biblios and one for authorities | |
18:48 | so we have a generic global etc dir with global config files | |
18:49 | and biblios and authorities have their own etc as well | |
18:49 | with database-specific config files | |
18:49 | if you look in koha/etc/zebradb | |
18:49 | you'll see an etc dir with the global configs | |
18:49 | and koha/etc/zebradb/biblios/etc has the biblios-specific config files | |
18:50 | one of the files in particular is used to define how zebra indexes things | |
18:50 | fbcit | so koha/etc/zebradb/foo/etc? |
18:50 | kados | yes |
18:50 | record.abs is the master index definition for a given database | |
18:50 | (well, foo.abs really) | |
18:50 | (but lets keep it simple for now) | |
18:51 | so marc21 and unimarc have different indexes obviously | |
18:51 | because, for instance, in unimarc 100$a isnt' author | |
18:51 | whereas in marc21, it is | |
18:51 | so koha/etc/zebradb/foo/etc/record.abs | |
18:51 | will be different depending on the flavour of MARC | |
18:51 | with me so far? | |
18:51 | fbcit | yea |
18:53 | kados | yep |
18:54 | fbcit | so 'abs' is just a diff format than sxml... |
18:54 | xslt | |
18:56 | kados | well, not quite |
18:57 | it's unfortunately a bit more complex than that | |
18:57 | fbcit | so the only diff between unimarc and marc21 is the "tag" (ie 100$a)? |
18:57 | kados | yea |
18:58 | fbcit | k |
18:58 | our problem is how to decide which record.abs to install...? | |
18:58 | kados | exactly |
18:58 | fbcit | and other associated config files... |
18:58 | kados | my thinking is |
18:58 | yea, there are only two others | |
18:58 | if we solve the prob for record.abs we can solve it for the others | |
18:59 | fbcit | with what I know at this point, I like the idea of an env var passed to Makefile.PL |
18:59 | and webinstaller checks as we discussed earlier... | |
19:02 | kados | yea, I like that idea too |
19:02 | we could almost store that in the config file | |
19:02 | rather than in the systempreferences | |
19:02 | but that would require a fair amount of refactoring | |
19:03 | fbcit | koha-conf.xml contains settings the user should not be able to change, right? |
19:03 | kados | correct |
19:04 | fbcit | I'm for leaving it in the db for now... |
19:09 | kados: is marc21 default or unimarc? | |
19:09 | kados | marc21 |
19:10 | unimarc is pretty localized to france | |
19:10 | fbcit | so we add ZEBRA_MARC or MARC_TYPE |
19:10 | ? | |
19:10 | kados | MARCFLAVOUR I think |
19:10 | fbcit | k |
19:12 | so only files under db/etc change for marc spec? or do some globals change also? | |
19:12 | kados | globals too :-) |
19:13 | all of the .chr files | |
19:13 | are marcflavour-specific | |
19:13 | fbcit | give me path/filename of what changes per marc spec |
19:13 | kados | ok |
19:13 | fbcit | I think this should not be too hard... |
19:13 | kados | we just discovered that the french team has been using files in misc/zebra |
19:13 | fbcit | famous last words..... |
19:13 | kados | and the english team has been using files in etc/zebradb |
19:13 | fbcit | we need to standardize I think... :-) |
19:14 | kados | yep |
19:14 | fbcit | off-topic: what is the release time-frame for Koha3? |
19:14 | kados | so the unimarc record.abs is in koha/misc/zebra/record_biblios_unimarc.abs |
19:14 | for biblios | |
19:14 | for authorities its | |
19:14 | so the unimarc record.abs is in koha/misc/zebra/record_authorities_unimarc.abs | |
19:15 | but the usmarc file in that dir should be ignored | |
19:15 | fbcit: 3.0 will be released when it's ready :-) | |
19:15 | fbcit: this year for sure | |
19:15 | asap basically | |
19:15 | misc/zebra/sort-string-utf_french.chr | |
19:15 | is the french version of | |
19:16 | ../../etc/zebradb/etc/sort-string.chr | |
19:17 | it's just three files :-) | |
19:17 | and use the naming conventions from etc/zebradb | |
19:17 | not misc/ | |
19:17 | fbcit | I assume these path/names are referenced in zebra-foo.cfg? |
19:18 | kados | correct |
19:18 | well | |
19:18 | in a round abotu way | |
19:18 | sort-string.chr is referenced in default.idx which is referenced in bib1.att which is referenced in zebra-foo.cfg | |
19:18 | :-) | |
19:19 | fbcit | so really the fr stuff needs to be made to match what exists in etc/zebradb |
19:20 | kados | yes |
19:20 | those three files | |
19:20 | fbcit | so *just* those three? |
19:20 | kados | yep |
19:21 | if we move those files to etc | |
19:21 | we can delete misc/zebra altogether | |
19:21 | fbcit | once that part works, we will work on the webinstaller part... |
19:22 | and do Pg port stuff in the cracks between... | |
19:22 | kados: sound ok? | |
19:23 | kados | yea, sounds perfect |
19:24 | fbcit: 3.0 is likely stable enough, or will be by the end of this week, to run in production | |
19:25 | fbcit: the liblimer's are doing code auditing this week of all the circ, searching, cataloging stuff | |
19:25 | fbcit: your help with the installer is most appreciated | |
19:25 | owen | kados, I was curious about the spelling suggest feature. When I look at the kohaspsuggest preference, its explanation is "Track search queries, turn on by defining host:dbname:user:pass" |
19:25 | kados | owen: yea, that's what NPL has |
19:26 | owen: I ported it to 3.0 | |
19:26 | owen | Why "track search queries" ? |
19:26 | kados | owen: it's just part of the functionality of that feature |
19:27 | owen: it tracks 'successful' queries and ranks them as part of the suggestion feature | |
19:27 | owen | I see. |
19:27 | Should that be a YesNo pref? Right now it's got a Textarea | |
19:28 | kados | no |
19:28 | see the syspref description :-) | |
19:28 | ' turn on by defining host:dbname:user:pass' | |
19:28 | owen | Oh, sorry, I wasn't thinking |
19:28 | Why doesn't it know those values? | |
19:30 | kados | I didn't add the sql to kohastructure.sql for 3.0 |
19:30 | it's a separate 'service' | |
19:30 | ie, not part of koha proper | |
19:30 | it's generic enough that it could be implemented for anything that needs spellchecking | |
19:32 | fbcit | kados: in zebradb/etc I see sort-string-utf.chr... |
19:32 | is this eq 'sortstring.chr' | |
19:32 | is this eq 'sort-string.chr' | |
19:35 | kados | yes |
19:37 | fbcit | kados: so I'm going with -marc21 and -unimarc suffix's... see any problems? |
19:39 | kados | ok, sorry, had a phone call |
19:39 | so this is interesting | |
19:40 | the *.chr file isn't really a unimarc vs marc21 thing | |
19:40 | it's more a language thing | |
19:40 | in fact, it's entirely a language thing | |
19:40 | lemme check the frenh one | |
19:41 | fbcit | k |
19:41 | kados | ok, right |
19:41 | it's language-specific | |
19:41 | the important differences between french and english | |
19:42 | are the articles | |
19:42 | in France, articles are Le, La, Les, etc. | |
19:42 | in English, The, the, a, A, An, etc. | |
19:42 | and we ignore those for sorting purposes | |
19:42 | this is interesting | |
19:43 | fbcit | I see.. hence the current suffix '_french' |
19:43 | kados | yea |
19:43 | fbcit | these are stopwords? |
19:44 | kados | stopwords specifically for sorting |
19:44 | if you look in default.idx | |
19:44 | that's where the index types are defined | |
19:44 | one type is 's' for 'sort' | |
19:44 | and that's the charmap that's defined there | |
19:44 | sort-string-utf8.chr | |
19:44 | there's a turkish one floating around as well | |
19:44 | that we should add | |
19:45 | and I'll have an arabic one by the end of next week | |
19:46 | this is what makes zebra so great and at the same time so hard to set up | |
19:47 | fbcit | so there is a diff default.idx per language? |
19:48 | kados | perhaps that's the best way to approach it |
19:48 | well | |
19:48 | it depends | |
19:48 | we might be able to do it with symlinks | |
19:48 | ie, symlink sort-string.chr to the appropriate language .chr file | |
19:48 | fbcit | we could setup for multi-lang and wrap the marc issue up inside |
19:48 | kados | ditto with the record.abs |
19:48 | fbcit | interesting... |
19:50 | kados | that'd be very apacheish |
19:51 | fbcit | so have Makefile.PL build the correct symlinks? |
19:51 | kados | in theory that should work |
19:52 | and we could have a little utility to change them | |
19:52 | kinda like a2enmod | |
19:52 | does that make sense? | |
19:52 | we should test to make sure that zebra won't complain if we use symlinks | |
19:52 | fbcit | in theory... ;-) |
19:53 | kados | no sense writing code for something that doesn't work |
19:53 | it's too bad the web installer couldn't have write access, this would be sooo much easier | |
19:53 | fbcit | can't we do 'su' inside a perl script? |
19:53 | or sudo? | |
19:54 | the password would be an issue.... | |
19:55 | otherwise 'qx(sudo foo)' | |
19:55 | kados | yea |
19:55 | fbcit | where 'foo' does the file moves? |
19:56 | might be somewhat dangerous, though. | |
20:01 | lrwxrwxrwx 1 root root 6 2007-11-13 14:51 default.idx -> us.idx | |
20:01 | fbcit:/usr/share/koha/etc/zebradb/etc# zebrasrv -c /usr/share/koha/etc/koha-conf.xml | |
20:01 | 14:52:14-13/11 [log] zebra_start /usr/share/koha/etc/koha-conf.xml 1.3.50 | |
20:01 | 14:52:14-13/11 [server] Adding dynamic listener on tcp:@:9999 id=0 | |
20:01 | 14:52:14-13/11 [server] Starting server zebrasrv pid=19409 | |
20:01 | kados | sweet |
20:02 | but lets keep default.idx as is | |
20:02 | and create symlinks for the .chr files | |
20:02 | fbcit | k |
20:04 | lrwxrwxrwx 1 root root 22 2007-11-13 14:54 sort-string-utf.chr -> sort-string-utf-us.chr | |
20:04 | zebra says the same as before | |
20:05 | kados: shall we wrap the marc issue up inside the language issue? | |
20:05 | or keep it separate? | |
20:06 | kados | separate |
20:06 | because, for instance, there are english users of unimarc | |
20:07 | fbcit | I am thinking of an altered dir structure... ie zebradb/etc/lang/en... to hold language specific files |
20:08 | or is this too much? | |
20:08 | zebradb/biblios/etc/lang/en and biblios/etc/marcflavour/marc21 | |
20:09 | kados | no, that's fine |
20:28 | fbcit | kados: the default lang is en, right? |
20:28 | kados | yes |
20:29 | fbcit | so why don't we build sym links in which default zebra to en and marc21, then let Makefile.PL write new ones if specified? |
20:29 | kados | sounds good |
20:29 | can we get git to store symlinks? | |
20:29 | also, that approach won't work on windows | |
20:29 | fbcit | I thought of M$ earlier... |
20:29 | kados | arrg |
20:29 | M$-- | |
20:30 | fbcit | I think that NTFS does some sort of symlink.... |
20:30 | kados | but we do have a big Koha Windows contingency |
20:30 | fbcit | ouch |
20:31 | kados: from google: | |
20:31 | NTFS 5.0 supports what they call junctions, which are similar to | |
20:31 | symbolic links, on an NTFS filesystem. They also allow hard links, | |
20:31 | which are essentially the same as hard links in Unix. | |
20:32 | kados | yea |
20:32 | but most koha windows users aren't running ntfs I'm guessing | |
20:32 | I woudln't want to tie our design choices to a specific os | |
20:32 | I mean ... filesystem | |
20:32 | arrg | |
20:32 | unless we just decide this installer i just for *nix | |
20:32 | and the windows package maintainer has to make up his own stuff :) | |
20:33 | yea | |
20:33 | and adding a big warning somewhere to the web installer | |
20:33 | to explain what needs to be done | |
20:34 | fbcit | I have played with windows istaller.... yuk! |
20:34 | installer | |
20:34 | kados | :-) |
20:34 | fbcit | at some point we could write a Makefile.PL eq in msi... |
20:36 | the wisdom of #git says that git will track symlinks. | |
20:51 | kados? | |
20:55 | atz | he's in a brief meeting, presently |
23:55 | kados | hiya fbcit-away |
23:55 | hiya fbcit-1 | |
23:55 | fbcit-1: pushed up your patches just now | |
23:58 | fbcit-1 | I saw. |
23:59 | I'm trying to figure out how to have make write symlinks. | |
00:08 | atz | ok I granted select on mysql.time_zone_name for rch jmf cfc frc and gmc |
00:09 | so we can test this timezones thing (on arwen) | |
00:14 | we now have 1685 rows in mysql.time_zone_name ! | |
00:17 | kados | wow |
00:18 | atz | (that's how many are in /usr/share/zoneinfo |
00:18 | ) | |
00:21 | kados: i agree, i think we need a Localization tab | |
00:22 | did you start on that, or can I do it? | |
00:27 | kados | you can do it |
00:27 | just a matter of adding it to systempreferences.pl | |
00:27 | and moving all the localization things to that tab | |
00:27 | atz | right |
00:27 | kados | dateformat |
00:27 | atz | like date format |
00:28 | kados | :-) |
00:28 | atz | :) |
00:28 | chris | and spelling it localisation :-) |
00:28 | kados | hehe |
00:28 | chris: you brit you | |
00:28 | chris | we need to localise our localization |
00:29 | i always lose at scrabble, because we have fair less words with z in it that you guys :) | |
00:29 | kados | hehe |
00:29 | en-US | |
00:30 | we were missing a ton of libraries in here | |
00:30 | atz | s/(fla|col|fav)or/$1our/g; |
00:32 | chris | *grin* |
00:34 | kados | still are but I added a few |
00:34 | chris: passing off to you | |
00:34 | oops | |
00:34 | did this one in my rmtest | |
00:34 | I'll just push it up | |
00:41 | fbcit-1: any progress? | |
00:44 | fbcit-1 | are you familiar with Module::Build? |
00:44 | kados | I'm not |
00:45 | fbcit-1 | According to the maintainer of MakeMaker, Module::Build is to replace it |
00:45 | kados | huh |
00:45 | fbcit-1 | Apparently CPAN depends on MakeMaker, but CPANPLUS uses Module::Build...anyhow |
00:46 | I can't find much on symlinks and make | |
00:46 | I did the file/dir changes in my clone | |
00:46 | added the symlinks | |
00:46 | ran make && make install | |
00:47 | kados | and it's happy? |
00:47 | fbcit-1 | make followed the symlinks and installed the actual file rather than the link |
00:47 | zebra works, but no symlinks | |
00:47 | kados | ahh |
00:48 | well | |
00:48 | that's probably OK | |
00:48 | can make rename files? | |
00:48 | fbcit-1 | there must be a way to tell make to build symlinks rather than simply doing cp'g |
00:48 | kados | that might be more portable actually |
00:48 | cp filename newfilename | |
00:48 | rather than symlinks? | |
00:48 | might be easier in the short term | |
00:49 | fbcit-1 | another point concerning makemaker: it is platform dependent since it uses make... |
00:49 | M::B is not platform dependent, but is pure perl | |
00:49 | kados | right |
00:49 | hmmm | |
00:49 | what would be involved in porting? | |
00:49 | yea | |
00:49 | that's what I'm thiking | |
00:49 | fbcit-1 | the coversion to M::B is supposed to be very straightforward. |
00:50 | there is a makemake wrapper for it also | |
00:50 | kados | yea, this sounds like the ticket |
00:50 | I'm confused why neither of these has an uninstall option | |
00:51 | fbcit-1 | because koha should never be uninstalled... :-) |
00:51 | kados | hehe |
00:53 | "Natively, Module::Build provides default installation locations for the following types of installable items:" | |
00:53 | fbcit-1 | I think we can have the makefile built based on lang/marcflavour |
00:53 | kados | hmmm |
00:55 | "If you do not need to retain compatibility with ExtUtils::MakeMaker or are starting a fresh Perl installation we recommand you use "install_base" instead (and "INSTALL_BASE" in ExtUtils::MakeMaker). See "Instaling in | |
00:55 | the same location as ExtUtils::MakeMaker" in Module::Build::Cookbook for further information." | |
00:55 | which do we use? | |
00:55 | fbcit-1 | if the switch to M::B makes sense, now is the time to do it. |
00:56 | kados | yea |
00:56 | I think this should be discussed on koha-devel | |
00:56 | make sure that MJ doesn't have a reason he picked MakeMaker over M::B | |
00:58 | fbcit-1 | we may need to abandon the idea of symlinks in light of the multi-os issues (although I think they are a neat approach). |
01:03 | interesting: | |
01:03 | One advantage of Module::Build is that since it's implemented as Perl methods, you can invoke these methods directly if you want to install a module non-interactively. For instance, the following Perl script will invoke the entire build/install procedure | |
01:05 | so running ./kohainstall.pl prompts the admin for possible vars, supplying defaults if not overridden, and then does make && make install all in one shot. | |
01:09 | kados: we use PREFIX= | |
01:21 | kados: I posted the thought to koha-devel | |
01:26 | unless I am mistaken, uninstalling is just a matter of deleting three or so subdirs and dropping a db. That could be scripted. | |
01:42 | kados | sorry fbcit-1 |
01:43 | I like the idea of ./kohainstall.pl | |
01:48 | fbcit-1: did you see that weird message on koha-devel that someone's getting about a missing colon after yazgfs? | |
01:49 | ahh, he was doing -c | |
01:50 | and yet that works for you | |
01:50 | weird | |
01:50 | it should be -f though | |
01:50 | fbcit-1: did you update that or should I? | |
01:58 | fbcit-1: I'm gonna go wild on the README.txt :-) | |
01:59 | fbcit-1 | kados: I did not update it because it worked for me. Sorry. You can... |
01:59 | kados | will do |
02:00 | fbcit-1 | sys admins have to know something as a prereq :-) |
02:02 | kados | hehe |
02:02 | well ... | |
02:03 | we'll have a chance to write up some detailed docs once we release the 3.0 beta | |
02:03 | now that things are settling down should be easier | |
02:03 | only I think two more features and a few enhancements/bugs holding us back | |
02:03 | and a possible shift to a new installer ;-) | |
02:04 | fbcit-1: I added you to the credits page :-) | |
02:04 | fbcit-1 | tnx |
02:04 | I need to load up sample data into pg and pound it | |
02:05 | there may not be quite as many mysqlisms as might be feared. | |
02:05 | kados | sweetness |
02:05 | fbcit-1 | you might should mention that the pg port is alpha in case I don't get it completed in time... |
02:06 | kados | loading data is pretty simple |
02:06 | I have a batch you could try if you're interested | |
02:06 | you basically just run: | |
02:06 | export KOHA_CONF=/path-to-koha-conf.xml | |
02:07 | perl misc/migration_tools/bulkmarcimport -file /path/to/marc.mrc | |
02:07 | then ... there are two options | |
02:07 | long and easy way is: | |
02:08 | (long meaning it takes forever) | |
02:08 | start zebra: | |
02:08 | zebrasrv -f /path/to/koha-conf.xml | |
02:08 | and -D if you want to start it as a daemon | |
02:08 | then: | |
02:08 | perl misc/cronjobs/zebraqueue_start.pl | |
02:08 | and go get a pizza :-) | |
02:09 | wget http://kados.org/stuff/outkoha.mrc | |
02:09 | that's your MARC records if you wanna try | |
02:09 | there's a quick but complicated way if you're impatient | |
02:09 | fbcit-1 | I'll grab them tomorrow after gk class and give it a whirl. |
02:10 | kados | if you have 2 minutes right now you could do it |
02:10 | wget http://kados.org/stuff/outkoha.mrc | |
02:10 | export KOHA_CONF=/opt/koha/etc/koha-conf.xml | |
02:10 | perl misc/migration_tools/bulkmarcimport -file | |
02:10 | ahh | |
02:10 | ok :-) | |
02:11 | fbcit-1 | I was getting pounded pretty hard on ssh so I closed up the port... |
02:11 | kados | ahh |
02:11 | fbcit-1 | don't have time to harden that port on my firewall... sorry. |
02:11 | kados | :-) |
02:13 | fbcit-1 | I need to finish porting the latest kohastructure.sql to pg prior to importing that data. |
02:13 | which brings up another *issue*... | |
02:14 | kados | hehe |
02:14 | fbcit-1 | keeping the two db ports in sync with most devs working on the mysql side... |
02:14 | kados | yea, I'm sorry, there have been some db changes recently |
02:14 | yea, do you have ideas for that? | |
02:14 | I noticed you moved updatedatabase into the mysql dir | |
02:14 | are there mysqlisms in there>? | |
02:15 | fbcit-1 | I peeked, but did not have time to really get into it... git was hot on my heals.... |
02:15 | kados | k |
02:15 | it would be ideal if we could have only generic sql in updatedatbase | |
02:16 | otherwise it's gonna be a nightmare to keep everything in sync | |
02:16 | fbcit-1 | Are most db updates done both in updatedatabase & kohastructure? |
02:16 | kados | all of them are |
02:16 | fbcit-1 | that would be ideal |
02:16 | kados | yep, all of them are |
02:16 | fbcit-1 | so kohastructure changes only on major releases? |
02:16 | kados | that's the idea |
02:16 | well ... | |
02:17 | it changes all the time | |
02:17 | concurrent with updatedatabase | |
02:17 | fbcit-1 | I thought that |
02:17 | kados | and the versioning scheme ensures that only the updates you haven't got will be applied |
02:18 | fbcit-1 | I had thought about having patches which involve sql cc'd to an email address to me so I would be sure to see those and port them... |
02:18 | I don't like mysql's INSERT IGNORE.... | |
02:19 | kados | that'd be great |
02:19 | fbcit-1 | seems dangerous |
02:19 | I'll setup an email addr and get it to you. | |
02:20 | kados | k |
02:37 | chris | heh, those are pretty old |
02:37 | fbcit-1 | which ones? :-) |
02:37 | chris | the katipo ones are old |
02:38 | fbcit-1 | my screen is blank... |
02:38 | http://www.cafepress.com/koha/ | |
02:38 | chris | ahh |
02:39 | we did those in feb 2003 | |
02:39 | i cant even get to cafepress | |
02:40 | fbcit-1 | maybe we could embed koha in a mug that would index various international coffees... ;-) |
02:40 | chris | heh |
02:40 | someone had koha running on their playstation | |
02:41 | its a short step from there to a coffee mug :) | |
02:43 | kados | hehe, or a digital watch :-) |
02:43 | that rocked :-) | |
02:46 | fbcit-1 | I wonder if you could install it on a wap using white russian? |
02:48 | looks like your windows port has some sort of installer? | |
02:49 | kados | yea, there's someone who maintains that separately from mainline koha's installer |
02:49 | unfortunately he uses a proprietary packaging system | |
02:49 | i wonder if there is such a thing as a open source windows packaging system | |
02:50 | fbcit-1 | there is... hold on... |
02:50 | wix... | |
02:51 | released on sourceforge by.... | |
02:51 | M$ | |
02:51 | http://wix.sourceforge.net/ | |
02:51 | now... have fun... :-P | |
02:52 | I worked with it for awhile trying to work up a win32 installer for another project. | |
02:53 | it uses xml files to configure and produces msi files. | |
03:08 | kados | fbcit-1 takes over the whole installer for Koha :-) |
03:14 | fbcit-1 | you can file a feature request... ;-) |
09:31 | paul | chris around ? |
← Previous day | Today | Next day → | Search | Index