--- Log opened Mon Feb 06 00:00:42 2017 00:05 #navit: < jkoan> Hi again pmckinley yes I have seen a map driver like this also. But probably I don't have a file to test it. But with source code I could figure out that the drivers name is "shapefile" and so the configuration line in navit configuration would be: 00:10 #navit: < jkoan> 00:10 #navit: < jkoan> 00:10 #navit: < jkoan> 00:11 #navit: < jkoan> Where I don't know if the extension is right 00:16 #navit: < jkoan> Please let me know if it works :) 01:29 -!- xenos1984 [~xenos1984@2001:bb8:2002:200:6651:6ff:fe53:a120] has joined #navit 02:43 -!- jjelen [jjelen@nat/redhat/x-hpodxiodzjlnaine] has joined #navit 03:44 -!- noradtux [~noradtux@port-11727.pppoe.wtnet.de] has quit [Ping timeout: 260 seconds] 03:48 -!- noradtux [~noradtux@2a02:2028:64b:b00::1] has joined #navit 04:40 #navit: < pmckinley> hi jkoan thank you for your effort! Sadly when I configure navit.xml as suggested Navit no longer launches at all (spinning mouse pointer for 15s then nothing). When I revert back to my Ireland.bin file from Navit's Planet Extractor site all is good again. 04:41 #navit: < pmckinley> 04:42 #navit: < pmckinley> i will try it your suggestion with a different shapefile, this time from OSM 04:59 #navit: < pmckinley> no the OSM derived Shapefile for Ireland I just downloaded from http://download.geofabrik.de/europe/ireland-and-northern-ireland.html was exactly the same result, Navit does not launch at all 05:00 #navit: < pmckinley> 05:01 #navit: < pmckinley> Like I said, my ireland.bin from Planet Extractor works fine 05:07 #navit: < pmckinley> If you were interested to investigate further, the .shp file from Geofabrik for the Isle of Man is only 3.1MB in size 05:07 #navit: < pmckinley> http://download.geofabrik.de/europe/isle-of-man.html 05:08 #navit: < pmckinley> It gives exactly the same result, Navit won't launch 05:09 #navit: < pmckinley> Geofabrik's maps are derived from OSM, same as Navit's own maps, so it's a good reliable place to start. Do you think you can help? 05:56 #navit: < jkoan> pmckinley: do you have only one active mapset? and whats the log output (please at pastebin or so)? maybe you sould run navit over console to see the log 07:03 #navit: < jkoan> kazer: another verry interesting point are the poly files like http://download.geofabrik.de/europe/germany/berlin.poly with the border of the region 07:07 #navit: < jkoan> and with Mapsplit (for example) we could use those files to get nice region data. More infos: http://wiki.openstreetmap.org/wiki/Osmosis/Polygon_Filter_File_Format 07:51 -!- pmckinley [586ed3af@gateway/web/freenode/ip.88.110.211.175] has quit [Ping timeout: 260 seconds] 10:52 -!- xenos1984 [~xenos1984@2001:bb8:2002:200:6651:6ff:fe53:a120] has quit [Quit: Leaving.] 11:17 -!- bzed [~bzed@shell.bzed.at] has quit [Ping timeout: 256 seconds] 11:19 -!- bzed [~bzed@shell.bzed.at] has joined #navit 11:42 -!- jjelen [jjelen@nat/redhat/x-hpodxiodzjlnaine] has quit [Ping timeout: 240 seconds] 11:49 -!- xenos1984 [~xenos1984@22-164-191-90.dyn.estpak.ee] has joined #navit 12:01 -!- Beluc [~androirc@80.215.8.33] has joined #navit 12:10 -!- Beluc [~androirc@80.215.8.33] has quit [Quit: AndroIRC - Android IRC Client ( http://www.androirc.com )] 12:11 -!- Beluc_taf [~Beluc@proxy-109-190-254-43.ovh.net] has joined #navit 12:12 #navit: < jkoan> Kazer does we have the latest source code of the map server online on github? 13:06 -!- Beluc_taf [~Beluc@proxy-109-190-254-43.ovh.net] has quit [Quit: Leaving] 13:15 -!- gernot_ [5496985f@gateway/web/freenode/ip.84.150.152.95] has joined #navit 13:15 #navit: < gernot_> just compared the size ob pbf bin and shapefile. 13:18 #navit: < gernot_> Bayern: pbf:530M shp.zip:740M bin:340M 13:19 #navit: < gernot_> If you want a small map get the pbf from geofabrik and use maptool to convert it to a binary. 13:21 #navit: < gernot_> I use this for bayern but dont find some small towns in search because not all boundarys are complete. 13:22 #navit: < jkoan> Yes I agree with you that this is the best solution, but this isn't the point. We have support for the shapefile so we should have documentation for it ;) 13:23 #navit: < gernot_> ok 13:24 #navit: < gernot_> Shapefile is enabled in my built. Unzipped you the shapefile.zip ? 13:27 #navit: < jkoan> I don't want shapefiles ;) and haven't tested it. pmckinley what it. Right now I haven't time to test 13:27 #navit: < gernot_> hope he read it 13:27 #navit: < jkoan> But if I test it I would definitely unzip it :D 13:27 #navit: < jkoan> He is not online :x 13:27 #navit: < gernot_> too 13:30 #navit: < jkoan> do you know who knows about the planet extractor? 13:30 #navit: < gernot_> no. 13:30 #navit: < jkoan> okay :X 13:30 #navit: < gernot_> at the moment hi has a problem with waterlines 13:31 #navit: < gernot_> hi =he 13:31 #navit: < jkoan> the planet extractor? 13:32 #navit: < gernot_> yes. there are some blue bocks on the map. 13:32 #navit: < gernot_> not tested the last month... 13:34 #navit: < jkoan> i want to work a little bit on the server software. so sometime i will take a look if i know where the source is :X 13:34 #navit: < gernot_> ok 13:36 #navit: < gernot_> unzip a shapefile shows many files 13:36 #navit: < jkoan> so hopefully kazer will be online soon and have new informations for us 13:38 #navit: < jkoan> hm :/ i will take a look in the next minutes on the shapefiles 13:45 #navit: < gernot_> Ok. I think navit shapefile and geofabtik shapefile are noct compatible. 13:45 #navit: < gernot_> navit search for files wirh the .dbfmap extention. 13:46 #navit: < gernot_> shapefile hold .dbf and .map in seperate files 14:21 #navit: < jkoan> where navit searches for .dbfmap files? 14:29 #navit: < kazer> hi there 14:29 #navit: < jkoan> hi :))) 14:29 #navit: < gernot_> hi 14:29 #navit: < jkoan> did you read everything? :D 14:29 #navit: < kazer> working on it :) 14:30 #navit: < jkoan> okay (Y) 14:31 #navit: < gernot_> I get such "xyz.dbfmap not found" messages on the console if i load shapefile "xyz" 14:31 #navit: < jkoan> oh okay i only get http://pastebin.com/XpBuC2wD 14:33 #navit: < kazer> jkoan: the mapserver code license isn' 14:33 #navit: < gernot_> my system crash also if i just deliver the zip 14:33 #navit: < kazer> isn't clear, so we cannot publish it for now. We need to rewrite it (but it should not be too hard) 14:33 #navit: < jkoan> same here 14:34 #navit: < gernot_> I think there shold be at least a second source for shapefiles. 14:34 #navit: < kazer> gernot_: the blue blocks are caused by an unclosed ocean/river contour during map processing. it happens a lot when processing small subsets of maps unfortunately 14:34 #navit: < jkoan> kazer: so you could also not give the souce to me? :D so i could take a look? 14:35 #navit: < gernot_> make it sense to rewrite shapefile just for geofabrik 14:36 #navit: < kazer> jkoan: i did not write it, so it's tricky. but basically it extracts files from a zip archive 14:36 #navit: < gernot_> kazer: ok 14:37 #navit: < gernot_> It also look that shapefiles are big after unzip 14:39 #navit: < jkoan> what about an Algorithmen witch processes the areas like geofabrik? http://download.geofabrik.de/technical.html and drop the support for selecting an spezific area? 14:39 #navit: < kazer> yes, like binfiles :) i believe an unzipped planet.bin would be ~500GB (vs 23 compressed) 14:40 #navit: < kazer> jkoan: yes i want to move the area selection to the UI. that's the point of the map downloader code. then the server side only needs to extract the tiles that match a bounding box 14:40 #navit: < kazer> much simpler 14:41 #navit: < jkoan> my idea would be that the server pre prozesses the data ever day and than stores it so no on demend prozess is needed 14:44 #navit: < gernot_> I think so is it at the moment 14:46 #navit: < gernot_> the world is calculated in 0.1° tiles 14:46 #navit: < jkoan> oh :O that is a new information 14:47 #navit: < jkoan> so everything could probably static and the "on demand" download anly packs the titles to one bin file? 14:48 #navit: < gernot_> planetexplorer deliver all tiles and some boundery information in the selected rectangle. 14:50 #navit: < gernot_> Just compare the speed difference between downloading abinfile or building it with maptool 14:51 #navit: < kazer> yep exactly. We have a batch processing on the map on our main server. This is what is making the wiki+forums so slow, the processing is really cpu intensive 14:51 #navit: < jkoan> yes... i also wondert why the extractor is so fast :D 14:51 #navit: < jkoan> when prozessing happens? 14:51 #navit: < gernot_> I dont know 14:57 #navit: < jkoan> so what do you think would be the best solution to get less cpu prozessing and optimize the extractor? @kazer? 14:58 #navit: < jkoan> would it make sense to only deliver predefined areas? 15:01 #navit: < jkoan> for users i think we could improve the frontend without rewrite the backend. but if we want to rewrite it we could say that we rewrite it with an api change and build an frontend ontop of the new api 15:01 #navit: < gernot_> I think the actual system is good. 15:01 #navit: < jkoan> frontend or backend? 15:02 #navit: < gernot_> It wourld be nice to select polygons intead a rectangle. 15:03 #navit: < gernot_> the backend is good 15:03 #navit: < jkoan> this sould be possible with poly files like : http://download.geofabrik.de/europe.poly 15:04 #navit: < jkoan> but the backend probably needs to improved :X 15:05 #navit: < gernot_> I think it is not the target to select exact a country. I'd like to select a region with 10 klicks around it 15:08 #navit: < jkoan> hm... and you want a file which exactly represents this klicks, or do you want to select multiple defined areas to one big? so for example bayern and Baden Württemberg in one file? 15:08 #navit: < kazer> what do you mean by only delivering predefined area? bypass the extractor and only serve pre-extracted files? 15:09 #navit: < kazer> gernot_: polygons are expensive compute, because currently we only check if a specific tile (which is always rectangular) is within a bounding box 15:10 #navit: < jkoan> only serving pre extracted files yes. because i tough the extractor prozesses the files on demand 15:10 #navit: < kazer> delivering polygon-based maps would probably required to extract the map beforehand, i think that in realtime the performance impact would be non negligeable 15:11 #navit: < kazer> so, the workflow is that we process OSM updates using maptool, which generates an updated planet.bin. Then we serve extracts of that map using the mapserver 15:11 #navit: < gernot_> kazer: yes, i know. But i think on a system like "flood fill" in paint programms 15:11 #navit: < kazer> we could serve pre-processed extracts, but it would required a lot more disk space 15:11 #navit: < kazer> (on the server) 15:12 #navit: < jkoan> probably we could combine both with small 0.1° tiles inside the big poly 15:12 #navit: < gernot_> I think only predifined areas are a big step back. 15:14 #navit: < gernot_> and much much work to define the areas 15:14 #navit: < jkoan> my last point would extract the 0.1° tiles in the area also on demand so custom areas would also be possible 15:14 #navit: < jkoan> no we could get them from geofabrik 15:14 #navit: < kazer> i am not sure that polygons are really worth it in terms of disk space savings. Especially for smallish zones. 15:15 #navit: < kazer> jkoan: geofabrik do not have polygons for all the countries 15:15 #navit: < jkoan> really? 15:15 #navit: < kazer> the link you shared a week or two ago was better 15:15 #navit: < kazer> yep 15:16 #navit: < jkoan> hm :/ 15:18 #navit: < gernot_> A other idea.... select multiple rectangles....deliver as one binary 15:18 #navit: < jkoan> wasn't that what I said? 15:19 #navit: < gernot_> No. I think just a button on the actual select dialog. "add rectangle" 15:20 #navit: < kazer> are you guys talking about the webui at http://maps.navit-project.org ? 15:20 #navit: < jkoan> kazer do you think it would make sense to rework the frontend before the backed? 15:21 #navit: < gernot_> kazer: Yes. With such a button you can select germany and austria into one binary. 15:22 #navit: < jkoan> oh the frontend=webui... not the best... this probably need a re design if you ask me 15:25 #navit: < kazer> my own vision was to get rid of that frontend and just implement that in navit itself. have you guys tried the map download on android? 15:25 #navit: < kazer> you could download germany and austria in two files, navit will still use them as a single map source 15:25 #navit: < jkoan> yes of course 15:26 #navit: < jkoan> I think its a good solution 15:26 #navit: < gernot_> no, no andruid 15:26 #navit: < gernot_> ok 15:29 #navit: < jkoan> at this moment I hold one Android device in each hand ^^ so I even know navit on Android ;) 15:29 #navit: < kazer> gernot_: i'll share screenshots. In short, you have a menu with a hierarchy of maps, like planet>Europe>Germany and you can download the maps from there 15:29 #navit: < kazer> jkoan: haha sweet 15:29 #navit: < gernot_> ah 15:29 #navit: < kazer> gernot_: one of the many benefits is that you don't have to fiddle with your config, or wonder where to put the maps. 15:30 #navit: < jkoan> yes decently 15:30 #navit: < kazer> gernot_: this branch : https://github.com/navit-gps/navit/tree/curl_download implements a proof of concept for other platforms 15:31 #navit: < gernot_> I try it 15:32 #navit: < kazer> cool. Next step is to build a list of areas, and fetch that list from navit to display it (for this POC i used a static url) 15:34 #navit: < jkoan> static URL or api ? 15:34 #navit: < jkoan> as you know I have tested it and it worked:) 15:36 #navit: < kazer> the static url is for the map that is being downloaded in the code branch i shared, to implement a generic map download in navit (instead of the android-specific one) 15:37 #navit: < kazer> the android map downloader also use a static list of areas.. and the map sizes are also static in that list so they are probably wrong by now :) 15:43 #navit: < jkoan> so you would move the defined areas out of the Android app and navit software and load it over internet? 15:46 #navit: < kazer> yep, like in a json, so that we always server up to date info, and so that we don't need an app update when we modify the areas 15:47 #navit: < jkoan> this is nice 15:47 #navit: < jkoan> do you patch the config automatically? 15:49 #navit: < kazer> no need to, we just need to put the maps in the right folder 15:50 #navit: < gernot_> verry good 15:50 #navit: < jkoan> but right now folders are not auto scanned? 15:54 #navit: < kazer> they are using the default config. This code also forces a refresh of the map list once the map is downloaded, so no need to restart navit to activate a freshly downloaded map 15:55 #navit: < gernot_> i have to go 15:55 #navit: < gernot_> by 15:55 #navit: < jkoan> bu 15:55 -!- gernot_ [5496985f@gateway/web/freenode/ip.84.150.152.95] has quit [] 15:55 #navit: < jkoan> fuuu 15:55 #navit: < jkoan> *by 15:55 #navit: < jkoan> kazer do the download is no bin? 15:56 #navit: < jkoan> *so 16:13 -!- beluc [~androirc@4-81-190-109.dsl.ovh.fr] has joined #navit 16:19 #navit: < kazer> beluc! 16:20 #navit: < beluc> Bordel dur de se capter :) 16:20 #navit: < kazer> jkoan: what do you mean? 16:20 #navit: < beluc> Viens en pv gros ! 16:20 #navit: < kazer> beluc: yep :) -> pm 16:21 #navit: < jkoan> the standard config does not load bin files it only loads XML right 16:22 #navit: < jkoan> all thought I don't understand French 16:26 #navit: < kazer> the xml can point to *.bin 16:30 #navit: < jkoan> okay,than Nice 17:16 -!- beluc [~androirc@4-81-190-109.dsl.ovh.fr] has quit [Read error: Connection reset by peer] 18:33 -!- redurgam [redurgam@gateway/shell/panicbnc/x-ksbkvbakeyndphya] has joined #navit 18:34 -!- Netsplit *.net <-> *.split quits: kazer, magruder 18:40 -!- Netsplit over, joins: kazer 19:01 -!- xenos1984 [~xenos1984@22-164-191-90.dyn.estpak.ee] has quit [Quit: Leaving.] 19:28 -!- pmckinley [586ed59d@gateway/web/freenode/ip.88.110.213.157] has joined #navit 19:38 #navit: < pmckinley> Hi kazer / jkoan 19:39 #navit: < pmckinley> kazer, when you say "i did not write it, so it's tricky. but basically it extracts files from a zip archive" 19:40 #navit: < pmckinley> can you tell me what the line in navit.xml should be when using a Shapefile? And should the Shapefile stay zipped as you seem to be suggesting? 19:59 -!- Horwitz [~mich1@p200300800E063C00022268FFFE64E7C4.dip0.t-ipconnect.de] has quit [Ping timeout: 264 seconds] 20:10 #navit: < pmckinley> kazer: by the way, who did write it? 20:12 #navit: < pmckinley> tried to configure navit.xml to use zipped Ireland Shapefile from Geofabrik, the result is the same, Navit wont launch 20:12 -!- Horwitz [~mich1@p200300800E050A00022268FFFE64E7C4.dip0.t-ipconnect.de] has joined #navit 20:12 -!- mode/#navit [+o Horwitz] by ChanServ 20:15 #navit: < pmckinley> 20:16 #navit: < pmckinley> Navit wont launch. When I revert to my Ireland binfile from Planet Extractor, Navit works fine 23:21 -!- pmckinley_ [586ed59d@gateway/web/freenode/ip.88.110.213.157] has joined #navit 23:26 -!- pmckinley_ [586ed59d@gateway/web/freenode/ip.88.110.213.157] has quit [Ping timeout: 260 seconds] --- Log closed Tue Feb 07 00:00:20 2017