osrm-backend/traffic_updater
Xun(Perry) Liu c613b1737c Feature/traffic updater statistic (#44)
* feat: implement statistic for osrm traffic dumper.
issues: https://github.com/Telenav/osrm-backend/issues/43

* feat: Implement statistic for loading traffic map.
issues: https://github.com/Telenav/osrm-backend/issues/43

* fix: Experiment to use channel to collect statistic information.
issues: https://github.com/Telenav/osrm-backend/issues/43
2019-07-19 09:32:33 +08:00
..
go Feature/traffic updater statistic (#44) 2019-07-19 09:32:33 +08:00
.gitignore Use Go Modules to manage Go code's dependency (#42) 2019-07-18 17:08:37 -07:00
proxy.thrift Update proxy thrift RPC protocol (#29) 2019-06-26 11:29:58 -07:00
README.md feat: Implement logic to generate way-2-nodes mapping and convert traffic result to nodes-2-speed (#28) 2019-06-28 11:10:54 +08:00

OSRM Traffic Updater

The OSRM Traffic Updater is designed for pull traffic data from Traffic Proxy(Telenav) then dump to OSRM required traffic.csv. Refer to OSRM with Telenav Traffic Design and OSRM Traffic for more details.
We have implemented both Python and Go version. Both of them have same function(pull data then dump to csv), but the Go implementation is about 23 times faster than Python implementation. So strongly recommended to use Go implementation as preference.

  • E.g. 6727490 lines traffic of NA region
    • Go Implementation: about 9 seconds
    • Python Implementation: about 210 seconds

RPC Protocol

See proxy.thrift for details.

Python Implementation

The python based implementation has been deprecated due to bad performance. See Deprecated Python Implementation Codes if you'd like to see code details.

Go Implementation

Requirements

  • go version go1.12.5 linux/amd64
  • thrift 0.12.0
    • clone thrift from github.com/apache/thrift, then checkout branch 0.12.0
  • change thrift imports in generated codes gen-go/proxy
    • git.apache.org/thrift.git/lib/go/thrift -> github.com/apache/thrift/lib/go/thrift

Usage

$ cd $GOPATH
$ go install github.com/Telenav/osrm-backend/traffic_updater/go/osrm_traffic_updater
$ ./bin/osrm_traffic_updater -h
Usage of ./bin/osrm_traffic_updater:
  -c string
    	traffic proxy ip address (default "127.0.0.1")
  -d	use high precision speeds, i.e. decimal. (default false)
  -f string
    	OSRM traffic csv file (default "traffic.csv")
  -m string
    	OSRM way id to node ids mapping table (default "wayid2nodeids.csv")
  -p int
    	traffic proxy listening port (default 6666)

wayid2nodeids_extractor

Extract wayid to nodeids mapping from PBF

Usage

$ cd $GOPATH
$ go install github.com/Telenav/osrm-backend/traffic_updater/go/wayid2nodeid_extractor
$ ./bin/wayid2nodeid_extractor -h
Usage of ./bin/wayid2nodeid_extractor:
  -b	Is pbf generated by telenav internally
  -i string
    	Input pbf file.
  -o string
    	Output csv file