A request to osrm-routed can be assigned to a thread which is currently busy processing another request, even when there are other threads/cores available. This unnecessarily delays the response, and can make requests appear to hang when awaiting CPU intensive requests to finish. The issue looks like a bug in Boost.Asio multithreaded networking stack. osrm-routed server implementation is heavily influenced by the HTTP server 3 example in the Boost.Asio docs. By upgrading to Boost 1.70 and updating the server connections to match the example provided in the 1.70 release, the problem is resolved. The diff of the changes to the Boost.Asio stack are vast, so it's difficult to identify the exact cause. However the implementation change is to push the strand of execution into the socket (and timer) objects, which suggests it could fix the type of threading issue we are observing.
51 lines
2.3 KiB
Docker
51 lines
2.3 KiB
Docker
FROM debian:bullseye-slim as builder
|
|
ARG DOCKER_TAG
|
|
ARG BUILD_CONCURRENCY
|
|
RUN mkdir -p /src && mkdir -p /opt
|
|
COPY . /src
|
|
WORKDIR /src
|
|
|
|
RUN NPROC=${BUILD_CONCURRENCY:-$(grep -c ^processor /proc/cpuinfo 2>/dev/null || 1)} && \
|
|
apt-get update && \
|
|
apt-get -y --no-install-recommends install cmake make git gcc g++ libbz2-dev libxml2-dev \
|
|
libzip-dev libboost1.74-all-dev lua5.2 liblua5.2-dev libtbb-dev -o APT::Install-Suggests=0 -o APT::Install-Recommends=0 && \
|
|
echo "Building OSRM ${DOCKER_TAG}" && \
|
|
git show --format="%H" | head -n1 > /opt/OSRM_GITSHA && \
|
|
echo "Building OSRM gitsha $(cat /opt/OSRM_GITSHA)" && \
|
|
mkdir -p build && \
|
|
cd build && \
|
|
BUILD_TYPE="Release" && \
|
|
ENABLE_ASSERTIONS="Off" && \
|
|
BUILD_TOOLS="Off" && \
|
|
case ${DOCKER_TAG} in *"-debug"*) BUILD_TYPE="Debug";; esac && \
|
|
case ${DOCKER_TAG} in *"-assertions"*) BUILD_TYPE="RelWithDebInfo" && ENABLE_ASSERTIONS="On" && BUILD_TOOLS="On";; esac && \
|
|
echo "Building ${BUILD_TYPE} with ENABLE_ASSERTIONS=${ENABLE_ASSERTIONS} BUILD_TOOLS=${BUILD_TOOLS}" && \
|
|
cmake .. -DCMAKE_BUILD_TYPE=${BUILD_TYPE} -DENABLE_ASSERTIONS=${ENABLE_ASSERTIONS} -DBUILD_TOOLS=${BUILD_TOOLS} -DENABLE_LTO=On && \
|
|
make -j${NPROC} install && \
|
|
cd ../profiles && \
|
|
cp -r * /opt && \
|
|
strip /usr/local/bin/* && \
|
|
rm -rf /src /usr/local/lib/libosrm*
|
|
|
|
|
|
# Multistage build to reduce image size - https://docs.docker.com/engine/userguide/eng-image/multistage-build/#use-multi-stage-builds
|
|
# Only the content below ends up in the image, this helps remove /src from the image (which is large)
|
|
FROM debian:bullseye-slim as runstage
|
|
RUN mkdir -p /src && mkdir -p /opt
|
|
RUN apt-get update && \
|
|
apt-get install -y --no-install-recommends libboost-program-options1.74.0 libboost-regex1.74.0 \
|
|
libboost-date-time1.74.0 libboost-chrono1.74.0 libboost-filesystem1.74.0 \
|
|
libboost-iostreams1.74.0 libboost-system1.74.0 libboost-thread1.74.0 \
|
|
expat liblua5.2-0 libtbb2 &&\
|
|
rm -rf /var/lib/apt/lists/*
|
|
COPY --from=builder /usr/local /usr/local
|
|
COPY --from=builder /opt /opt
|
|
RUN /usr/local/bin/osrm-extract --help && \
|
|
/usr/local/bin/osrm-routed --help && \
|
|
/usr/local/bin/osrm-contract --help && \
|
|
/usr/local/bin/osrm-partition --help && \
|
|
/usr/local/bin/osrm-customize --help
|
|
WORKDIR /opt
|
|
|
|
EXPOSE 5000
|