pgspider perl 语言扩展

perl 也算是一个小语言,但是功能很强大,以下是pgspider 集成perl的试用
以及docker基础镜像的制作,方便后期应用扩展使用

构建说明

基于源码构建,需要的配置参数./configure --with-perl

docker base 镜像

 
FROM debian:stretch-slim
RUN apt-get update && apt-get install -y build-essential git libperl-dev wget libreadline-dev zlib1g-dev
WORKDIR /app
RUN set -eux; \
   if [ -f /etc/dpkg/dpkg.cfg.d/docker ]; then \
   # if this file exists, we're likely in "debian:xxx-slim", and locales are thus being excluded so we need to remove that exclusion (since we need locales)
   grep -q '/usr/share/locale' /etc/dpkg/dpkg.cfg.d/docker; \
   sed -ri '/\/usr\/share\/locale/d' /etc/dpkg/dpkg.cfg.d/docker; \
   ! grep -q '/usr/share/locale' /etc/dpkg/dpkg.cfg.d/docker; \
   fi; \
   apt-get update; apt-get install -y locales; rm -rf /var/lib/apt/lists/*; \
   localedef -i en_US -c -f UTF-8 -A /usr/share/locale/locale.alias en_US.UTF-8
ENV LANG en_US.utf8
RUN set -eux; \
   apt-get update; \
   apt-get install -y --no-install-recommends libnss-wrapper; \
   rm -rf /var/lib/apt/lists/*
RUN wget https://ftp.postgresql.org/pub/source/v11.6/postgresql-11.6.tar.gz
RUN wget https://raw.githubusercontent.com/pgspider/pgspider/master/pgspider.patch
RUN tar xvf postgresql-11.6.tar.gz
RUN patch -p1 -d postgresql-11.6 < /app/pgspider.patch
RUN cd postgresql-11.6 \
   && ./configure --with-perl \
   && make && make install \
   && cd /app/postgresql-11.6/contrib/pgspider_core_fdw \
   && make && make install \
   && cd /app/postgresql-11.6/contrib/pgspider_fdw \ 
   && make && make install \
   && cd /app/postgresql-11.6/contrib \ 
   && make && make install
ENV PATH $PATH:/usr/local/pgspider/bin

集成pg_cron 的扩展

FROM dalongrong/pgspider:base-perl as build
WORKDIR /app
RUN apt-get update && apt-get install -y openssl 
RUN git clone https://github.com/citusdata/pg_cron.git /app/postgresql-11.6/contrib/pg_cron
RUN cd /app/postgresql-11.6/contrib/pg_cron && make && make install
FROM debian:stretch-slim
ENV GOSU_VERSION 1.11
RUN apt-get update && apt-get install -y wget libperl-dev openssl libreadline-dev
# explicitly set user/group IDs
RUN set -eux; \
   groupadd -r postgres --gid=999; \
# https://salsa.debian.org/postgresql/postgresql-common/blob/997d842ee744687d99a2b2d95c1083a2615c79e8/debian/postgresql-common.postinst#L32-35
   useradd -r -g postgres --uid=999 --home-dir=/var/lib/postgresql --shell=/bin/bash postgres; \
# also create the postgres user's home directory with appropriate permissions
# see https://github.com/docker-library/postgres/issues/274
   mkdir -p /var/lib/postgresql; \
   chown -R postgres:postgres /var/lib/postgresql
RUN wget -O /usr/local/bin/gosu "https://github.com/tianon/gosu/releases/download/$GOSU_VERSION/gosu-$(dpkg --print-architecture)" \
   && chmod +x /usr/local/bin/gosu \
   && gosu nobody true
# make the "en_US.UTF-8" locale so postgres will be utf-8 enabled by default
RUN set -eux; \
   if [ -f /etc/dpkg/dpkg.cfg.d/docker ]; then \
   # if this file exists, we're likely in "debian:xxx-slim", and locales are thus being excluded so we need to remove that exclusion (since we need locales)
   grep -q '/usr/share/locale' /etc/dpkg/dpkg.cfg.d/docker; \
   sed -ri '/\/usr\/share\/locale/d' /etc/dpkg/dpkg.cfg.d/docker; \
   ! grep -q '/usr/share/locale' /etc/dpkg/dpkg.cfg.d/docker; \
   fi; \
   apt-get update; apt-get install -y locales; rm -rf /var/lib/apt/lists/*; \
   localedef -i en_US -c -f UTF-8 -A /usr/share/locale/locale.alias en_US.UTF-8
ENV LANG en_US.utf8
# install "nss_wrapper" in case we need to fake "/etc/passwd" and "/etc/group" (especially for OpenShift)
# https://github.com/docker-library/postgres/issues/359
# https://cwrap.org/nss_wrapper.html
RUN set -eux; \
   apt-get update; \
   apt-get install -y --no-install-recommends libnss-wrapper; \
   rm -rf /var/lib/apt/lists/*
COPY --from=build /usr/local/pgspider /usr/local/pgspider
RUN sed -ri "s!^#?(listen_addresses)\s*=\s*\S+.*!\1 = '*'!" /usr/local/pgspider/share/postgresql/postgresql.conf.sample; \
   grep -F "listen_addresses = '*'" /usr/local/pgspider/share/postgresql/postgresql.conf.sample
RUN echo "shared_preload_libraries = 'pg_cron'" >> /usr/local/pgspider/share/postgresql/postgresql.conf.sample \
  && echo "cron.database_name = 'postgres'" >> /usr/local/pgspider/share/postgresql/postgresql.conf.sample
RUN mkdir -p /var/run/postgresql && chown -R postgres:postgres /var/run/postgresql && chmod 2777 /var/run/postgresql
ENV PATH $PATH:/usr/local/pgspider/bin
ENV PGDATA /var/lib/postgresql/data
RUN mkdir -p "$PGDATA" && chown -R postgres:postgres "$PGDATA" && chmod 777 "$PGDATA"
VOLUME /var/lib/postgresql/data
COPY docker-entrypoint.sh /usr/local/bin/
RUN ln -s usr/local/bin/docker-entrypoint.sh / # backwards compat
ENTRYPOINT ["docker-entrypoint.sh"]
EXPOSE 5432
CMD ["postgres"]

使用

  • 启动服务
docker run -d -e POSTGRES_PASSWORD=dalong dalongrong/pgspider:pg_cron-perl
  • 创建扩展

    容器内部操作

CREATE EXTENSION plperl
  • 创建perl 函数
CREATE FUNCTION perl_max (integer, integer) RETURNS integer AS $$
    if ($_[0] > $_[1]) { return $_[0]; }
    return $_[1];
$$ LANGUAGE plperl;
  • 使用
select perl_max(1,4);

效果
返回4,最大的数据
pgspider perl 语言扩展

 

 

说明

pgspider perl 的基础镜像以及push dockerhub了,需要集成扩展的,可以参考上边的dockerfile

参考资料

https://www.postgresql.org/docs/11/plperl-funcs.html
https://github.com/pgspider/pgspider
https://github.com/rongfengliang/pgspider-docker

上一篇:perl 根据/div/span 和/div/a标签爬取


下一篇:国外的几个知名源码网站