Date: Mon, 2 Jun 2008 15:06:00 GMT From: Pierre-Emmanuel André <pea@raveland.org> To: freebsd-gnats-submit@FreeBSD.org Subject: ports/124210: New port: databases/pgloader : PostgreSQL Loader Message-ID: <200806021506.m52F60p1005095@www.freebsd.org> Resent-Message-ID: <200806021510.m52FA13W014947@freefall.freebsd.org>
next in thread | raw e-mail | index | archive | help
>Number: 124210 >Category: ports >Synopsis: New port: databases/pgloader : PostgreSQL Loader >Confidential: no >Severity: non-critical >Priority: low >Responsible: freebsd-ports-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: change-request >Submitter-Id: current-users >Arrival-Date: Mon Jun 02 15:10:00 UTC 2008 >Closed-Date: >Last-Modified: >Originator: Pierre-Emmanuel André >Release: FreeBSD 7.0 RELEASE >Organization: >Environment: FreeBSD bsd.local 7.0-RELEASE FreeBSD 7.0-RELEASE #0: Sun Feb 24 10:35:36 UTC 2008 root@driscoll.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64 >Description: New port: databases/pgloader pgloader imports data from a flat file and insert it into a PostgreSQL database table. It uses a flat file per database table, and you can configure as many Sections as you want, each one associating a table name and a data file. Homepage: http://pgfoundry.org/projects/pgloader/ >How-To-Repeat: >Fix: # This is a shell archive. Save it in a file, remove anything before # this line, and then unpack it by entering "sh file". Note, it may # create directories; files and directories will be owned by you and # have default permissions. # # This archive contains: # # /usr/ports/mystuff/database/pgloader/ # /usr/ports/mystuff/database/pgloader/pkg-descr # /usr/ports/mystuff/database/pgloader/Makefile # /usr/ports/mystuff/database/pgloader/pkg-plist # /usr/ports/mystuff/database/pgloader/distinfo # echo c - /usr/ports/mystuff/database/pgloader/ mkdir -p /usr/ports/mystuff/database/pgloader/ > /dev/null 2>&1 echo x - /usr/ports/mystuff/database/pgloader/pkg-descr sed 's/^X//' >/usr/ports/mystuff/database/pgloader/pkg-descr << 'END-of-/usr/ports/mystuff/database/pgloader/pkg-descr' Xpgloader imports data from a flat file and inserts it into one or Xmore PostgreSQL database tables. It uses a flat file per database Xtable, and you can configure as many Sections as you want, each one Xassociating a table name and a data file. X XData are parsed and rewritten, then given to PostgreSQL COPY command. XParsing is necessary for dealing with end of lines and eventual trailing Xseparator characters, and for column reordering: your flat data file may Xnot have the same column order as the database table has. X Xpgloader is also able to load some large objects data into PostgreSQL, Xas of now only Informix UNLOAD data files are supported. This command Xgives large objects data location information into the main data file. Xpgloader parse it add the text or bytea content properly escaped to the XCOPY data. X Xpgloader issues some timing statistics every "commit_every" commits. At Xthe end of processing each section, a summary of overall operations, Xnumbers of rows copied and commits, time it took in seconds, errors Xlogged and database errors is issued. X XWWW: http://pgfoundry.org/projects/pgloader/ END-of-/usr/ports/mystuff/database/pgloader/pkg-descr echo x - /usr/ports/mystuff/database/pgloader/Makefile sed 's/^X//' >/usr/ports/mystuff/database/pgloader/Makefile << 'END-of-/usr/ports/mystuff/database/pgloader/Makefile' X# New ports collection makefile for: pgloader X# Date created: 2008-06-02 X# Whom: Pierre-Emmanuel Andre X# X# $FreeBSD$ X# X XPORTNAME= pgloader XPORTVERSION= 2.3.0 XCATEGORIES= databases XMASTER_SITES= http://pgfoundry.org/frs/download.php/1679/ X XMAINTAINER= pea@raveland.org XCOMMENT= Import CSV data and Large Object to PostgreSQL X XMAN1= pgloader.1 X XNO_BUILD= Yes XUSE_PYTHON= 2.4+ X XRUN_DEPENDS+= ${PYTHON_SITELIBDIR}/psycopg2/__init__.py:${PORTSDIR}/databases/py-psycopg2 X Xpre-configure: X ${REINPLACE_CMD} -e 's,/usr/share/python-support,${PYTHON_SITELIBDIR},' ${WRKSRC}/pgloader/options.py X Xdo-install: X ${INSTALL_SCRIPT} ${WRKSRC}/pgloader.py ${PREFIX}/bin/pgloader X ${INSTALL_MAN} ${WRKSRC}/pgloader.1 ${MAN1PREFIX}/man/man1 X ${MKDIR} ${PYTHON_SITELIBDIR}/pgloader X @cd ${WRKSRC}/pgloader && ${COPYTREE_SHARE} \* ${PYTHON_SITELIBDIR}/pgloader/ X ${MKDIR} ${PYTHON_SITELIBDIR}/pgloader/reformat X @cd ${WRKSRC}/reformat && ${COPYTREE_SHARE} \* ${PYTHON_SITELIBDIR}/pgloader/reformat/ X.if !defined(NOPORTEXAMPLES) X ${MKDIR} ${EXAMPLESDIR} X @cd ${WRKSRC}/examples && ${COPYTREE_SHARE} \* ${EXAMPLESDIR} X.endif X.if !defined(NOPORTDOCS) X ${MKDIR} ${DOCSDIR} X ${INSTALL_DATA} ${WRKSRC}/BUGS.txt ${DOCSDIR} X ${INSTALL_DATA} ${WRKSRC}/TODO.txt ${DOCSDIR} X ${INSTALL_DATA} ${WRKSRC}/pgloader.1.txt ${DOCSDIR} X.endif X X.include <bsd.port.mk> END-of-/usr/ports/mystuff/database/pgloader/Makefile echo x - /usr/ports/mystuff/database/pgloader/pkg-plist sed 's/^X//' >/usr/ports/mystuff/database/pgloader/pkg-plist << 'END-of-/usr/ports/mystuff/database/pgloader/pkg-plist' Xbin/pgloader Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/__init__.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/csvreader.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/db.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/lo.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/logger.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/options.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/options.py.bak Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/pgloader.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/reader.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/textreader.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/tools.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/reformat/README Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/reformat/__init__.py Xlib/%%PYTHON_VERSION%%/site-packages/pgloader/reformat/mysql.py X%%PORTDOCS%%%%DOCSDIR%%/BUGS.txt X%%PORTDOCS%%%%DOCSDIR%%/TODO.txt X%%PORTDOCS%%%%DOCSDIR%%/pgloader.1.txt X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/README X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/allcols/allcols.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/allcols/allcols.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/clob/clob.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/clob/clob.out X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/clob/clob.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/cluttered/cluttered.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/cluttered/cluttered.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/csv/csv.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/csv/csv.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/errors/errors.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/errors/errors.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/parallel.conf X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/parallel/parallel.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/parallel/parallel.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/partial/partial.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/partial/partial.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/pgloader.conf X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/reformat/reformat.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/reformat/reformat.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/serial/serial.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/serial/serial.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/simple/simple.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/simple/simple.sql X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/udc/udc.data X%%PORTEXAMPLES%%%%EXAMPLESDIR%%/udc/udc.sql X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/udc X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/simple X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/serial X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/reformat X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/partial X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/parallel X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/errors X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/csv X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/cluttered X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/clob X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%%/allcols X%%PORTDOCS%%@dirrm %%DOCSDIR%% X%%PORTEXAMPLES%%@dirrm %%EXAMPLESDIR%% X@dirrm lib/%%PYTHON_VERSION%%/site-packages/pgloader/reformat X@dirrm lib/%%PYTHON_VERSION%%/site-packages/pgloader END-of-/usr/ports/mystuff/database/pgloader/pkg-plist echo x - /usr/ports/mystuff/database/pgloader/distinfo sed 's/^X//' >/usr/ports/mystuff/database/pgloader/distinfo << 'END-of-/usr/ports/mystuff/database/pgloader/distinfo' XMD5 (pgloader-2.3.0.tar.gz) = d4637c23f2cbefb30625751081f6a1c4 XSHA256 (pgloader-2.3.0.tar.gz) = cc2a7570f6c908f740fd5b53d5c1b51a9d93ab223232df90ec01e874e18c1b1d XSIZE (pgloader-2.3.0.tar.gz) = 83945 END-of-/usr/ports/mystuff/database/pgloader/distinfo exit >Release-Note: >Audit-Trail: >Unformatted:
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200806021506.m52F60p1005095>