Author Archives: taotetek

About taotetek

Sometimes stereotypical but never ironic. You can't stop the signal, Mal. All my opinions are my own, unless I stole them from you.

ZeroMQ Input / Output Plugins for Rsyslog

Just dropping a quick note that Aggregate Knowledge, where I work as Service Delivery Data Architect, has released our first open source release this week – zeromq input and output plugins for rsyslog. Give them a spin if it’s something … Continue reading

Posted in 0mq, zeromq | Tagged | Leave a comment

How Much Do My Date Partitions Grow Each Day? – Stupid PostgreSQL Tricks

Today I had to do some fast analysis on a data warehouse to see how much the database was growing each day. The PostgreSQL database was date partitioned in a fairly standard way: each partitioned table had tables with the … Continue reading

Posted in postgresql | Tagged | Leave a comment

PostgreSQL 9, Listen / Notify, and Jruby – Part 2

I worked up one more example, in this case, using PL/Ruby rather than PL/PgSQL… and then using yaml to serialize the NEW record returned by the trigger, send it to the client, and reconstitute it as a hash. The PL/Ruby … Continue reading

Posted in jruby, postgresql | Tagged | Leave a comment

PostgreSQL 9, Listen / Notify, and Jruby.

The LISTEN / NOTIFY functionality of PostgreSQL received a large boost to functionality in the 9.0 release. Since I’ve lately been experimenting with JRuby, I decided to write up some example code of utilizing LISTEN / NOTIFY via JDBC. LISTEN … Continue reading

Posted in jruby, postgresql | Tagged | 4 Comments

Mecha Multi Mechanize

Awhile back, I had the pleasure of contributing a small amount of code to Corey Goldberg’s excellent multi-mechanize web performance and load testing framework. Since I have been experimenting with using zeromq in place of the python Queue object for … Continue reading

Posted in Python, zeromq | Tagged , , | Leave a comment

Simple TCP to ZeroMQ Message Forwarder with Eventlet

I spent part of the day playing with eventlet today. Eventlet recently added zeromq support. Here’s a very simple message forwarder that sends line terminated messages sent over TCP to a zeromq push socket, using the zeromq hub:

Posted in Python, zeromq | Tagged | Leave a comment

Python Multiprocessing – ZeroMQ vs Queue

As a quick follow up to my previous post, here’s a look at the performance of passing messages between two python processes using the Queue class vs using 0mq push / pull connections.  As a quick test, we will pass … Continue reading

Posted in Python, zeromq | Tagged | 7 Comments

Python Multiprocessing with ZeroMQ

Recently, I’ve begun exploring the depths of ZeroMQ, and the pyzmq bindings.  This post is not an introduction to ZeroMQ, but for a basic rundown the “0MQ in A Hundred Words” blurb from the project site suffices: ØMQ (ZeroMQ, 0MQ, … Continue reading

Posted in Python | Tagged | 15 Comments