Thoonk A clusterable, Redis based, Publish-Subscribe, Queue, and Job Distrubtion system based on the philosoph...
Download

Thoonk Ranking & Summary

Thoonk Tags

Python library Python job

Thoonk Description

Thoonk is a persistent (and fast!) system for push feeds, queues, and jobs which leverages Redis. It is the Python implementation of Thoonk, and is interoperable with other versions of Thoonk (currently Thoonk.js for node.js).Feed TypesFeedThe core of Thoonk is the feed. A feed is a subject that you can publish items to (string, binary, json, xml, whatever), each with a unique id (assigned or generated). Other apps and services may subscribe to your feeds and recieve new/update/retract notices on your feeds. Each feed persists published items that can later be queried. Feeds may also be configured for various behaviors, such as max number of items, default serializer, friendly title, etc.Feeds are useful for clustering applications, delivering data from different sources to the end user, bridged peering APIs (pubsub hubbub, XMPP Pubsub, maintaining ATOM and RSS files, etc), persisting, application state, passing messages between users, taking input from and serving multiple APIs simultaneously, and generally persisting and pushing data around.QueueQueues are stored and interacted with in similar ways to feeds, except instead of publishes being broadcast, clients may do a "blocking get" to claim an item, ensuring that they're the only one to get it. When an item is delivered, it is deleted from the queue.Queues are useful for direct message passing.Sorted FeedSorted feeds are unbounded, manually ordered collections of items. Sorted feeds behave similarly to plain feeds except that items may be edited in place or inserted in arbitrary order.JobJobs are like Queues in that one client claims an item, but that client is also required to report that the item is finished or cancel execution. Failure to to finish the job in a configured amount of time or canceling the job results in the item being reintroduced to the available list. Unlike queues, job items are not deleted until they are finished.Jobs are useful for distributing load, ensuring a task is completed regardless of outages, and keeping long running tasks away from synchronous interfaces.InstallationIn theory, if I publish the package correctly, then this should work.pip install thoonkRunning the TestsAfter checking out a copy of the source code, you can runpython testall.pyfrom the main directory.Product's homepage

Thoonk Related Software