Bonobo Extensions

Stay light

One of Bonobo's goals is to stay light. To do this, it's important to know what should be part of the core, and what should be bundled as extensions.

The core should include :

  • All the tools required to build and manipulate Graphs.
  • All the basic data handlers, like CSV, JSON, Files, etc ...
  • All the tools required to instrument, execute, profile and monitor a Graph.
  • All the interfaces necessary to extend the core with basically anything.

Whatever does not fall in one of those categories can still exist in the Bonobo ecosystem, but must be bundled as a separate extension.

As we do use a few things that does not fit here, a few official extensions have been built, both do demonstrate a possible way to do things and to be more "batteries included".

Bonobo-Docker

Docker extension for Bonobo allows to run ETL jobs in docker containers. It also helps a lot the Bonobo development itself, by allowing better isolation for tests, and especially integration testing.

Code at GitHubDocumentation

Bonobo-SQLAlchemy

SQLAlchemy extension for Bonobo is a tiny extension that defines a few configurable blocks that you can use to work with SQL Databases, like Firebird, Microsoft SQL Server, MySQL, Oracle, PostgreSQL, SQLite or Sybase.

Code at GitHubDocumentationExamples

Bonobo-Selenium

Selenium extension for Bonobo is a funny thing. It allows to define a selenium browser as a bonobo service, and use it to extract data (or enrich, of course). It's an experiment over writing web scrappers with Bonobo, and it proved its value for us (even if it could be worthless for your own use case.

Code at GitHubDocumentationExamples

Python Cheese Shop

Last but not least, Python is a realy beast. There are a lot of libraries available to handle basically anything. You want to connect to CouchDB, CouchBase, Cassandra, Neo4J, Titan, OpenLDAP, some open-data provider, etc.? There's a wheel for that!

Wrapping the library in Bonobo should not be a lot of work, and if you're in trouble we'll be glad to help!

Python Packages Index

Who has DataSets?
My kingdom for more DataSets!

Here are a few resources you can find datasets on.

Happy data processing!

Did I say we need feedback? Slack discussions and issues are more than welcome!

Announcements

Low volume, get a change list summary of major releases, along with important announcements.

We'll get in touch soon!

Now open your inbox and click the subscription link, so we know you're the real owner of this address.

Oops! Something went wrong while submitting the form. And we're not even able to tell you what... Maybe your e-mail was invalid?

Latest news

Bonobo ETL v.0.6

Bonobo ETL v.0.6.0 is now available. You should upgrade your projects as soon as possible. A migration guide is available for backward incompatible changes.

Bonobo ETL v.0.5

Bonobo ETL v.0.5.0 is now available. As always, you should upgrade your projects as soon as possible and give feedback if anything goes wrong.

EuroPython 2017

A little summary of the apes' invasion in Rimini, for the amazing EuroPython conference. Including slides, videos of the talk, general thoughts, sprint sessions and thanks to all the amazing people that were there.

Bonobo v.0.3.2

Minor maintenance release for the 0.3 branch.

Bonobo ETL v.0.4

Bonobo ETL v.0.4.0 is now available. Amongst a lot of new features, there is now good integration with python logging facilities, better console handling, better command line interface and more exciting, the first preview releases of the bonobo-docker extension, that allows to build images and run ETL jobs in containers. As always, you should upgrade your projects as soon as possible, and of course make feedback if anything goes wrong.

Bonobo ETL will be at PyParis 2017

We're glad to announce that our talk about Bonobo ETL has been accepted to PyParis 2017, a conference gathering users and developers of the Python programming language.

Bonobo v.0.3.1

Minor maintenance release for the 0.3 branch. Also, docker extension got a big bump forward and there is now a simple process to build the images.

Bonobo v.0.3

Just released Bonobo 0.3. Lots of new features, stability enhancements, better internal plumbery... You should upgrade your projects as soon as possible, and of course make feedback if anything goes wrong.