Commit Graph

11 Commits

Author SHA1 Message Date
8ea7ce0b1a wip, aio: asyncio strategy (defunct, not fully implemented) and related refactorings. 2018-07-29 15:24:35 +01:00
ae1aca60ca bugfix: set max workers to the actual node count in graph. 2018-07-28 16:05:43 +01:00
6a1203602f Minor tweaks about code quality. 2018-07-16 10:00:28 +02:00
47c676a068 Adds an OrderFields transformation factory, update examples. 2017-12-02 14:18:24 +01:00
9e0834b061 Check partially configured transformations that are function based (aka transformation factories) on execution context setup.
wip: make sure all api is exported, raise an error when a function based transformation factory is (incorrectly) used as a transformation.
2017-12-01 07:43:14 +01:00
5e0b6567cd Rewritting Bags from scratch using a namedtuple approach, along with other (less major) updates.
New bag implementation improves a lot how bonobo works, even if this is
highly backward incompatible (sorry, that's needed, and better sooner
than later).

* New implementation uses the same approach as python's namedtuple,
  by dynamically creating the python type's code. This has drawbacks, as
  it feels like not the right way, but also a lot of benefits that
  cannot be achieved using a regular approach, especially the
  constructor parameter order, hardcoded.
* Memory usage is now much more efficient. The "keys" memory space will
  be used only once per "io type", being spent in the underlying type
  definition instead of in the actual instances.
* Transformations now needs to use tuples as output, which will be bound
  to its "output type". The output type can be infered from the tuple
  length, or explicitely set by the user using either
  `context.set_output_type(...)` or `context.set_output_fields(...)` (to
  build a bag type from a list of field names).

Jupyter/Graphviz integration is more tight, allowing to easily display
graphs in a notebook, or displaying the live transformation status in an
html table instead of a simple <div>.

For now, context processors were hacked to stay working as before but
the current API is not satisfactory, and should be replaced. This new
big change being unreasonable without some time to work on it properly,
it is postponed for next versions (0.7, 0.8, ...). Maybe the best idea
is to have some kind of "local services", that would use the same
dependency injection mechanism as the execution-wide services.

Services are now passed by keywoerd arguments only, to avoid confusion
with data-arguments.
2017-11-27 00:04:51 +01:00
c87775f090 Core: refactoring contexts with more logical responsibilities, stopping to rely on kargs ordering for compat with python3.5 2017-11-12 16:36:11 +01:00
c2f17296f6 [stdlib] Adds Update(...) and FixedWindow(...) the the standard nodes provided with bonobo. 2017-11-12 10:06:15 +01:00
d1481fbfe8 Moves jupyter extension to both bonobo.contrib.jupyter (for the jupyter widget) and to bonobo.plugins (for the executor-side plugin). 2017-11-12 09:08:05 +01:00
0b969d31e0 Adds basic test for convert command. 2017-11-04 14:55:08 +01:00
28884231b3 [core] Moves bonobo.execution context related package to new bonobo.execution.contexts package, also moves bonobo.strategies to new bonobo.execution.strategies package, so everything related to execution is now contained under the bonobo.execution package. 2017-11-04 13:13:47 +01:00