Commit Graph

21 Commits

Author SHA1 Message Date
a1f883e3c6 Release: 0.6.0a1 2017-12-03 10:00:47 +01:00
5e0b6567cd Rewritting Bags from scratch using a namedtuple approach, along with other (less major) updates.
New bag implementation improves a lot how bonobo works, even if this is
highly backward incompatible (sorry, that's needed, and better sooner
than later).

* New implementation uses the same approach as python's namedtuple,
  by dynamically creating the python type's code. This has drawbacks, as
  it feels like not the right way, but also a lot of benefits that
  cannot be achieved using a regular approach, especially the
  constructor parameter order, hardcoded.
* Memory usage is now much more efficient. The "keys" memory space will
  be used only once per "io type", being spent in the underlying type
  definition instead of in the actual instances.
* Transformations now needs to use tuples as output, which will be bound
  to its "output type". The output type can be infered from the tuple
  length, or explicitely set by the user using either
  `context.set_output_type(...)` or `context.set_output_fields(...)` (to
  build a bag type from a list of field names).

Jupyter/Graphviz integration is more tight, allowing to easily display
graphs in a notebook, or displaying the live transformation status in an
html table instead of a simple <div>.

For now, context processors were hacked to stay working as before but
the current API is not satisfactory, and should be replaced. This new
big change being unreasonable without some time to work on it properly,
it is postponed for next versions (0.7, 0.8, ...). Maybe the best idea
is to have some kind of "local services", that would use the same
dependency injection mechanism as the execution-wide services.

Services are now passed by keywoerd arguments only, to avoid confusion
with data-arguments.
2017-11-27 00:04:51 +01:00
d1481fbfe8 Moves jupyter extension to both bonobo.contrib.jupyter (for the jupyter widget) and to bonobo.plugins (for the executor-side plugin). 2017-11-12 09:08:05 +01:00
5cc514e490 Update dependencies, remove python-dotenv. 2017-11-01 18:53:27 +01:00
8351897e3a [core] Refactoring of commands to move towards a more pythonic way of running the jobs. Commands are now classes, and bonobo "graph" related commands now hooks into bonobo.run() calls so it will use what you actually put in your __main__ block. 2017-10-29 19:23:50 +01:00
3c453f0be7 Code formating. 2017-10-22 18:05:39 +02:00
d596d3a438 Update requirements. 2017-10-21 12:39:46 +02:00
ee65cd736b Update dependencies. 2017-10-05 18:52:53 +02:00
21514ad670 Update dependencies. 2017-09-30 09:54:30 +02:00
0e2e772043 release: 0.4.3 2017-07-16 10:50:49 +02:00
d034588091 Update dependencies. 2017-07-04 10:51:33 +02:00
b1db4263d4 Update dependencies. 2017-06-18 21:30:19 +02:00
c42520987f Update requests from 2.17.3 to 2.18.1 2017-06-14 21:38:37 +02:00
c17d560d16 Merge pull request #111 from python-bonobo/pyup-update-fs-2.0.3-to-2.0.4
Update fs to 2.0.4
2017-06-12 09:24:01 +02:00
735ae43fc6 Update bonobo-docker from 0.2.6 to 0.2.8 2017-06-11 22:14:16 +02:00
079ad57a61 Update fs from 2.0.3 to 2.0.4 2017-06-11 17:15:17 +02:00
fb54143a7a release: 0.4.0 2017-06-10 15:34:22 +02:00
187a24fca9 Merge branch '0.3' into develop
Conflicts:
	Makefile
	requirements-dev.txt
2017-06-10 14:17:26 +02:00
1ca48d885d Refactoring and fixes around ioformats. 2017-06-08 21:47:01 +02:00
99cf5a03c6 Merge remote-tracking branch 'upstream/pyup-update-pytest-3.1.0-to-3.1.1' into develop 2017-05-31 22:07:53 +02:00
9370f6504e [ext] Adds docker extra to setup.py 2017-05-28 16:51:02 +02:00