Commit Graph

30 Commits

Author SHA1 Message Date
5e0b6567cd Rewritting Bags from scratch using a namedtuple approach, along with other (less major) updates.
New bag implementation improves a lot how bonobo works, even if this is
highly backward incompatible (sorry, that's needed, and better sooner
than later).

* New implementation uses the same approach as python's namedtuple,
  by dynamically creating the python type's code. This has drawbacks, as
  it feels like not the right way, but also a lot of benefits that
  cannot be achieved using a regular approach, especially the
  constructor parameter order, hardcoded.
* Memory usage is now much more efficient. The "keys" memory space will
  be used only once per "io type", being spent in the underlying type
  definition instead of in the actual instances.
* Transformations now needs to use tuples as output, which will be bound
  to its "output type". The output type can be infered from the tuple
  length, or explicitely set by the user using either
  `context.set_output_type(...)` or `context.set_output_fields(...)` (to
  build a bag type from a list of field names).

Jupyter/Graphviz integration is more tight, allowing to easily display
graphs in a notebook, or displaying the live transformation status in an
html table instead of a simple <div>.

For now, context processors were hacked to stay working as before but
the current API is not satisfactory, and should be replaced. This new
big change being unreasonable without some time to work on it properly,
it is postponed for next versions (0.7, 0.8, ...). Maybe the best idea
is to have some kind of "local services", that would use the same
dependency injection mechanism as the execution-wide services.

Services are now passed by keywoerd arguments only, to avoid confusion
with data-arguments.
2017-11-27 00:04:51 +01:00
d1481fbfe8 Moves jupyter extension to both bonobo.contrib.jupyter (for the jupyter widget) and to bonobo.plugins (for the executor-side plugin). 2017-11-12 09:08:05 +01:00
8f3c4252b4 Working on the new version of the tutorial. Only Step1 implemented. 2017-11-05 19:41:27 +01:00
e6596cf3f3 Removes cookiecutter. 2017-11-01 13:19:24 +01:00
edc2321c54 Issue #134: update documentation 2017-10-28 14:20:53 +02:00
bf5f870304 Add a note about the graph variable
It needs to be global and publicly available.  Some people reading the
tutorial may want to put it in its own function or the __main__
conditional, which won't work.
2017-10-28 12:10:39 +02:00
2532dd1b89 [doc] fix typos and errors. 2017-10-12 11:41:23 -05:00
c337aad14d [doc] fix typos and errors. 2017-10-04 08:40:08 +02:00
75a68d1322 [doc] fix links 2017-10-03 08:41:03 +02:00
fbd0ee9862 Update tut02.rst 2017-07-15 10:34:30 +02:00
7f30df93c3 [doc] sqla tutorial: adds some titles. 2017-07-06 12:52:19 +02:00
a107434139 [doc] sqla: move logger usage to service, fix service name. 2017-07-06 12:47:07 +02:00
0f23f1a940 [docs] First draft of sqlalchemy tutorial. 2017-07-06 12:41:05 +02:00
cf5b078620 [doc] Documentation, my dear. Half of the work, looks you are a little behind on quotas ... 2017-07-05 19:28:42 +02:00
fb54143a7a release: 0.4.0 2017-06-10 15:34:22 +02:00
b80ff253db [docs] work in progress. 2017-06-05 10:47:16 +02:00
0146fb0d55 [doc] Documentation work for the 0.4 release (not finished). 2017-05-28 19:21:12 +02:00
46ab71c193 Update index.rst 2017-05-22 17:21:33 +02:00
f27db31b91 Update index.rst 2017-05-22 17:18:47 +02:00
a018cca20e Documenting transformations and configurables. 2017-05-20 13:05:07 +02:00
96d712d8b9 Increment minor version number. 2017-05-01 19:09:59 +02:00
71a32f623f Sweeping the docs. 2017-05-01 09:56:10 +02:00
d9a7dc3e11 fix namespace for readers/writers in documentation. 2017-04-30 11:46:13 +02:00
4ee3fd3be9 adds tutorials and documentation for file readers and writers. 2017-04-30 11:14:34 +02:00
42519ab468 Minor typos 2017-04-22 22:54:35 +02:00
061255bf99 Minor typos etc 2017-04-22 22:47:41 +02:00
9dab39a474 Minor fixes and update documentation. Preparing the upcoming 0.2 release. 2017-01-20 20:45:16 +01:00
8b63b0bf44 doc update and better versionning method 2016-12-29 17:27:06 +01:00
ad36f9368a more docs, still wip 2016-12-27 22:05:21 +01:00
25ad284935 starting to write docs, taking decisions on public api 2016-12-27 13:31:38 +01:00