Commit Graph

44 Commits

Author SHA1 Message Date
5e0b6567cd Rewritting Bags from scratch using a namedtuple approach, along with other (less major) updates.
New bag implementation improves a lot how bonobo works, even if this is
highly backward incompatible (sorry, that's needed, and better sooner
than later).

* New implementation uses the same approach as python's namedtuple,
  by dynamically creating the python type's code. This has drawbacks, as
  it feels like not the right way, but also a lot of benefits that
  cannot be achieved using a regular approach, especially the
  constructor parameter order, hardcoded.
* Memory usage is now much more efficient. The "keys" memory space will
  be used only once per "io type", being spent in the underlying type
  definition instead of in the actual instances.
* Transformations now needs to use tuples as output, which will be bound
  to its "output type". The output type can be infered from the tuple
  length, or explicitely set by the user using either
  `context.set_output_type(...)` or `context.set_output_fields(...)` (to
  build a bag type from a list of field names).

Jupyter/Graphviz integration is more tight, allowing to easily display
graphs in a notebook, or displaying the live transformation status in an
html table instead of a simple <div>.

For now, context processors were hacked to stay working as before but
the current API is not satisfactory, and should be replaced. This new
big change being unreasonable without some time to work on it properly,
it is postponed for next versions (0.7, 0.8, ...). Maybe the best idea
is to have some kind of "local services", that would use the same
dependency injection mechanism as the execution-wide services.

Services are now passed by keywoerd arguments only, to avoid confusion
with data-arguments.
2017-11-27 00:04:51 +01:00
321bb83aa4 Documentation for new behaviour. 2017-10-22 16:57:46 +02:00
12e4250166 Merge pull request #195 from cw-andrews/feature/env_file
Feature/env file
2017-10-17 13:55:48 +02:00
5d41f6df2d Update environment.rst
Updated examples to use preferred naming conventions for default and private/local .env files per request of @hartym.
2017-10-15 17:15:30 -04:00
945d850139 Update environment.rst
Fixed typo (I think).
2017-10-15 17:11:10 -04:00
d6d063ad43 Updated environment documentation in guides to account for env files. 2017-10-15 16:43:28 -04:00
3b20a40bb7 [doc] Missing description. 2017-10-08 17:42:48 +02:00
7fa9a2be5b [doc] Updating guides in documentation 2017-10-08 13:13:20 +02:00
d936e164ac [doc] cleanup & refactorings 2017-10-03 08:37:46 +02:00
2ab48080e6 [doc] refactors guides index so the toc is showing up correctly in sidebar. 2017-10-03 08:25:15 +02:00
e9dfcfe0d8 [doc] adds cross ref in env vars page 2017-10-03 08:15:50 +02:00
0bfa873743 [doc] fix typo 2017-10-03 08:13:17 +02:00
bfa43e65e6 [doc] tuning a few things in documentation. 2017-10-03 08:09:50 +02:00
142a6d60df Updated inline examples and fixed code markup. 2017-10-02 16:11:41 -04:00
504e8920f2 Update and rename environmental_variables.rst to environment_variables.rst
Made review requests per @hardym.
2017-10-02 16:06:04 -04:00
56d8f32910 Update environmental_variables.rst 2017-10-02 15:34:00 -04:00
5f83aef47d Update jupyter.rst 2017-10-02 15:25:13 -04:00
b83ba99beb Update index.rst 2017-10-02 15:24:41 -04:00
074d173ea7 Added envrionmental_variables page to the guides section. 2017-10-01 21:26:10 -04:00
c1a5750b60 Made a few spelling and grammar corrections/adjustments to the docs under guide. 2017-10-01 20:16:24 -04:00
dda0a63880 [docs] Fix additional grammar issues at bottom of purity.rst 2017-07-21 15:38:06 -07:00
4ef4364f42 [docs] Fix grammar in purity.rst 2017-07-21 15:32:06 -07:00
cf5b078620 [doc] Documentation, my dear. Half of the work, looks you are a little behind on quotas ... 2017-07-05 19:28:42 +02:00
98430354e6 [docs] link to first bonobo-docker guide. 2017-06-05 10:50:36 +02:00
5bbfa41956 [jupyter] minor docs edit. 2017-06-05 09:45:49 +02:00
a377639f94 [config] adds documentation for Exclusive contextmanager 2017-05-25 11:19:56 +02:00
39e083e594 Some documentation around context processors. 2017-05-22 10:44:05 +02:00
a018cca20e Documenting transformations and configurables. 2017-05-20 13:05:07 +02:00
171fa3415b first draft of enhancers. 2017-05-08 11:33:02 +02:00
71a32f623f Sweeping the docs. 2017-05-01 09:56:10 +02:00
4ee3fd3be9 adds tutorials and documentation for file readers and writers. 2017-04-30 11:14:34 +02:00
357683bd02 Default service configuration in directory or file (#38). 2017-04-28 07:37:15 +02:00
c801131190 Merge branch 'filesystem' into 0.2 2017-04-28 06:33:37 +02:00
4f49ad9fd1 Tighter dependencies, and rewriting a bit of the documentation. 2017-04-28 06:32:48 +02:00
27c937054f Update services.rst 2017-04-27 09:52:18 +02:00
02f0c1d972 Update services.rst 2017-04-27 09:47:24 +02:00
86dfe3bb9a Update index.rst 2017-04-27 08:44:33 +02:00
8900e902ca Update services.rst 2017-04-27 08:43:58 +02:00
efcd4361cc First implementation of services and basic injection. Not working with CLI for now. 2017-04-25 22:04:21 +02:00
6926058625 Refactoring plugin architecture, fixing jupyter integration and a few documentation about how to setup jupyter notebook widget. 2017-04-24 20:49:05 +02:00
1399bbe733 Update purity.rst 2017-04-22 18:29:48 +02:00
9dab39a474 Minor fixes and update documentation. Preparing the upcoming 0.2 release. 2017-01-20 20:45:16 +01:00
8b63b0bf44 doc update and better versionning method 2016-12-29 17:27:06 +01:00
ad36f9368a more docs, still wip 2016-12-27 22:05:21 +01:00