Commit Graph

42 Commits

Author SHA1 Message Date
89dda0dca6 feat: new alternate syntax and switch to black + isort (yeah, maybe not the best time, but that is done). 2018-07-29 18:21:56 +01:00
12fb1cf5c0 misc: sorting imports. 2018-07-29 16:04:07 +01:00
21d013bdf3 feat: nicer errors, cleanup examples. 2018-07-29 15:59:44 +01:00
8ea7ce0b1a wip, aio: asyncio strategy (defunct, not fully implemented) and related refactorings. 2018-07-29 15:24:35 +01:00
6a1203602f Minor tweaks about code quality. 2018-07-16 10:00:28 +02:00
a9c55de270 Update requirements / format. 2018-05-16 07:43:15 +02:00
47f3897847 Example datasets are now stored by bonobo minor version. 2017-12-02 16:19:27 +01:00
7a25774b0f Removing datasets from the repository. 2017-12-02 15:57:14 +01:00
47c676a068 Adds an OrderFields transformation factory, update examples. 2017-12-02 14:18:24 +01:00
d8c0dfe11a Inheritance of bags and better jupyter output for pretty printer. 2017-11-28 21:58:01 +01:00
686d1c81b3 Simple "examples" command that just show examples for now. 2017-11-28 21:57:08 +01:00
5e0b6567cd Rewritting Bags from scratch using a namedtuple approach, along with other (less major) updates.
New bag implementation improves a lot how bonobo works, even if this is
highly backward incompatible (sorry, that's needed, and better sooner
than later).

* New implementation uses the same approach as python's namedtuple,
  by dynamically creating the python type's code. This has drawbacks, as
  it feels like not the right way, but also a lot of benefits that
  cannot be achieved using a regular approach, especially the
  constructor parameter order, hardcoded.
* Memory usage is now much more efficient. The "keys" memory space will
  be used only once per "io type", being spent in the underlying type
  definition instead of in the actual instances.
* Transformations now needs to use tuples as output, which will be bound
  to its "output type". The output type can be infered from the tuple
  length, or explicitely set by the user using either
  `context.set_output_type(...)` or `context.set_output_fields(...)` (to
  build a bag type from a list of field names).

Jupyter/Graphviz integration is more tight, allowing to easily display
graphs in a notebook, or displaying the live transformation status in an
html table instead of a simple <div>.

For now, context processors were hacked to stay working as before but
the current API is not satisfactory, and should be replaced. This new
big change being unreasonable without some time to work on it properly,
it is postponed for next versions (0.7, 0.8, ...). Maybe the best idea
is to have some kind of "local services", that would use the same
dependency injection mechanism as the execution-wide services.

Services are now passed by keywoerd arguments only, to avoid confusion
with data-arguments.
2017-11-27 00:04:51 +01:00
4bea3f7dad Fix examples with new module paths. 2017-11-12 06:24:29 +01:00
8351897e3a [core] Refactoring of commands to move towards a more pythonic way of running the jobs. Commands are now classes, and bonobo "graph" related commands now hooks into bonobo.run() calls so it will use what you actually put in your __main__ block. 2017-10-29 19:23:50 +01:00
c7f39aa851 release: 0.5.1 2017-10-21 12:49:34 +02:00
0d53e13581 Making factory example work. Still work in progress. 2017-09-30 12:23:14 +02:00
ef938c9970 Adding warnings to transformation factory, and code formating. 2017-09-30 11:58:37 +02:00
25cb430b7b Merge branch 'develop' into transformation_factory 2017-07-16 18:54:37 +02:00
f02d92c7e8 Merge branch 'master' into transformation_factory 2017-07-15 14:38:09 +02:00
4a2c7280d6 [misc] Fixes formatting. 2017-07-05 13:09:46 +02:00
8de6f50523 [examples] Fix examples, fix termination bug with unrecoverable errors. 2017-07-05 13:08:53 +02:00
2ff19c18a6 [errors] Implements unrecoverable errors, that will raise and stop the transformation. Used when an invalid ioformat is used. 2017-07-05 11:34:34 +02:00
c34b86872f Update example datasets. 2017-06-05 10:52:47 +02:00
2ffbc90bcb Add examples for pickle functionality 2017-05-24 22:21:29 -04:00
3059f112f1 WIP: factory for transformations 2017-05-21 20:42:54 +02:00
58a1580668 Fix iterable problems due to context currifier, and some examples with wrong import paths. 2017-05-20 10:40:44 +02:00
bbd258c313 74 characters instead of 80 for examples, as it seems that desktop version display less characters than tablet on rtd theme. 2017-05-01 15:22:32 +02:00
0feccb1aa9 reformating code, and adding specific rules for examples so it shows up correctly on readthedocs, by default. 2017-05-01 15:21:26 +02:00
8fc0430a23 more documentage 2017-05-01 10:21:56 +02:00
d79ca9e20e Cleaner api exposition. 2017-05-01 09:00:07 +02:00
b4716f9cee fix json example (#37) 2017-05-01 08:14:09 +02:00
bb5fc22f5e release: 0.2.2 2017-04-28 08:04:48 +02:00
357683bd02 Default service configuration in directory or file (#38). 2017-04-28 07:37:15 +02:00
eacd0cc8c5 wip: filesystem as a service. 2017-04-28 06:21:26 +02:00
08db4213b3 Allowing container lazy resolution of params and fixing unterminated late transforms in default strategy (bad bug!) 2017-04-26 01:26:11 +02:00
efcd4361cc First implementation of services and basic injection. Not working with CLI for now. 2017-04-25 22:04:21 +02:00
3ecb2c2ccd Minor stuff, cleanup and formating. 2017-04-25 07:47:51 +02:00
ef2c881075 Attempt to refactor a bit of context, new count transform that counts the calls, new bonobo.structs package with basic data structures, removal of blessings. 2017-04-24 23:44:29 +02:00
476923dc44 Attempt to fix windows terminal compatibility (ping @jelloslinger). If this is working on windows, we should consider removing blessings in favor of colorama. 2017-04-23 15:10:29 +02:00
2aa46ad7f4 update coffeeshops dataset 2017-04-23 11:57:54 +02:00
b035bdea32 formating, better consistency in readers, ability to read files from http (fast and dirty). 2017-02-12 08:10:22 +01:00
9dab39a474 Minor fixes and update documentation. Preparing the upcoming 0.2 release. 2017-01-20 20:45:16 +01:00