Commit Graph

37 Commits

Author SHA1 Message Date
e06b616251 Refactoring the runner to go more towards standard python, also adds the ability to use bonobo argument parser from standard python execution. 2017-11-01 18:46:45 +01:00
cac6920040 Minor test change. 2017-10-29 12:13:52 +01:00
32e73316e1 Merge pull request #210 from mpenkov/streamjson
Support line-delimited JSON
2017-10-28 17:45:09 +02:00
10a82cce62 Support line-delimited JSON
New nodes for handling line-delimited JSON.

https://en.wikipedia.org/wiki/JSON_Streaming
2017-10-28 17:34:13 +02:00
efb31126b4 [tests] simplify assertion 2017-10-28 17:24:26 +02:00
9a54f7b4aa [core] Still refactoring the core behaviour of bags, starting to be much simpler. 2017-10-23 21:18:02 +02:00
4f1eeacd45 Merge tag '0.5.1' into develop
0.5.1
2017-10-21 12:54:46 +02:00
c7f39aa851 release: 0.5.1 2017-10-21 12:49:34 +02:00
92cc400fe7 [core] Refactoring IOFormats so there is one and only obvious way to send it.
This is the commit where I admit that having more than one input/output
format for readers and writers was complicating the code too much for a
very small gain, and that it would be easier to only have one way to do
it.

So such way is now:

- Returning (or yielding) a dict if you have key-value type collections.
- Returning (or yielding) a tuple if you have a list-type collection.
- Returning (or yielding) something else otherwise, which will continue
  to work like the old "arg0" format.

IOFORMAT options has been removed in favour of a RemovedOption, which
will complain if you're still trying to set it to anything else than the
one value allowed.
2017-10-15 21:37:22 +02:00
1d27376785 release: 0.4.2 2017-06-18 21:35:30 +02:00
67b4227436 [stdlib] Fix I/O related nodes (especially json), there were bad bugs with ioformat. 2017-06-17 10:37:17 +02:00
1ca48d885d Refactoring and fixes around ioformats. 2017-06-08 21:47:01 +02:00
2c2bc4fca9 [qa] fix unclosed files problems in tests. 2017-05-28 23:15:40 +02:00
1afd8746eb [pm] Moving project artifact management to next edgy.project version. 2017-05-27 16:08:10 +02:00
de082ed794 Merge branch 'develop' into feature/io_pickle 2017-05-25 06:36:11 -07:00
9375a5d1fb [nodes/io] Adds an output_format option to CsvReader (BC ok) for more flexibility. 2017-05-25 15:14:51 +02:00
5d8f4c3dc7 Add tests for pickle functionality 2017-05-24 22:20:59 -04:00
171fa3415b first draft of enhancers. 2017-05-08 11:33:02 +02:00
670f4e61d1 fixing codacy issues 2017-05-01 11:02:28 +02:00
95eeaf61b9 fix test 2017-04-30 11:19:29 +02:00
bb5fc22f5e release: 0.2.2 2017-04-28 08:04:48 +02:00
eacd0cc8c5 wip: filesystem as a service. 2017-04-28 06:21:26 +02:00
ad502d7e23 Split execution module in submodules for better readability. 2017-04-25 23:05:18 +02:00
efcd4361cc First implementation of services and basic injection. Not working with CLI for now. 2017-04-25 22:04:21 +02:00
ef2c881075 Attempt to refactor a bit of context, new count transform that counts the calls, new bonobo.structs package with basic data structures, removal of blessings. 2017-04-24 23:44:29 +02:00
8532520aae Big refactoring, way simpler management of transformations. Early branch for upcoming version 0.2. 2017-01-17 22:45:10 +01:00
f736e7e7e3 Working toward sqlalchemy extension. Better ability to extend context. Still needs a lot of cleanup. 2017-01-03 22:06:09 +01:00
d3d2a22145 Exports CSV reader/writer to root package (#2) 2016-12-28 12:29:15 +01:00
e77fbae38b Implements naive csv reader / writer (#2) 2016-12-28 12:27:23 +01:00
cebb8df173 API is cleaner this way, easier to understand the purpose of methods (#2). 2016-12-28 11:40:03 +01:00
67e25b92e1 Implements JsonReader (#2) 2016-12-28 11:29:12 +01:00
2527a1b85b Still working on file handlers... JsonWriter (#2) 2016-12-28 11:14:37 +01:00
2b8216ec0d implementing FileReader/FileWriter (#2) 2016-12-28 10:54:50 +01:00
25ad284935 starting to write docs, taking decisions on public api 2016-12-27 13:31:38 +01:00
512e2ab46d refactoring contexts, moved json writer to a class as it make more sense. 2016-12-27 09:06:44 +01:00
fdd5d511eb fixing tests under py3.5 2016-12-26 09:19:50 +01:00
8903e1d386 still testing 2016-12-26 08:57:39 +01:00