Commit Graph

898 Commits

Author SHA1 Message Date
c770287466 [core] still refactoring env-related stuff towards using __main__ blocks (but with argparser, if needed). 2017-10-29 23:46:39 +01:00
2ad47ae958 You should not code when tired... 2017-10-29 23:40:58 +01:00
b3e74aff85 Fixes syntax error. 2017-10-29 23:36:44 +01:00
ba9f7171d4 [bugfix] Trying to fix a race condition that happens on empty graphs sometimes, on some computers. 2017-10-29 23:32:34 +01:00
06dc6b6e35 [bugfix] Trying to fix a race condition that happens on empty graphs sometimes, on some computers. 2017-10-29 23:22:45 +01:00
8351897e3a [core] Refactoring of commands to move towards a more pythonic way of running the jobs. Commands are now classes, and bonobo "graph" related commands now hooks into bonobo.run() calls so it will use what you actually put in your __main__ block. 2017-10-29 19:23:50 +01:00
cac6920040 Minor test change. 2017-10-29 12:13:52 +01:00
f9c809f626 [core] Change the token parsing part in prevision of different flags. 2017-10-29 12:10:02 +01:00
32e73316e1 Merge pull request #210 from mpenkov/streamjson
Support line-delimited JSON
2017-10-28 17:45:09 +02:00
10a82cce62 Support line-delimited JSON
New nodes for handling line-delimited JSON.

https://en.wikipedia.org/wiki/JSON_Streaming
2017-10-28 17:34:13 +02:00
08f0950f02 Update Makefile/setup. 2017-10-28 17:29:05 +02:00
ce0bd9ea37 Merge branch 'develop' of https://github.com/mpenkov/bonobo into mpenkov-develop 2017-10-28 17:27:04 +02:00
209c4f3176 Merge branch 'develop' of github.com:python-bonobo/bonobo into develop 2017-10-28 17:24:39 +02:00
efb31126b4 [tests] simplify assertion 2017-10-28 17:24:26 +02:00
3e7898a987 Issue #134: use requests.get as a context manager 2017-10-28 16:19:05 +02:00
eabc79c8ec Issue #134: use requests instead of urllib 2017-10-28 16:11:58 +02:00
66bda718c5 update Projectfile with download entry point 2017-10-28 15:58:07 +02:00
edc2321c54 Issue #134: update documentation 2017-10-28 14:20:53 +02:00
7d9b547a53 Merge branch 'zimmermann/import' of github.com:userzimmermann/bonobo into develop 2017-10-28 14:16:08 +02:00
9e86abca60 Issue #134: add a bonobo download url command
This enables users on different platforms to download the examples in
the tutorial using the same command.
2017-10-28 14:08:53 +02:00
a94efeaafc commands.run: Enable relative imports in main.py
Do project's main.py loading with importlib instead of runpy and define
a __bonobo__ parent package for the user directory
2017-10-28 13:08:48 +02:00
88ef23e93e Merge pull request #207 from PeterUe/develop
adapt tutorial "Working with files" to the latest develop version
2017-10-28 13:04:35 +02:00
9c5e98b18b adapt tutorial "Working with files" to the latest develop version 2017-10-28 12:34:20 +02:00
a8ebc4d4d7 Merge pull request #205 from mpenkov/develop
Add a note about the graph variable
2017-10-28 12:29:00 +02:00
bf5f870304 Add a note about the graph variable
It needs to be global and publicly available.  Some people reading the
tutorial may want to put it in its own function or the __main__
conditional, which won't work.
2017-10-28 12:10:39 +02:00
81738d796f Merge pull request #193 from arimbr/feature/bonobo-init-should-work-on-an-empty-existing-directory
Fix bonobo init should work on an empty existing directory
2017-10-25 09:18:05 +02:00
3fdefcda72 Update sidebarinfos.html 2017-10-24 11:14:11 +02:00
cb97b18dca [tests] trying to speed up the init test. 2017-10-23 22:58:35 +02:00
3f97eb05d8 Merge branch 'develop' of github.com:python-bonobo/bonobo into arimbr-feature/bonobo-init-should-work-on-an-empty-existing-directory 2017-10-23 22:45:52 +02:00
a935c8fa92 Merge branch 'feature/bonobo-init-should-work-on-an-empty-existing-directory' of git://github.com/arimbr/bonobo into arimbr-feature/bonobo-init-should-work-on-an-empty-existing-directory 2017-10-23 22:45:39 +02:00
0c865818a5 Merge pull request #198 from hartym/develop
Development of 0.6
2017-10-23 22:38:04 +02:00
a79c17c3e9 [tests] bonobo.util.objects 2017-10-23 22:15:19 +02:00
dd28e08f0f [nodes] Removing draft quality factory from bonobo main package, will live in separate personnal package until it is good enough to live here. 2017-10-23 21:56:13 +02:00
ece764b95c [tests] rename factory test and move bag detecting so any bag is returned as is as an output. 2017-10-23 21:28:49 +02:00
9a54f7b4aa [core] Still refactoring the core behaviour of bags, starting to be much simpler. 2017-10-23 21:18:02 +02:00
4641425e4c Fix python 3.5 os.chdir not accepting LocalPath 2017-10-23 00:30:10 +02:00
7c0071bfdf Remove unused shutil import 2017-10-22 23:30:23 +02:00
9820fca2b4 Use pytest tmpdir fixture and add more init tests 2017-10-22 23:26:59 +02:00
df45251622 Check if target directory is empty instead of current directory and remove overwrite_if_exists argument 2017-10-22 23:05:58 +02:00
f18889830b Remove dispatcher as it is not a dependency, for now, and as such breaks the continuous integration (yes, again.). 2017-10-22 18:11:11 +02:00
01a652cd05 Remove dispatcher as it is not a dependency, for now, and as such breaks the continuous integration. 2017-10-22 18:08:03 +02:00
3c453f0be7 Code formating. 2017-10-22 18:05:39 +02:00
28fe41c0bd [core] Testing and fixing new args/kwargs behaviour. 2017-10-22 18:00:16 +02:00
bc01b5d404 [core] simplification of result interpretation. 2017-10-22 17:37:49 +02:00
80006ba24d [tests] fix uncaptured output in test_commands 2017-10-22 17:23:19 +02:00
321bb83aa4 Documentation for new behaviour. 2017-10-22 16:57:46 +02:00
0c58d21b12 [django, misc] adds create_or_update to djangos ETLCommand class, adds getitem/setitem/contains dunders to ValueHolder. 2017-10-22 16:26:47 +02:00
42c1fee6f1 [core] (..., dict) means Bag(..., **dict) 2017-10-22 16:26:47 +02:00
650b49a41a [django, google] Implements basic extensions for django and google oauth systems.
Using those extensions means you have the correct dependencies installed, and that you know about the external system.

Django: just provide an ETLCommand class that contains all the shortcuts
to write django management commands based on Bonobo.

Google: shortcuts to create the necessary objects for oauth flow, with
local caching of credentials.

Both those extensions are not stable and will evolve.
2017-10-22 16:26:36 +02:00
329bf9e6ca Merge pull request #194 from hartym/develop
[core] Refactoring IOFormats so there is one and only obvious way to …
2017-10-21 12:58:37 +02:00