23fbabe303
Further improve parallel execution.
2017-07-26 17:39:07 +02:00
d1a044cc23
multiprocessing.Pool -> concurrent.futures.ProcessPoolExecutor
2017-07-26 12:01:19 +02:00
7c7a98d083
pep8
2017-07-25 12:43:54 +02:00
0af64c01bf
Add -p HOST_MAX argument.
2017-07-25 11:12:18 +02:00
060ddc2a17
Merge remote-tracking branch 'ungleich/master' into ssh-mux-sigpipe
2017-07-21 17:23:07 +02:00
e2a1519332
Merge inventory from beta branch.
2017-07-20 22:04:44 +02:00
a20b7167cd
pep8
2017-07-19 07:58:14 +02:00
01d7f63fcb
Merge remote-tracking branch 'ungleich/master' into ssh-mux-sigpipe
2017-07-19 07:55:19 +02:00
126a1812a5
Fix parallel object prepare and run steps. Add nonparallel type marker.
2017-07-15 22:18:20 +02:00
9c914308f6
Fix ssh connection multiplexing race condition #542
...
Increase ControlPersist to 2h.
After host run run ssh mux master exit command.
If custom remote exec/copy is specified then do nothing.
2017-07-06 12:43:17 +02:00
9fe2420547
also log start of config run
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-07-05 16:40:02 +02:00
a1d73f7281
log changing object as Processing instead of Updating
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-07-04 23:49:43 +02:00
f6e1174adb
start moving info log messages to verbose
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-07-04 23:49:43 +02:00
a37d286d67
Suppress subprocess script output in quiet mode.
2017-07-04 23:49:43 +02:00
a722f3c634
3rd iteration of logging cleanup.
2017-07-04 23:49:43 +02:00
248656b81f
First iteration of logging cleanup.
2017-07-04 23:49:43 +02:00
138705e3dc
Code improvements.
2017-07-02 00:32:43 +02:00
2a9bd77550
Merge custom cache path pattern from beta branch.
2017-07-01 23:59:51 +02:00
93ccf925cd
need a way to set remote.base_path from the command line
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-06-27 10:36:26 +02:00
e375bd464d
Merge remote-tracking branch 'ungleich/master' into the-good-the-bad-and-the-ugly
2017-06-12 13:15:00 +02:00
29bebc4af4
Shorten ssh control path.
...
On macos the path is too long due to long default TMP dir.
2017-05-31 09:55:33 +02:00
e5a6599ccb
Create mp_pool_run helper function for running in parallel.
2016-12-08 21:48:59 +01:00
8776a2ee06
concurrent.futures -> multiprocessing
2016-12-08 17:36:57 +01:00
e6b9fc90ba
Add log messages.
2016-12-08 14:11:30 +01:00
ca3a8ddf67
no clear() in python < 3.3; if only one then do it sequentially
2016-12-08 00:47:07 +01:00
1952d43073
Initial try for parallelization.
2016-12-07 19:06:51 +01:00
258a6c7f56
Merge branch 'the-good-the-bad-and-the-ugly-gunfight' into the-good-the-bad-and-the-ugly
2016-12-07 18:57:58 +01:00
341de216a6
Fix missing vars.
2016-12-07 18:39:43 +01:00
6c1b215db8
Begin parallelizing object prepare and run.
2016-12-06 14:27:17 +01:00
e6fc74c081
ugly -> bad
2016-12-03 18:12:38 +01:00
8c53ce78f5
Started the good, the bad and the ugly - code cleanup.
2016-12-03 10:46:49 +01:00
9268062de5
Fix target_host vars in Code.
2016-11-03 13:26:50 +01:00
74652cec13
Write more informative warning messages.
2016-09-21 19:22:24 +02:00
b5262c850e
Exit cleanly in case of non UTF-8 file.
2016-08-21 21:48:21 +02:00
7f1e41f769
Move hostfile line processing to new method.
2016-08-19 21:56:24 +02:00
7aa4b2d40a
Support comments in hostfile, skip empty lines.
2016-08-19 13:37:57 +02:00
680806ce76
Fix getting host_name and host_fqdn.
2016-08-17 20:46:56 +02:00
2fb551131e
Fix error when non-existing host is used.
2016-08-17 20:27:51 +02:00
fdf6a6570c
Check for beta in scripts/cdist.
2016-08-15 16:01:39 +02:00
1c07b63f1d
Add -b/--enable-beta option for enabling beta functionalities.
2016-08-15 14:20:35 +02:00
f858191976
Merge remote-tracking branch 'ungleich/master' into parallel-global-explorers-execution
2016-08-14 22:27:39 +02:00
a4c49201c0
Add jobs option for parallel execution, global explorers first.
2016-08-11 23:54:31 +02:00
45298b810c
Add more comments.
2016-08-11 00:04:37 +02:00
dbcc94ab65
Add derived env vars for target hostname and fqdn.
2016-08-10 23:56:56 +02:00
6f28fc2db2
Fix ssh mux socket file error.
...
ssh ControlPath socket file needs to be unique for each host.
To avoid using ssh ControlPath option placeholders move socket file
to host's temp directory. Since each host has unique temp
directory then, although file name for socket file is fixed, its path
is unique.
2016-07-23 16:13:59 +02:00
64efa04599
pep8
2016-07-05 20:44:24 +02:00
fa5175fee5
Allow both hosts sources: command line args and file.
2016-05-22 09:45:08 +02:00
4fce4a631c
Add -f option for reading hosts from file or stdin.
2016-05-22 09:22:39 +02:00
73c77dd2d3
Let core use random .cdist directory for objects
...
Signed-off-by: Nico Schottelius <nico@freiheit.schottelius.org>
2015-03-05 15:02:26 +01:00
ff00df72ad
Merge branch 'master' into no-dot-cdist
2015-03-05 11:08:49 +01:00
0cf170b18e
prettier print when requirements are broken
...
Signed-off-by: Nico Schottelius <nico@freiheit.schottelius.org>
2015-02-10 21:59:39 +01:00
c363fc24de
begin to make OBJECT_MARKER dynamic
...
Signed-off-by: Nico Schottelius <nico@bento.schottelius.org>
2014-05-06 00:28:18 +02:00
16d51b3cf1
backport ignoring install types in config mode from install_integration branch
...
Signed-off-by: Nico Schottelius <nico@bento.schottelius.org>
2014-01-29 22:40:59 +01:00
fcfd2d0a3c
refactor so that there is no interaction between code-local and code-remote
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2013-11-26 16:31:18 +01:00
a3dea70a97
Revert "first generate and execute *-local, then *-remote"
...
This reverts commit cf22499538266b1b4fac1694254edfd8ba9be68d.
2013-11-26 16:31:18 +01:00
12ef3ca4d2
first generate and execute *-local, then *-remote
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2013-11-26 16:31:17 +01:00
589d50bdba
make --dry-run work, fixes #199
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2013-09-12 21:57:22 +02:00
760b7e7afb
++changes(2.3.2)
...
Signed-off-by: Nico Schottelius <nico@bento.schottelius.org>
2013-08-30 02:55:22 +02:00
3de9b869ac
there is no such thing as cdist install in master
...
remove all traces of it to prevent the ongoing merge issues when using the real thing
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2013-08-29 21:56:53 +02:00
2403fc59ee
refactor commandline: merge into its own class (and add first shell code)
...
Signed-off-by: Nico Schottelius <nico@bento.schottelius.org>
2013-08-07 09:24:10 +02:00
c9f728e073
lib/cdist => cdist (pypi)
...
Signed-off-by: Nico Schottelius <nico@brief.schottelius.org>
2012-10-25 17:21:58 +02:00
Darko Poljak
Darko Poljak
Steven Armstrong
Nico Schottelius
Nico Schottelius
Nico Schottelius