Darko Poljak
f368539447
Some pylint cleaning.
2017-08-22 10:58:30 +02:00
Philippe Gregoire
61b52ac806
Set default remote_cmds_cleanup_pattern
...
Fixes an exception when --remote-copy and --remote-exec are used.
2017-08-14 16:13:57 -04:00
Philippe Gregoire
7b0b3d9415
Fix remote cmds cleanup
...
When --remote-copy and --remote-exec are provided,
args.remote_cmds_cleanup_pattern is not set.
This patches fixes the evaluation of args.remote_cmds_cleanup_pattern
and prevents cdist from throwing an exception when --remote-copy
and --remote-exec are used.
2017-08-14 14:25:19 -04:00
Darko Poljak
75fe3272b3
Add file locking for -j parallel execution.
2017-08-13 12:26:20 +02:00
Darko Poljak
2b0e8160cf
Merge pull request #543 from darko-poljak/ssh-mux-sigpipe
...
Fix ssh connection multiplexing race condition #542
2017-08-10 23:42:16 +02:00
Darko Poljak
68cb13881f
Add archiving support.
2017-08-09 16:56:02 +02:00
Darko Poljak
0d734c872d
Fix log var assignment.
2017-07-27 09:36:00 +02:00
Darko Poljak
23fbabe303
Further improve parallel execution.
2017-07-26 17:39:07 +02:00
Darko Poljak
d1a044cc23
multiprocessing.Pool -> concurrent.futures.ProcessPoolExecutor
2017-07-26 12:01:19 +02:00
Darko Poljak
7c7a98d083
pep8
2017-07-25 12:43:54 +02:00
Darko Poljak
0af64c01bf
Add -p HOST_MAX argument.
2017-07-25 11:12:18 +02:00
Darko Poljak
060ddc2a17
Merge remote-tracking branch 'ungleich/master' into ssh-mux-sigpipe
2017-07-21 17:23:07 +02:00
Darko Poljak
e2a1519332
Merge inventory from beta branch.
2017-07-20 22:04:44 +02:00
Darko Poljak
a20b7167cd
pep8
2017-07-19 07:58:14 +02:00
Darko Poljak
01d7f63fcb
Merge remote-tracking branch 'ungleich/master' into ssh-mux-sigpipe
2017-07-19 07:55:19 +02:00
Darko Poljak
126a1812a5
Fix parallel object prepare and run steps. Add nonparallel type marker.
2017-07-15 22:18:20 +02:00
Darko Poljak
9c914308f6
Fix ssh connection multiplexing race condition #542
...
Increase ControlPersist to 2h.
After host run run ssh mux master exit command.
If custom remote exec/copy is specified then do nothing.
2017-07-06 12:43:17 +02:00
Steven Armstrong
9fe2420547
also log start of config run
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-07-05 16:40:02 +02:00
Steven Armstrong
a1d73f7281
log changing object as Processing instead of Updating
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-07-04 23:49:43 +02:00
Steven Armstrong
f6e1174adb
start moving info log messages to verbose
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-07-04 23:49:43 +02:00
Darko Poljak
a37d286d67
Suppress subprocess script output in quiet mode.
2017-07-04 23:49:43 +02:00
Darko Poljak
a722f3c634
3rd iteration of logging cleanup.
2017-07-04 23:49:43 +02:00
Darko Poljak
248656b81f
First iteration of logging cleanup.
2017-07-04 23:49:43 +02:00
Darko Poljak
138705e3dc
Code improvements.
2017-07-02 00:32:43 +02:00
Darko Poljak
2a9bd77550
Merge custom cache path pattern from beta branch.
2017-07-01 23:59:51 +02:00
Steven Armstrong
93ccf925cd
need a way to set remote.base_path from the command line
...
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-06-27 10:36:26 +02:00
Darko Poljak
e375bd464d
Merge remote-tracking branch 'ungleich/master' into the-good-the-bad-and-the-ugly
2017-06-12 13:15:00 +02:00
Darko Poljak
29bebc4af4
Shorten ssh control path.
...
On macos the path is too long due to long default TMP dir.
2017-05-31 09:55:33 +02:00
Darko Poljak
e5a6599ccb
Create mp_pool_run helper function for running in parallel.
2016-12-08 21:48:59 +01:00
Darko Poljak
8776a2ee06
concurrent.futures -> multiprocessing
2016-12-08 17:36:57 +01:00
Darko Poljak
e6b9fc90ba
Add log messages.
2016-12-08 14:11:30 +01:00
Darko Poljak
ca3a8ddf67
no clear() in python < 3.3; if only one then do it sequentially
2016-12-08 00:47:07 +01:00
Darko Poljak
1952d43073
Initial try for parallelization.
2016-12-07 19:06:51 +01:00
Darko Poljak
258a6c7f56
Merge branch 'the-good-the-bad-and-the-ugly-gunfight' into the-good-the-bad-and-the-ugly
2016-12-07 18:57:58 +01:00
Darko Poljak
341de216a6
Fix missing vars.
2016-12-07 18:39:43 +01:00
Darko Poljak
6c1b215db8
Begin parallelizing object prepare and run.
2016-12-06 14:27:17 +01:00
Darko Poljak
e6fc74c081
ugly -> bad
2016-12-03 18:12:38 +01:00
Darko Poljak
8c53ce78f5
Started the good, the bad and the ugly - code cleanup.
2016-12-03 10:46:49 +01:00
Darko Poljak
9268062de5
Fix target_host vars in Code.
2016-11-03 13:26:50 +01:00
Darko Poljak
74652cec13
Write more informative warning messages.
2016-09-21 19:22:24 +02:00
Darko Poljak
b5262c850e
Exit cleanly in case of non UTF-8 file.
2016-08-21 21:48:21 +02:00
Darko Poljak
7f1e41f769
Move hostfile line processing to new method.
2016-08-19 21:56:24 +02:00
Darko Poljak
7aa4b2d40a
Support comments in hostfile, skip empty lines.
2016-08-19 13:37:57 +02:00
Darko Poljak
680806ce76
Fix getting host_name and host_fqdn.
2016-08-17 20:46:56 +02:00
Darko Poljak
2fb551131e
Fix error when non-existing host is used.
2016-08-17 20:27:51 +02:00
Darko Poljak
fdf6a6570c
Check for beta in scripts/cdist.
2016-08-15 16:01:39 +02:00
Darko Poljak
1c07b63f1d
Add -b/--enable-beta option for enabling beta functionalities.
2016-08-15 14:20:35 +02:00
Darko Poljak
f858191976
Merge remote-tracking branch 'ungleich/master' into parallel-global-explorers-execution
2016-08-14 22:27:39 +02:00
Darko Poljak
a4c49201c0
Add jobs option for parallel execution, global explorers first.
2016-08-11 23:54:31 +02:00
Darko Poljak
45298b810c
Add more comments.
2016-08-11 00:04:37 +02:00