Commit Graph

68 Commits

Author SHA1 Message Date
Darko Poljak f368539447 Some pylint cleaning. 2017-08-22 10:58:30 +02:00
Philippe Gregoire 61b52ac806 Set default remote_cmds_cleanup_pattern
Fixes an exception when --remote-copy and --remote-exec are used.
2017-08-14 16:13:57 -04:00
Philippe Gregoire 7b0b3d9415 Fix remote cmds cleanup
When --remote-copy and --remote-exec are provided,
args.remote_cmds_cleanup_pattern is not set.

This patches fixes the evaluation of args.remote_cmds_cleanup_pattern
and prevents cdist from throwing an exception when --remote-copy
and --remote-exec are used.
2017-08-14 14:25:19 -04:00
Darko Poljak 75fe3272b3 Add file locking for -j parallel execution. 2017-08-13 12:26:20 +02:00
Darko Poljak 2b0e8160cf Merge pull request #543 from darko-poljak/ssh-mux-sigpipe
Fix ssh connection multiplexing race condition #542
2017-08-10 23:42:16 +02:00
Darko Poljak 68cb13881f Add archiving support. 2017-08-09 16:56:02 +02:00
Darko Poljak 0d734c872d Fix log var assignment. 2017-07-27 09:36:00 +02:00
Darko Poljak 23fbabe303 Further improve parallel execution. 2017-07-26 17:39:07 +02:00
Darko Poljak d1a044cc23 multiprocessing.Pool -> concurrent.futures.ProcessPoolExecutor 2017-07-26 12:01:19 +02:00
Darko Poljak 7c7a98d083 pep8 2017-07-25 12:43:54 +02:00
Darko Poljak 0af64c01bf Add -p HOST_MAX argument. 2017-07-25 11:12:18 +02:00
Darko Poljak 060ddc2a17 Merge remote-tracking branch 'ungleich/master' into ssh-mux-sigpipe 2017-07-21 17:23:07 +02:00
Darko Poljak e2a1519332 Merge inventory from beta branch. 2017-07-20 22:04:44 +02:00
Darko Poljak a20b7167cd pep8 2017-07-19 07:58:14 +02:00
Darko Poljak 01d7f63fcb Merge remote-tracking branch 'ungleich/master' into ssh-mux-sigpipe 2017-07-19 07:55:19 +02:00
Darko Poljak 126a1812a5 Fix parallel object prepare and run steps. Add nonparallel type marker. 2017-07-15 22:18:20 +02:00
Darko Poljak 9c914308f6 Fix ssh connection multiplexing race condition #542
Increase ControlPersist to 2h.
After host run run ssh mux master exit command.
If custom remote exec/copy is specified then do nothing.
2017-07-06 12:43:17 +02:00
Steven Armstrong 9fe2420547 also log start of config run
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-07-05 16:40:02 +02:00
Steven Armstrong a1d73f7281 log changing object as Processing instead of Updating
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-07-04 23:49:43 +02:00
Steven Armstrong f6e1174adb start moving info log messages to verbose
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-07-04 23:49:43 +02:00
Darko Poljak a37d286d67 Suppress subprocess script output in quiet mode. 2017-07-04 23:49:43 +02:00
Darko Poljak a722f3c634 3rd iteration of logging cleanup. 2017-07-04 23:49:43 +02:00
Darko Poljak 248656b81f First iteration of logging cleanup. 2017-07-04 23:49:43 +02:00
Darko Poljak 138705e3dc Code improvements. 2017-07-02 00:32:43 +02:00
Darko Poljak 2a9bd77550 Merge custom cache path pattern from beta branch. 2017-07-01 23:59:51 +02:00
Steven Armstrong 93ccf925cd need a way to set remote.base_path from the command line
Signed-off-by: Steven Armstrong <steven@icarus.ethz.ch>
2017-06-27 10:36:26 +02:00
Darko Poljak e375bd464d Merge remote-tracking branch 'ungleich/master' into the-good-the-bad-and-the-ugly 2017-06-12 13:15:00 +02:00
Darko Poljak 29bebc4af4 Shorten ssh control path.
On macos the path is too long due to long default TMP dir.
2017-05-31 09:55:33 +02:00
Darko Poljak e5a6599ccb Create mp_pool_run helper function for running in parallel. 2016-12-08 21:48:59 +01:00
Darko Poljak 8776a2ee06 concurrent.futures -> multiprocessing 2016-12-08 17:36:57 +01:00
Darko Poljak e6b9fc90ba Add log messages. 2016-12-08 14:11:30 +01:00
Darko Poljak ca3a8ddf67 no clear() in python < 3.3; if only one then do it sequentially 2016-12-08 00:47:07 +01:00
Darko Poljak 1952d43073 Initial try for parallelization. 2016-12-07 19:06:51 +01:00
Darko Poljak 258a6c7f56 Merge branch 'the-good-the-bad-and-the-ugly-gunfight' into the-good-the-bad-and-the-ugly 2016-12-07 18:57:58 +01:00
Darko Poljak 341de216a6 Fix missing vars. 2016-12-07 18:39:43 +01:00
Darko Poljak 6c1b215db8 Begin parallelizing object prepare and run. 2016-12-06 14:27:17 +01:00
Darko Poljak e6fc74c081 ugly -> bad 2016-12-03 18:12:38 +01:00
Darko Poljak 8c53ce78f5 Started the good, the bad and the ugly - code cleanup. 2016-12-03 10:46:49 +01:00
Darko Poljak 9268062de5 Fix target_host vars in Code. 2016-11-03 13:26:50 +01:00
Darko Poljak 74652cec13 Write more informative warning messages. 2016-09-21 19:22:24 +02:00
Darko Poljak b5262c850e Exit cleanly in case of non UTF-8 file. 2016-08-21 21:48:21 +02:00
Darko Poljak 7f1e41f769 Move hostfile line processing to new method. 2016-08-19 21:56:24 +02:00
Darko Poljak 7aa4b2d40a Support comments in hostfile, skip empty lines. 2016-08-19 13:37:57 +02:00
Darko Poljak 680806ce76 Fix getting host_name and host_fqdn. 2016-08-17 20:46:56 +02:00
Darko Poljak 2fb551131e Fix error when non-existing host is used. 2016-08-17 20:27:51 +02:00
Darko Poljak fdf6a6570c Check for beta in scripts/cdist. 2016-08-15 16:01:39 +02:00
Darko Poljak 1c07b63f1d Add -b/--enable-beta option for enabling beta functionalities. 2016-08-15 14:20:35 +02:00
Darko Poljak f858191976 Merge remote-tracking branch 'ungleich/master' into parallel-global-explorers-execution 2016-08-14 22:27:39 +02:00
Darko Poljak a4c49201c0 Add jobs option for parallel execution, global explorers first. 2016-08-11 23:54:31 +02:00
Darko Poljak 45298b810c Add more comments. 2016-08-11 00:04:37 +02:00