900 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Marek Marczykowski-Górecki	8d884a52e6	tests: disable slow tests unless ENABLE_SLOW_TESTS=1 is set	2017-07-21 03:54:04 +02:00
Marek Marczykowski-Górecki	ea47701fe6	tools/qvm-backup-restore: fix restoring only specific VMs ... Related to QubesOS/qubes-issues#2924	2017-07-21 03:54:04 +02:00
Marek Marczykowski-Górecki	c50fc21e44	tests: qvm-backup-restore tool tests ... Very simple one, but also fix reporting errors detected by tests.	2017-07-21 03:54:04 +02:00
Marek Marczykowski-Górecki	3c9fb8dbac	tools/qvm-volume: fix default action handling	2017-07-21 03:10:02 +02:00
Marek Marczykowski-Górecki	ae0729fb53	storage: drop 'internal' volume property ... Since external block devices use Devices API now, it isn't useful anymore. QubesOS/qubes-issues#2256	2017-07-21 03:10:01 +02:00
Marek Marczykowski-Górecki	c736395432	tools/qvm-backup-restore: fix default list of VMs to restore ... By default restore all of them, not only the ones named "[" or "]" (which are invalid name). Fixes QubesOS/qubes-issues#2924	2017-07-19 23:52:11 +02:00
Marek Marczykowski-Górecki	6f1c7c2b23	version 4.0.2	2017-07-18 05:37:29 +02:00
Marek Marczykowski-Górecki	756235d4f3	Change 'hvm' property to 'virt_mode' ... QubesOS/qubes-issues#2912	2017-07-18 04:22:34 +02:00
Marek Marczykowski-Górecki	7b9ee45c07	Choose QubesLocal or QubesRemote based on /etc/qubes-release presence ... Do not check for qubesd socket (at module import time), because if not running at this precise time, it will lead to wrong choice. And a weird error message in consequence (looking for qrexec-client-vm in dom0). Fixes QubesOS/qubes-issues#2917	2017-07-18 01:58:33 +02:00
Marek Marczykowski-Górecki	0c0b625a70	Merge branch 'devel-backup'	2017-07-18 01:49:37 +02:00
Marek Marczykowski-Górecki	f058c48c92	Merge branch 'devel-2-qvm-run-1' ... * devel-2-qvm-run-1: Make pylint happy tools/qvm-run: fix handling EOF tests: mark qvm-run tests with "expected failure" tools/qvm-run: fix handling copying stdin to the process	2017-07-18 01:49:16 +02:00
Marek Marczykowski-Górecki	5178029a3c	Make pylint happy	2017-07-18 01:32:06 +02:00
Marek Marczykowski-Górecki	706cecd60d	tools/qvm-run: fix handling EOF	2017-07-18 01:12:43 +02:00
Marek Marczykowski-Górecki	40a1769806	tests: mark qvm-run tests with "expected failure" ... since qvm-run use multiprocessing.Process now, stdin sent to it is processed in separate process and doesn't come back to TestApp.actual_calls (self.app). Annotate tests for now, to be fixed later.	2017-07-18 01:03:57 +02:00
Marek Marczykowski-Górecki	e7ee06936a	tools/qvm-backup-restore: handle VMs selection, not only exclusion ... QubesOS/qubes-issues#1214	2017-07-17 23:34:03 +02:00
Marek Marczykowski-Górecki	ce2215c603	backup: improve error logging ... Include VM and volume name in data-related error mesages. QubesOS/qubes-issues#1214	2017-07-17 23:32:31 +02:00
Marek Marczykowski-Górecki	f2fa613dce	backup: use 'cat' instead of read-write loop in python ... The most important part is fixing resize handling - call size_func before data_func, but after tar gets initial data (and output file size). But other than that, it makes the process a little faster. QubesOS/qubes-issues#1214	2017-07-17 23:30:37 +02:00
Marek Marczykowski-Górecki	96d4a2f066	backup: change 'hvm' property to 'virt_mode' ... QubesOS/qubes-issues#2912	2017-07-17 20:40:08 +02:00
Marek Marczykowski-Górecki	ced735b476	backup: do not show full stacktrace to the user ... Opt for a simple one-liner error messages, instead of meaningless stack trace (it's most of the time about qubesd responding with error, so the stack trace of actual problem is elsewhere).	2017-07-17 20:28:23 +02:00
Marek Marczykowski-Górecki	ca399c1a5a	app: call admin.vm.volume.Import as root ... This is needed to write LVM data.	2017-07-17 20:28:23 +02:00
Marek Marczykowski-Górecki	f0151d73b3	tools: add qvm-backup-restore ... Frontend tool for backup restore code. Fixes QubesOS/qubes-issues#1214	2017-07-17 20:28:22 +02:00
Marek Marczykowski-Górecki	137e1ed877	tests: backup: add firewall.xml and appmenus checking	2017-07-17 20:28:22 +02:00
Marek Marczykowski-Górecki	51f77d5834	firewall: fix handling DstHost.prefixlen=0 ... Do not silently convert it into 32 or 128 netmask. And also do not include it actual rule (it's no-op check).	2017-07-17 20:28:22 +02:00
Marek Marczykowski-Górecki	f1036c27a7	backup: add firewall and appmenus list handling	2017-07-17 20:28:21 +02:00
Marek Marczykowski-Górecki	04ad224a9d	tests: add v4 (Qubes 4.0) backup format tests, move qubes.xml ... Move qubes.xml to be tested into separate files. The backup tests script is long enouch already.	2017-07-17 20:28:21 +02:00
Marek Marczykowski-Górecki	525f8dc7f3	tests/backup: use smaller images ... This will be less realistic (private.img of 2MB?!), but makes tests much quicker. And since tar is used to make files sparse, we don't really test multi-part archives anyway.	2017-07-17 20:28:20 +02:00
Marek Marczykowski-Górecki	a91372a919	devices,features: fix bool values handling ... API define False value serialized as '' and True as 'True'. Do not serialize 0 as '' (features) or True as 'yes' (devices).	2017-07-17 20:27:35 +02:00
Marek Marczykowski-Górecki	2ab31e63dc	Exclude 'qubesadmin.backup' module from python2 install	2017-07-17 20:27:35 +02:00
Marek Marczykowski-Górecki	e6d3425047	tests/backup: tests for backup-restore code ... Based on "backup compatibility" tests, which manually assemble the backup. This is because we don't have access to actual backup creation code here. QubesOS/qubes-issues#1214	2017-07-17 20:27:32 +02:00
Marek Marczykowski-Górecki	268a3453a9	backup: initial support for backup restore over Admin API ... The code is mostly copied from core-admin. QubesOS/qubes-issues#1214	2017-07-17 20:24:34 +02:00
Marek Marczykowski-Górecki	66f2e9c889	Merge remote-tracking branch 'qubesos/pr/11' ... * qubesos/pr/11: added helper function updates_vms_status	2017-07-15 22:01:04 +02:00
Marek Marczykowski-Górecki	68ed06a200	Don't try to set 'created-by-' tag when cloning VM ... This tag can't be set from outside of qubesd.	2017-07-14 04:14:46 +02:00
Marek Marczykowski-Górecki	941b553b81	tools/qvm-run: fix handling copying stdin to the process ... Launch stdin copy loop in a separate process (multiprocessing.Process) and terminate it when target process is terminated. Another idea here was threads, but there is no API to kill a thread waiting on read().	2017-07-08 00:11:15 +02:00
Marek Marczykowski-Górecki	a3e3dac6dc	tests: improve test failure message ... When multiple Admin API calls are expected, but not all were made, show which were missing.	2017-07-08 00:08:20 +02:00
Marek Marczykowski-Górecki	b35303ff62	events: fix cleanup function in qrexec case ... qrexec-client-vm process may be already dead, don't treat this as an error.	2017-07-08 00:08:20 +02:00
Marek Marczykowski-Górecki	e6149b09ce	Fix VM creation with default template ... Fixes QubesOS/qubes-issues#2866	2017-07-08 00:08:19 +02:00
Marek Marczykowski-Górecki	9036103102	tests: qvm-shutdown --wait tests	2017-07-08 00:08:19 +02:00
Marek Marczykowski-Górecki	6b1c6141f6	tests/tools: add MockEventsReader ... Make it easy to test things listening for events	2017-07-08 00:08:19 +02:00
Marek Marczykowski-Górecki	389252f386	tools: handle shutdown order in qvm-shutdown ... VMs can have runtime dependencies - for example it isn't possible to shutdown netvm used by some other running VM(s). Since client-side tools may not have full knowledge about rules enforcing those dependencies (for example may not have access to 'netvm' property), implement best-effort approach: 1. Try to shutdown all requested VMs 2. For those where shutdown request succeed, wait for actual shutdown 3. For others - go back to step 1 And loop until all VMs are shutdown, or all shutdown requests fails.	2017-07-08 00:08:19 +02:00
Marek Marczykowski-Górecki	2052b32202	events: simplify wait_for_domain_shutdown coroutine ... 1. Handle timeout externally - using asyncio.wait_for. 2. Add support for waiting for multiple VMs.	2017-07-06 22:01:17 +02:00
Marek Marczykowski-Górecki	43ef244eaa	vm: make QubesVM objects hashable	2017-07-06 22:01:16 +02:00
Marek Marczykowski-Górecki	8f7b0009db	version 4.0.1	2017-07-05 20:14:12 +02:00
Marek Marczykowski-Górecki	a2d9303ea9	app: fix policy deny reporting when running in VM ... qrexec-client-vm non-zero exit code means policy have denied the call. Treat this exactly the same as empty response (in dom0 case).	2017-07-05 14:16:31 +02:00
Marek Marczykowski-Górecki	d8f018eb95	tools: clarify help in qvm-template-postprocess	2017-07-05 14:16:31 +02:00
Marek Marczykowski-Górecki	7c9699cd87	tools: split calling qubes.PostInstall service to a separate function ... The code is long enough to warrant separate function (suggested by pylint).	2017-07-05 14:16:31 +02:00
Marek Marczykowski-Górecki	627aebf2cd	tools: remove policy handling from qvm-firewall tool ... Follow the API removal QubesOS/qubes-issues#2869	2017-07-05 14:16:30 +02:00
Marek Marczykowski-Górecki	942e122d27	firewall: drop GetPolicy/SetPolicy calls ... Firewall policy is now hardcoded to 'drop'. Keep the property, so anyone trying to assign it will get an exception QubesOS/qubes-issues#2869	2017-07-05 14:16:30 +02:00
Marek Marczykowski-Górecki	ade5083e5e	app: do not clone 'uuid' property ... Cloned VM have new UUID	2017-07-05 14:16:30 +02:00
Marek Marczykowski-Górecki	c6eb4c49a3	storage: rework clone as two-stage operation ... Split clone to two Admin API calls - one to the source volume, then other to destination.	2017-07-05 14:16:30 +02:00
Marek Marczykowski-Górecki	88de4f77a5	tests: handle returning different response for the same request ... Allow programming different responses for the same request when called multiple times. This is useful for example for shutdown tests - first domain is running, but after issuing shutdown request is is not.	2017-07-05 14:16:29 +02:00