5251 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Marek Marczykowski-Górecki	4be325a383	tests: drop VM cleanup from tearDownClass, fix asyncio usage in tearDown ... When tearDownClass is executed, event loop is already closed. Since no test really need it right now, drop support for test class-wide VMs and convert those methods back to instance methods. Also put coroutines (vm.remove_from_disk, vm.kill) onto event loop.	2017-07-26 03:26:59 +02:00
Marek Marczykowski-Górecki	910f793c61	storage: fix Storage.clone and Storage.clone_volume ... 1. Volume.import_volume expect volume to be created first. 2. asyncio.wait do not accept generator, it must be concrete iterable.	2017-07-26 03:26:59 +02:00
Marek Marczykowski-Górecki	1af7034d57	tests: more tests fixes	2017-07-26 03:26:58 +02:00
Marek Marczykowski-Górecki	214c646417	firewall: raise ValueError on invalid hostname in dsthost= ... ...instead of AssertionError	2017-07-26 03:26:58 +02:00
Marek Marczykowski-Górecki	625c94d1f6	qmemman: don't load qubes.xml ... Only qubesd should load qubes.xml directly. Put a TODO comments for now in place of slow VM reporting, invent some better mechanism later. This loading of qubes.xml caused deadlocks, because qmemnan kept open file descriptor (in locked state).	2017-07-26 03:26:58 +02:00
Marek Marczykowski-Górecki	5d9bc00885	tests: fix AdminVM test ... Since it is no longer child of QubesVM, constructor do not take 'qid' and 'name' arguments. Also: - remove other dropped properties tests (netvm, storage related) - make the test working in non-dom0	2017-07-26 03:26:40 +02:00
Marek Marczykowski-Górecki	a9934316c1	tests: create temporary files in /tmp	2017-07-26 03:26:39 +02:00
Marek Marczykowski-Górecki	8bae2d39c2	tests: remove renaming test - it isn't supported anymore ... QubesOS/qubes-issues#2868	2017-07-26 03:26:39 +02:00
Marek Marczykowski-Górecki	8b2db94b41	tests: various fixes for storage tests ... - improve TestPool mock - init_volume now return appropriate mock type, instead of TestPool - improve patching base directory (/var/lib/qubes) - it is stored in more than one place... - fix inheritance in TC_01_ThinPool class - fix expected LVM volume names ('vm-' prefix) - fix cleanup after FilePool tests - remove temporary qubes.xml - asyncio usage - better reporting in integ.storage - include error message in the report, not only as a comment in code	2017-07-26 03:26:13 +02:00
Marek Marczykowski-Górecki	a8e2f3111d	tests: fix removing LVM volumes ... VM volumes have 'vm-' name prefix now. This is continuation of fd5386c storage/lvm: prefix VM LVM volumes with 'vm-'	2017-07-26 03:26:12 +02:00
Marek Marczykowski-Górecki	75394a1348	tests: fix asyncio usage in some tests	2017-07-26 03:26:12 +02:00
Marek Marczykowski-Górecki	ba2b034843	tests: minor fixes to api/admin tests ... Drop debug print, fix mocking Storage.remove (it is a coroutine).	2017-07-26 03:26:11 +02:00
Marek Marczykowski-Górecki	4208897146	storage/file: create -cow.img only when needed ... Do not create it at volume creation time. It it needed only when VM is running, so create it just before startup only. QubesOS/qubes-issues#2256	2017-07-26 03:26:11 +02:00
Marek Marczykowski-Górecki	c5667791e8	storage: move volume_config['source'] filling to one place ... Don't set 'source' volume in various places (each VM class constructor etc), do it as part of volume initialization. And when it needs to be re-calculated, call storage.init_volume again. This code was duplicated, and as usual in such a case, those copies were different - one have set 'size', the other one not. QubesOS/qubes-issues#2256	2017-07-26 03:26:11 +02:00
Marek Marczykowski-Górecki	3a21e1f1b3	app: do not create 'default' storage pool ... Since we have app.default_pool* properties, create appropriately named pool and let those properties choose the right pool. This also means we don't need to specify pool name in default volume config anymore QubesOS/qubes-issues#2256	2017-07-25 06:20:42 +02:00
Marek Marczykowski-Górecki	73a78ca0db	app: add missing setters for default_pool* global properties ... Function itself was already written, but not set in the properties. QubesOS/qubes-issues#2256	2017-07-25 05:21:32 +02:00
Marek Marczykowski-Górecki	1933a720d0	tests: add qdb_watch test ... Use dom0 instance of QubesDB, to be independent of working (or not) VMs at this stage. QubesOS/qubes-issues#2940	2017-07-25 05:20:39 +02:00
Marek Marczykowski-Górecki	67c382c8b0	ext/block: make use of QubesDB watch ... Actually use just introduced API. Also document new `device-list-change:class` event. QubesOS/qubes-issues#2940	2017-07-25 05:20:39 +02:00
Marek Marczykowski-Górecki	b7f0cf7d82	vm: add API for watching changes in QubesDB ... Provide an API for use QubesDB.watch() inside of qubesd. Fixes QubesOS/qubes-issues#2940	2017-07-25 05:20:39 +02:00
Marek Marczykowski-Górecki	d5b94d1cbd	vm: optimize imports ... Remove unused, sort others.	2017-07-25 05:20:39 +02:00
Marek Marczykowski-Górecki	354aa14c53	api/admin: don't send internal events in admin.Events ... Some events are internal for a sole purpose of getting some data from extension. Since listeners of admin.Events cannot return anything, there is no sense in sending those events there.	2017-07-25 05:20:38 +02:00
Marek Marczykowski-Górecki	b25cf4b085	Add explanation why admin.vm.volume.Import is a custom script ... Cc @rootkovska	2017-07-25 05:20:38 +02:00
Marek Marczykowski-Górecki	0fb7c1fbed	Follow change of qubesdb path return type ... It's str/unicode, not bytes now. QubesOS/qubes-issues#2937	2017-07-25 05:20:38 +02:00
Marek Marczykowski-Górecki	1759bca00f	Rename vm.qdb to vm.untrusted_qdb ... QubesDB can be freely modified by a VM, so one should take care when reading any data retrieved from it. Fixes QubesOS/qubes-issues#2934	2017-07-24 13:01:55 +02:00
Marek Marczykowski-Górecki	cdbe1d14b3	rpm: include directory for backup profiles ... QubesOS/qubes-issues#2931	2017-07-21 03:16:57 +02:00
Marek Marczykowski-Górecki	397a8263bd	tarwriter: use new PAX format, instead of old GNU for sparse files ... The old format have many issues and is discouraged by tar developers. In this case the most important one is header with possible non-ASCII characters, which will result in UnicodeDecodeError (tarfile module require header parts in utf-8). PAX format is much cleaner, as it use standard mechanism for extended headers.	2017-07-21 03:14:06 +02:00
Marek Marczykowski-Górecki	abdad8c2b2	backup: allow backup running VMs ... Since we have LVM by default, it is possible to backup VMs while they are running. For now it will include its state from before startup, but later we may implement some other logic (a snapshot of running VM).	2017-07-21 03:12:23 +02:00
Marek Marczykowski-Górecki	1ec0060577	backup: check inner archiver exit code ... If inner tar returns with non-zero code, mostly like the backup is incomplete, so it is very important to report it.	2017-07-21 03:11:02 +02:00
Marek Marczykowski-Górecki	82918ee704	api/admin: gracefuly report cancelled backup operation ... QubesOS/qubes-issues#2931	2017-07-21 03:10:26 +02:00
Marek Marczykowski-Górecki	088c838ac3	storage: typo fix in comment	2017-07-20 12:19:02 +02:00
Marek Marczykowski-Górecki	dbea03ad1f	tests: admin.backup.* ... Those tests are only about Admin API integration, not about actual backup backend code QubesOS/qubes-issues#2931	2017-07-20 12:19:01 +02:00
Marek Marczykowski-Górecki	74375146e8	tools/qubesd: increase loglevel with --debug option	2017-07-20 12:19:01 +02:00
Marek Marczykowski-Górecki	6dbce8259f	api/admin: plug backup into Admin API ... Fixes QubesOS/qubes-issues#2931	2017-07-20 12:19:01 +02:00
Marek Marczykowski-Górecki	81246cac64	backup: fix get_backup_summary ... QubesOS/qubes-issues#2931	2017-07-20 12:09:17 +02:00
Marek Marczykowski-Górecki	579d90e174	backup: use proper API for getting volumes list and size ... Do not assume static list of volume (although it is true for now), and also use proper API for getting volume size, instead of assuming it's a normal file.	2017-07-20 12:09:17 +02:00
Marek Marczykowski-Górecki	9dd0cfe6c5	backup: drop BackupHeader loading code ... It is useless here since backup restore is moved to qubes-core-admin-client.	2017-07-20 12:09:16 +02:00
Marek Marczykowski-Górecki	d4e9120903	backup: convert from multiprocessing to asyncio ... QubesOS/qubes-issues#2931	2017-07-20 02:48:44 +02:00
Marek Marczykowski-Górecki	c17e63588e	version 4.0.2	2017-07-18 05:32:56 +02:00
Marek Marczykowski-Górecki	c035f8fc35	systemd: order VMs autostart after qubesd ... Fixes QubesOS/qubes-issues#2919	2017-07-18 04:04:26 +02:00
Marek Marczykowski-Górecki	801d6acf5c	Rename 'net/*' features to 'net.*' ... Same reasoning as with 'service/*' - '/' is not allowed in qrexec (so Admin API) call argument. Related to QubesOS/qubes-issues#2906	2017-07-18 03:50:02 +02:00
Marek Marczykowski-Górecki	9e4f2d0907	Merge remote-tracking branch 'qubesos/pr/131' ... * qubesos/pr/131: When running tests clean up and remove qubesd.socket Do not display gi Gtk warning when running tests	2017-07-18 02:19:34 +02:00
Marek Marczykowski-Górecki	c6e09b5a99	storage: fix resize and revert handling ... - fix coroutine calling from Admin API - fix off-by-one error in resize - adjust tests	2017-07-18 01:42:37 +02:00
Marek Marczykowski-Górecki	7f85d81197	Remove qvm-backup tool ... The tool itself should live in qubes-core-admin-client and communicate with actual backup code over Admin API.	2017-07-18 01:42:37 +02:00
Marek Marczykowski-Górecki	2ace5901df	backup: make pylint happy, remove dead settings ... After removing backup-restore code the remaining part of backup.py is not that bad - lets fix it and no longer exclude it from pylint.	2017-07-18 01:42:36 +02:00
Marek Marczykowski-Górecki	61519014cb	Remove qvm-backup-restore and its backend code ... This functionality is moved to qubes-core-admin-client, which does it over Admin API QubesOS/qubes-issues#1214	2017-07-18 01:30:39 +02:00
Marek Marczykowski-Górecki	4037bf9abc	vm/qubesvm: do not assign all host vCPUs to a qube ... Fixes QubesOS/qubes-issues#2900	2017-07-17 12:33:52 +02:00
Marek Marczykowski-Górecki	11fac7be56	vm/qubesvm: minor fix	2017-07-17 12:29:25 +02:00
Marek Marczykowski-Górecki	8dfe2b873d	Fix libvirt xml template ... Issue found by the test created in previous commit.	2017-07-17 12:28:56 +02:00
Marek Marczykowski-Górecki	ef756eb05d	tests: libvirt xml rendering unit test	2017-07-17 12:28:24 +02:00
Marek Marczykowski-Górecki	9ba84ecdad	Add code and test for migrating vm.hvm into vm.virt_mode ... This will allow to load old qubes.xml - otherwise previous change render the system unusable (until manual qubes.xml edit). QubesOS/qubes-issues#2912	2017-07-17 12:27:17 +02:00